-- Logs begin at Tue 2021-11-02 11:55:58 UTC, end at Tue 2021-11-02 13:11:52 UTC. -- Nov 02 12:40:05.283210 dv-cinder-816324-1-iscsi systemd[1]: Started Devstack devstack@q-svc.service. Nov 02 12:40:08.067555 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.common.config [-] Logging enabled! Nov 02 12:40:08.068175 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev132 Nov 02 12:40:08.068329 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=108431) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 02 12:40:08.072017 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.common.config [-] Logging enabled! Nov 02 12:40:08.072266 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.common.config [-] /usr/local/bin/neutron-server version 19.1.0.dev132 Nov 02 12:40:08.072599 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] command line: /usr/local/bin/neutron-server --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=108431) setup_logging /opt/stack/neutron/neutron/common/config.py:112}} Nov 02 12:40:08.073586 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 12:40:08.073815 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] Configuration options gathered from: {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 12:40:08.074173 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 12:40:08.074438 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 12:40:08.074663 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ================================================================================ {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 12:40:08.074977 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] allow_bulk = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.075269 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] allow_overlapping_ips = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.075559 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] api_extensions_path = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.075784 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] api_paste_config = api-paste.ini {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.076070 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] api_workers = 2 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.076353 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] auth_strategy = keystone {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.076627 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] backlog = 4096 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.076911 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] base_mac = fa:16:3e:00:00:00 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.077197 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] bind_host = 0.0.0.0 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.077474 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] bind_port = 9696 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.077745 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] client_socket_timeout = 900 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.078021 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] config_dir = [] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.078244 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.078608 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] config_source = [] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.081596 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] control_exchange = neutron {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.081596 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] core_plugin = ml2 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.081596 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] debug = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.081596 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] default_availability_zones = [] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.081596 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.081596 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] dhcp_agent_notification = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.081977 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] dhcp_lease_duration = 86400 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.081977 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] dns_domain = openstacklocal {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.081977 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] enable_traditional_dhcp = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.081977 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] external_dns_driver = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.081977 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] filter_validation = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.081977 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] global_physnet_mtu = 1500 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.082309 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] host = dv-cinder-816324-1-iscsi {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.082618 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] http_retries = 3 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.082876 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] instance_format = [instance: %(uuid)s] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.083157 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.083436 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ipam_driver = internal {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.083706 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ipv6_pd_enabled = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.083973 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] log_config_append = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.084252 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.084522 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] log_dir = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.084818 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] log_file = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.085674 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] log_rotate_interval = 1 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.085942 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] log_rotate_interval_type = days {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.086224 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] log_rotation_type = none {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.086536 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.086760 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.086974 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.087257 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.087537 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.087806 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] max_dns_nameservers = 5 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.088071 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] max_header_line = 16384 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.088338 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] max_logfile_count = 30 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.088603 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] max_logfile_size_mb = 200 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.088873 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] max_subnet_host_routes = 20 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.089133 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] network_link_prefix = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.089417 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] notify_nova_on_port_data_changes = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.089756 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] notify_nova_on_port_status_changes = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.090091 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] pagination_max_limit = -1 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.090364 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] periodic_fuzzy_delay = 5 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.090654 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] periodic_interval = 40 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.090926 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] publish_errors = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.091192 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] rate_limit_burst = 0 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.091472 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] rate_limit_except_level = CRITICAL {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.091740 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] rate_limit_interval = 0 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.092006 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] retry_until_window = 30 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.092273 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] rpc_response_max_timeout = 600 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.092552 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] rpc_state_report_workers = 0 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.092814 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] rpc_workers = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.093083 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] send_events_interval = 2 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.093375 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.093654 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] setproctitle = on {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.093931 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] state_path = /opt/stack/data/neutron {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.094208 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] syslog_log_facility = LOG_USER {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.094501 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] tcp_keepidle = 600 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.094779 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] transport_url = **** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.095045 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] use_eventlog = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.095309 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] use_journal = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.095573 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] use_json = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.095889 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] use_ssl = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.096154 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] use_stderr = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.096429 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] use_syslog = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.096693 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] vlan_transparent = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.096959 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] watch_log_file = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.097222 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] wsgi_default_pool_size = 100 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.097485 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] wsgi_keep_alive = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.097763 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:08.098055 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_concurrency.disable_process_locking = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.098349 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.098670 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] profiler.connection_string = messaging:// {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.098951 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] profiler.enabled = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.099257 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] profiler.es_doc_type = notification {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.099532 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] profiler.es_scroll_size = 10000 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.099818 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] profiler.es_scroll_time = 2m {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.100090 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] profiler.filter_error_trace = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.100374 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] profiler.hmac_keys = SECRET_KEY {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.100679 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] profiler.sentinel_service_name = mymaster {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.100962 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] profiler.socket_timeout = 0.1 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.101264 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] profiler.trace_sqlalchemy = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.101546 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_policy.enforce_new_defaults = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.101817 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_policy.enforce_scope = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.102107 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_policy.policy_default_rule = default {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.102431 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.102722 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.103010 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.103283 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.103553 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.103823 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.104097 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.104378 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.104650 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.104937 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.105223 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.105497 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.105777 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] nova.auth_section = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.106066 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] nova.auth_type = password {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.106352 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.106642 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] nova.certfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.106964 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] nova.collect_timing = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.107253 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] nova.endpoint_type = public {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.107526 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] nova.insecure = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.107794 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] nova.keyfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.108065 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] nova.live_migration_events = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.108348 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] nova.region_name = RegionOne {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.108617 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] nova.split_loggers = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.108883 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] nova.timeout = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.109163 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] placement.auth_section = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.109434 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] placement.auth_type = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.109699 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] placement.cafile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.109964 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] placement.certfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.110233 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] placement.collect_timing = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.110544 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] placement.endpoint_type = public {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.110814 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] placement.insecure = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.111079 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] placement.keyfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.111341 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] placement.region_name = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.111610 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] placement.split_loggers = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.111877 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] placement.timeout = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.112152 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ironic.auth_section = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.112424 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ironic.auth_type = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.112695 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ironic.cafile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.112958 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ironic.certfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.113229 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ironic.collect_timing = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.113495 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ironic.connect_retries = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.113761 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ironic.connect_retry_delay = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.114029 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ironic.enable_notifications = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.114330 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ironic.endpoint_override = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.114623 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ironic.insecure = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.114892 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ironic.interface = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.115159 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ironic.keyfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.115426 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ironic.max_version = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.115691 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ironic.min_version = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.115956 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ironic.region_name = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.116240 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ironic.service_name = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.116504 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ironic.service_type = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.116772 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ironic.split_loggers = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.117035 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ironic.status_code_retries = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.117299 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ironic.status_code_retry_delay = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.117565 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ironic.timeout = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.117830 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ironic.valid_interfaces = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.118096 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ironic.version = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.118443 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] service_providers.service_provider = [] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.118780 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.119062 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.119336 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.119610 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.119884 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.120157 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.120427 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.120698 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.120970 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.121236 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.121521 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.121798 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.122080 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.122355 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.122647 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.122966 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.123241 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.123517 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.123788 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.124063 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.124385 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.124663 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.124952 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.125240 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.125527 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.125815 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_rabbit.ssl_version = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.126099 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_notifications.driver = [] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.126392 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_notifications.retry = -1 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.126700 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.126975 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] oslo_messaging_notifications.transport_url = **** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:08.127188 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.common.config [-] ******************************************************************************** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 12:40:08.127427 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo.service.wsgi [-] Loading app neutron from /etc/neutron/api-paste.ini {{(pid=108431) load_app /usr/local/lib/python3.8/dist-packages/oslo_service/wsgi.py:349}} Nov 02 12:40:08.562687 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=108431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 12:40:08.562956 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" released by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.001s {{(pid=108431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 12:40:08.563238 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=108431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Nov 02 12:40:08.563573 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.manager [-] Loading core plugin: ml2 Nov 02 12:40:08.894257 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:08.894571 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:08.894840 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:08.896079 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:08.896349 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:08.896612 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:08.932080 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:08.932347 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:08.932614 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:08.948417 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:08.948694 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:08.948959 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:08.981040 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:08.981320 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:08.981588 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.018064 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.018333 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.018625 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.258596 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.259234 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.259234 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.259414 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.260103 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.395148 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.395457 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.395785 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.396096 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.396404 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.396711 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.396991 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.397288 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.398155 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.398616 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.398997 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.399451 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.400935 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.401250 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.403044 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.403360 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.403661 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.403969 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.404276 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.404627 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.405113 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.405562 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.405987 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.406418 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.406687 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.406956 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.407393 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=108431) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 02 12:40:09.407666 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=108431) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 02 12:40:09.407931 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=108431) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 02 12:40:09.408195 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=108431) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 02 12:40:09.408454 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=108431) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 02 12:40:09.408709 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=108431) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 02 12:40:09.409099 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] Nov 02 12:40:09.412912 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['physnet1'] Nov 02 12:40:09.417941 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Nov 02 12:40:09.422216 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict([('physnet1', [(850, 899)])]) Nov 02 12:40:09.424184 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan'] Nov 02 12:40:09.424661 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'gre', 'local', 'vlan', 'vxlan']) Nov 02 12:40:09.424994 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['vlan'] Nov 02 12:40:09.425378 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security'] Nov 02 12:40:09.428386 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security'] Nov 02 12:40:09.428669 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security'] Nov 02 12:40:09.429038 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['openvswitch', 'hyperv'] Nov 02 12:40:09.435395 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.drivers.mech_agent [-] HyperV agent's supported_vnic_types: ['normal', 'direct'] Nov 02 12:40:09.461426 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.drivers.mech_agent [-] Open vSwitch agent's supported_vnic_types: ['normal', 'direct', 'smart-nic', 'vdpa'] Nov 02 12:40:09.461887 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > qos_plugin after_init 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.462187 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.services.qos.drivers.openvswitch.driver [-] Open vSwitch QoS driver registered {{(pid=108431) register /opt/stack/neutron/neutron/services/qos/drivers/openvswitch/driver.py:82}} Nov 02 12:40:09.462570 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > logging-plugin after_init 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.464024 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.services.logapi.drivers.openvswitch.driver [-] Open vSwitch logging driver registered {{(pid=108431) register /opt/stack/neutron/neutron/services/logapi/drivers/openvswitch/driver.py:69}} Nov 02 12:40:09.464324 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['openvswitch', 'hyperv'] Nov 02 12:40:09.464567 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['openvswitch', 'hyperv'] Nov 02 12:40:09.468194 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.468495 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:09.533809 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Nov 02 12:40:09.534004 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Nov 02 12:40:09.534197 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Nov 02 12:40:09.534607 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 1000)] Nov 02 12:40:09.555632 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_db.sqlalchemy.engines [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Nov 02 12:40:10.254813 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.managers [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Initializing driver for type 'gre' Nov 02 12:40:10.255372 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] gre ID ranges: [(1, 1000)] Nov 02 12:40:10.455349 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.managers [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Initializing driver for type 'local' Nov 02 12:40:10.456022 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.managers [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Initializing driver for type 'vlan' Nov 02 12:40:10.582514 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] VlanTypeDriver initialization complete Nov 02 12:40:10.582769 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.managers [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Initializing driver for type 'vxlan' Nov 02 12:40:10.583285 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.drivers.type_tunnel [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] vxlan ID ranges: [(1, 1000)] Nov 02 12:40:10.857001 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.managers [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Initializing extension driver 'port_security' Nov 02 12:40:10.857263 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.extensions.port_security [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] PortSecurityExtensionDriver initialization complete Nov 02 12:40:10.857621 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.managers [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Initializing mechanism driver 'openvswitch' Nov 02 12:40:10.857946 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.managers [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Initializing mechanism driver 'hyperv' Nov 02 12:40:10.870802 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.plugins.ml2.plugin [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=108431) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:40:10.871661 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > port after_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.872034 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > port after_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.872389 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > port after_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.872964 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[port] started {{(pid=108431) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 02 12:40:10.873395 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > subnet after_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.873747 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > subnet after_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.874092 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > subnet after_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.874527 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[subnet] started {{(pid=108431) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 02 12:40:10.874934 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > network after_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.875281 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > network after_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.875623 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > network after_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.876045 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[network] started {{(pid=108431) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 02 12:40:10.876421 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > security_group after_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.876769 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > security_group after_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.877106 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > security_group after_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.877500 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group] started {{(pid=108431) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 02 12:40:10.877904 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > security_group_rule after_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.878251 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > security_group_rule after_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.878618 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > security_group_rule after_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.879012 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[security_group_rule] started {{(pid=108431) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 02 12:40:10.879413 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > address_group after_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.879761 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > address_group after_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.880099 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > address_group after_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.880486 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.plugins.ml2.ovo_rpc [-] Thread ObjectChangeHandler[address_group] started {{(pid=108431) dispatch_events /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:105}} Nov 02 12:40:10.880859 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] ML2 OVO RPC backend initialized. {{(pid=108431) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:154}} Nov 02 12:40:10.881557 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > router_interface after_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.881943 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.882355 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > network before_response 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.882723 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > networks before_response 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.883068 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > port before_response 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.883408 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > ports before_response 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.883750 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > subnet before_response 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.884089 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > subnets before_response 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.884478 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > network after_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.884815 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > network after_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.885150 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > network after_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.885485 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > port after_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.885818 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > port after_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.886151 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > port after_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.886512 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > subnet after_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.886842 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > subnet after_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.887172 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > subnet after_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.887743 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.plugin [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Modular L2 Plugin initialization complete Nov 02 12:40:10.888065 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading services supported by the core plugin {{(pid=108431) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:168}} Nov 02 12:40:10.888386 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.plugins.ml2.managers [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Got port-security extension from driver 'port_security' Nov 02 12:40:10.888851 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.extensions.vlantransparent [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Disabled vlantransparent extension. Nov 02 12:40:10.889326 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading service plugins: ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=108431) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Nov 02 12:40:10.889677 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading Plugin: router Nov 02 12:40:10.938151 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > router_interface before_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.938566 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > router after_create 55549900 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.938938 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > router before_create 55549900 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.939304 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > router_interface before_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.939678 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > router_interface after_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.940066 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > router after_delete 55549900 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.940391 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > floatingip after_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.940860 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > floatingip after_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.941221 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > router after_create 55549900 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.941577 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > router after_update 55549900 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.941927 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > router after_update 55549900 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.942275 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > router_gateway after_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.942664 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > router after_update 55549900 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.943079 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > router precommit_update 55549900 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.943451 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: port after_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.943794 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: port after_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.944657 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: subnet after_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.945001 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: subnetpool_address_scope after_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.945346 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > port precommit_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.945692 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > router precommit_create 55549900 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.946033 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: port before_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.946396 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > router precommit_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.946774 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > router after_update 55549900 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.947099 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > router precommit_delete 55549900 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.947442 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > router precommit_create 55549900 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.947803 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > router_interface after_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.948148 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > router precommit_update 55549900 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.948513 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > agent after_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.948862 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > agent after_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.949205 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > network after_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.950109 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Tracking information for resource: router configured {{(pid=108431) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 02 12:40:10.950473 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Tracking information for resource: floatingip configured {{(pid=108431) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:205}} Nov 02 12:40:10.955649 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.db.l3_agentschedulers_db [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Skipping period L3 agent status check because automatic router rescheduling is disabled. Nov 02 12:40:10.956233 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: port after_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.956590 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: port after_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.956937 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: port after_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.957286 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: port after_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.958084 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > router before_create 55550100 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.958483 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > router precommit_delete 55550100 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.958849 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > router precommit_create 55550100 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.959205 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > router precommit_update 55550100 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.964755 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.services.provider_configuration [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Service providers = [] {{(pid=108431) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Nov 02 12:40:10.965117 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.db.servicetype_db [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=108431) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Nov 02 12:40:10.969623 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.services.service_base [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded 'neutron.services.l3_router.service_providers.dvrha.DvrHaDriver' provider for service L3_ROUTER_NAT {{(pid=108431) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 02 12:40:10.969972 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.services.service_base [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded 'neutron.services.l3_router.service_providers.dvr.DvrDriver' provider for service L3_ROUTER_NAT {{(pid=108431) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 02 12:40:10.970313 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.services.service_base [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded 'neutron.services.l3_router.service_providers.ha.HaDriver' provider for service L3_ROUTER_NAT {{(pid=108431) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 02 12:40:10.971239 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.services.service_base [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded 'neutron.services.l3_router.service_providers.single_node.SingleNodeDriver' provider for service L3_ROUTER_NAT {{(pid=108431) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Nov 02 12:40:10.971610 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.services.service_base [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Default provider is not specified for service type L3_ROUTER_NAT Nov 02 12:40:10.971987 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding between (L2) Neutron networks and access to external networks via a NAT gateway. {{(pid=108431) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 02 12:40:10.972340 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading Plugin: neutron.services.metering.metering_plugin.MeteringPlugin Nov 02 12:40:10.985110 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Successfully loaded METERING plugin. Description: METERING {{(pid=108431) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 02 12:40:10.985439 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading Plugin: auto_allocate Nov 02 12:40:10.991352 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: network precommit_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.991763 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: network precommit_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:10.992295 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=108431) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 02 12:40:10.992618 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading Plugin: tag Nov 02 12:40:10.999573 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=108431) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 02 12:40:10.999901 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading Plugin: timestamp Nov 02 12:40:11.003742 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=108431) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 02 12:40:11.004101 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading Plugin: network_ip_availability Nov 02 12:40:11.010124 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:11.015398 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:11.015398 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:11.015398 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=108431) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 02 12:40:11.015398 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading Plugin: flavors Nov 02 12:40:11.019972 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=108431) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 02 12:40:11.020305 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading Plugin: revisions Nov 02 12:40:11.025217 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=108431) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Nov 02 12:40:11.025608 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_concurrency.lockutils [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Lock "manager" released by "neutron.manager.NeutronManager._create_instance" :: held 2.462s {{(pid=108431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Nov 02 12:40:11.026352 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] get_extension_paths = OrderedDict([('/opt/stack/neutron/neutron/extensions', 1)]) {{(pid=108431) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Nov 02 12:40:11.026713 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Initializing extension manager. Nov 02 12:40:11.027233 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: __init__.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.027574 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: __pycache__ {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.027909 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: _standard_attr_segment_lib.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.028241 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: address_group.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.028998 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.029574 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: address-group Nov 02 12:40:11.029898 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: address_scope.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.030638 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.031147 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: address-scope Nov 02 12:40:11.031467 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: admin_state_down_before_update.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.032402 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.032918 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: router-admin-state-down-before-update Nov 02 12:40:11.033239 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: agent.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.033940 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.034455 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: agent Nov 02 12:40:11.034780 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: agent_resources_synced.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.035689 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.036193 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: agent-resources-synced Nov 02 12:40:11.036513 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: allowedaddresspairs.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.038345 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.038882 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: allowed-address-pairs Nov 02 12:40:11.039205 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: auto_allocated_topology.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.040290 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.040801 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: auto-allocated-topology Nov 02 12:40:11.041124 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: availability_zone.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.041816 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.042319 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: availability_zone Nov 02 12:40:11.042661 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: availability_zone_filter.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.043576 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.044085 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: availability_zone_filter Nov 02 12:40:11.044408 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: data_plane_status.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.045314 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.045826 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension data-plane-status not supported by any of loaded plugins Nov 02 12:40:11.046148 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: default_subnetpools.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.047089 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.047604 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: default-subnetpools Nov 02 12:40:11.047926 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: dhcpagentscheduler.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.048991 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.049494 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: dhcp_agent_scheduler Nov 02 12:40:11.049817 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: dns.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.050775 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.051276 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension dns-integration not supported by any of loaded plugins Nov 02 12:40:11.051597 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: dns_domain_ports.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.052519 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.053027 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension dns-domain-ports not supported by any of loaded plugins Nov 02 12:40:11.053348 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.054289 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.054823 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension dns-integration-domain-keywords not supported by any of loaded plugins Nov 02 12:40:11.055147 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: dvr.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.055892 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.056315 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: dvr Nov 02 12:40:11.056632 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: ecmp_routes.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.057553 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.058054 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension ecmp_routes not supported by any of loaded plugins Nov 02 12:40:11.058399 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: empty_string_filtering.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.059299 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.059802 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: empty-string-filtering Nov 02 12:40:11.060120 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.061038 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.061536 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Nov 02 12:40:11.061858 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.062798 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.063304 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Nov 02 12:40:11.063624 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: external_net.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.064533 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.065042 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: external-net Nov 02 12:40:11.065363 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: extra_dhcp_opt.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.066264 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.066794 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: extra_dhcp_opt Nov 02 12:40:11.067120 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: extraroute.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.068027 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.068533 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: extraroute Nov 02 12:40:11.068853 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: extraroute_atomic.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.077986 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.078528 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: extraroute-atomic Nov 02 12:40:11.078854 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: filter_validation.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.079696 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.080196 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: filter-validation Nov 02 12:40:11.080518 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: fip_pf_description.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.081435 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.081946 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Nov 02 12:40:11.082262 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: fip_port_details.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.083193 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.083699 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: fip-port-details Nov 02 12:40:11.084019 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: flavors.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.085941 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.086480 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: flavors Nov 02 12:40:11.086810 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.088503 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.089029 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Nov 02 12:40:11.089362 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: floatingip_pools.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.090065 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.090608 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: floatingip-pools Nov 02 12:40:11.090937 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: ip_allocation.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.091871 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.092379 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension ip_allocation not supported by any of loaded plugins Nov 02 12:40:11.092705 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: ip_substring_port_filtering.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.093622 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.094133 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: ip-substring-filtering Nov 02 12:40:11.094486 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: l2_adjacency.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.095412 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.095961 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension l2_adjacency not supported by any of loaded plugins Nov 02 12:40:11.096242 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: l3.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.097212 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.097723 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: router Nov 02 12:40:11.098050 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: l3_conntrack_helper.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.100329 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.100879 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension l3-conntrack-helper not supported by any of loaded plugins Nov 02 12:40:11.101216 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: l3_ext_gw_mode.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.107126 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.107591 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: ext-gw-mode Nov 02 12:40:11.107926 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: l3_ext_ha_mode.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.108841 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.109352 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: l3-ha Nov 02 12:40:11.109674 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: l3_flavors.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.110628 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.111135 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: l3-flavors Nov 02 12:40:11.111457 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.112373 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.112881 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: l3-port-ip-change-not-allowed Nov 02 12:40:11.113203 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: l3agentscheduler.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.114225 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.114770 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: l3_agent_scheduler Nov 02 12:40:11.115100 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: logging.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.116626 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.117149 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension logging not supported by any of loaded plugins Nov 02 12:40:11.117480 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: metering.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.118226 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.118839 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: metering Nov 02 12:40:11.119163 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.120398 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.120916 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: metering_source_and_destination_fields Nov 02 12:40:11.121243 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: multiprovidernet.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.122171 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.122715 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: multi-provider Nov 02 12:40:11.123039 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: netmtu.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.123993 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.124463 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: net-mtu Nov 02 12:40:11.124787 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: netmtu_writable.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.125700 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.126205 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: net-mtu-writable Nov 02 12:40:11.126555 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: network_availability_zone.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.127234 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.132191 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: network_availability_zone Nov 02 12:40:11.132191 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: network_ip_availability.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.132697 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.133215 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: network-ip-availability Nov 02 12:40:11.133542 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: network_segment_range.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.134313 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.134849 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension network-segment-range not supported by any of loaded plugins Nov 02 12:40:11.135169 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: pagination.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.136150 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.136479 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: pagination Nov 02 12:40:11.136799 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: port_device_profile.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.137720 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.138239 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: port-device-profile Nov 02 12:40:11.138595 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: port_mac_address_regenerate.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.139524 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.140038 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: port-mac-address-regenerate Nov 02 12:40:11.140364 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: port_numa_affinity_policy.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.141286 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.141846 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: port-numa-affinity-policy Nov 02 12:40:11.142170 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: port_resource_request.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.143116 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.143623 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension port-resource-request not supported by any of loaded plugins Nov 02 12:40:11.143943 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: port_resource_request_groups.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.144917 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.145424 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension port-resource-request-groups not supported by any of loaded plugins Nov 02 12:40:11.145744 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: portbindings.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.146741 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.147846 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: binding Nov 02 12:40:11.148176 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: portbindings_extended.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.149458 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.149977 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: binding-extended Nov 02 12:40:11.150306 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: portsecurity.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.151256 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.151769 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: port-security Nov 02 12:40:11.152094 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: project_id.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.153107 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.153432 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: project-id Nov 02 12:40:11.153756 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: providernet.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.154714 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.155250 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: provider Nov 02 12:40:11.155571 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: qos.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.159123 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.159653 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension qos not supported by any of loaded plugins Nov 02 12:40:11.159976 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: qos_bw_limit_direction.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.161217 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.161733 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Nov 02 12:40:11.162065 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.163046 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.163561 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Nov 02 12:40:11.163887 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: qos_default.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.164799 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.165310 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension qos-default not supported by any of loaded plugins Nov 02 12:40:11.165634 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: qos_fip.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.166287 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.166830 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension qos-fip not supported by any of loaded plugins Nov 02 12:40:11.167157 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: qos_gateway_ip.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.168083 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.168599 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension qos-gateway-ip not supported by any of loaded plugins Nov 02 12:40:11.168925 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: qos_port_network_policy.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.169833 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.170345 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension qos-port-network-policy not supported by any of loaded plugins Nov 02 12:40:11.170694 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.175991 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.176505 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension qos-pps-minimum not supported by any of loaded plugins Nov 02 12:40:11.176830 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: qos_pps_rule.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.178022 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.178778 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension qos-pps not supported by any of loaded plugins Nov 02 12:40:11.179107 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: qos_rule_type_details.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.180021 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.180529 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension qos-rule-type-details not supported by any of loaded plugins Nov 02 12:40:11.180851 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: qos_rules_alias.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.181904 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.182447 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension qos-rules-alias not supported by any of loaded plugins Nov 02 12:40:11.182773 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: quotasv2.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.183715 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.184044 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: quotas Nov 02 12:40:11.184365 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: quotasv2_detail.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.187710 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.188045 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: quota_details Nov 02 12:40:11.188374 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: rbac.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.189440 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.189965 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: rbac-policies Nov 02 12:40:11.190297 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: rbac_address_group.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.191261 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.191777 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: rbac-address-group Nov 02 12:40:11.192103 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: rbac_address_scope.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.193021 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.193535 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: rbac-address-scope Nov 02 12:40:11.193859 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: rbac_security_groups.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.195302 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.195818 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: rbac-security-groups Nov 02 12:40:11.196142 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: rbac_subnetpool.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.197063 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.197571 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: rbac-subnetpool Nov 02 12:40:11.197893 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: revisionifmatch.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.198837 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.199345 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: revision-if-match Nov 02 12:40:11.199667 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: revisions.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.200781 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.201289 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: standard-attr-revisions Nov 02 12:40:11.201613 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: router_availability_zone.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.202284 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.202821 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: router_availability_zone Nov 02 12:40:11.203143 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: routerservicetype.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.204059 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.204574 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension router-service-type not supported by any of loaded plugins Nov 02 12:40:11.204890 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.205813 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.206316 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: security-groups-normalized-cidr Nov 02 12:40:11.206669 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: security_groups_port_filtering.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.207592 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.208101 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: port-security-groups-filtering Nov 02 12:40:11.208422 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: security_groups_remote_address_group.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.209419 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.210523 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: security-groups-remote-address-group Nov 02 12:40:11.210849 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: security_groups_shared_filtering.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.211772 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.212282 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: security-groups-shared-filtering Nov 02 12:40:11.212603 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: security_groups_shared_filtering_lib.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.213189 dv-cinder-816324-1-iscsi neutron-server[108431]: WARNING neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Did not find expected name "Security_groups_shared_filtering_lib" in /opt/stack/neutron/neutron/extensions/security_groups_shared_filtering_lib.py Nov 02 12:40:11.213507 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: securitygroup.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.223274 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.223801 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: security-group Nov 02 12:40:11.224129 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: segment.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.224925 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.225462 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension segment not supported by any of loaded plugins Nov 02 12:40:11.225788 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.231852 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.232373 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Nov 02 12:40:11.232696 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: servicetype.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.233849 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.234407 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: service-type Nov 02 12:40:11.234740 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: sorting.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.235726 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.236060 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: sorting Nov 02 12:40:11.236386 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: standard_attr_segment.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.237308 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.237824 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension standard-attr-segment not supported by any of loaded plugins Nov 02 12:40:11.238145 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: standardattrdescription.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.238829 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.239336 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: standard-attr-description Nov 02 12:40:11.239660 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: stateful_security_group.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.240590 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.241129 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: stateful-security-group Nov 02 12:40:11.241455 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: stdattrs_common.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.242028 dv-cinder-816324-1-iscsi neutron-server[108431]: WARNING neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Nov 02 12:40:11.242349 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.243311 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.243819 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension subnet-dns-publish-fixed-ip not supported by any of loaded plugins Nov 02 12:40:11.244140 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: subnet_onboard.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.245249 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.245767 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: subnet_onboard Nov 02 12:40:11.246088 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: subnet_segmentid_writable.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.247068 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.247580 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Nov 02 12:40:11.247902 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: subnet_service_types.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.248827 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.249349 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: subnet-service-types Nov 02 12:40:11.249673 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: subnetallocation.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.250862 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.251377 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: subnet_allocation Nov 02 12:40:11.251702 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.252376 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.252885 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: subnetpool-prefix-ops Nov 02 12:40:11.253211 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.254138 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.254676 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Nov 02 12:40:11.255002 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: tagging.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.256091 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.257126 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: standard-attr-tag Nov 02 12:40:11.257455 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: timestamp.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.258696 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.259215 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loaded extension: standard-attr-timestamp Nov 02 12:40:11.259541 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: trunk.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.260576 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.261091 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension trunk not supported by any of loaded plugins Nov 02 12:40:11.261420 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: trunk_details.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.262358 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.262898 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension trunk-details not supported by any of loaded plugins Nov 02 12:40:11.263223 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: uplink_status_propagation.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.264140 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.264651 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension uplink-status-propagation not supported by any of loaded plugins Nov 02 12:40:11.264976 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Loading extension file: vlantransparent.py {{(pid=108431) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:450}} Nov 02 12:40:11.265647 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=108431) _check_extension /opt/stack/neutron/neutron/api/extensions.py:416}} Nov 02 12:40:11.266147 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extension vlan-transparent not supported by any of loaded plugins Nov 02 12:40:11.268759 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Creating instance of TrackedResource for resource:network Nov 02 12:40:11.269283 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Creating instance of TrackedResource for resource:subnet Nov 02 12:40:11.269682 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Creating instance of TrackedResource for resource:subnetpool Nov 02 12:40:11.270084 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Creating instance of TrackedResource for resource:port Nov 02 12:40:11.271369 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.v2.resource_helper [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108431) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 02 12:40:11.279920 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.v2.resource_helper [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Service FLAVORS assigned prefix: {{(pid=108431) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 02 12:40:11.279920 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.v2.resource_helper [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108431) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 02 12:40:11.279920 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.v2.resource_helper [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108431) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 02 12:40:11.279920 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Creating instance of TrackedResource for resource:router Nov 02 12:40:11.279920 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Creating instance of TrackedResource for resource:floatingip Nov 02 12:40:11.279920 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.v2.resource_helper [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Service METERING assigned prefix: /metering {{(pid=108431) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 02 12:40:11.280441 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > rbac-policy before_create 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:11.280441 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > rbac-policy before_update 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:11.280441 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Subscribe: > rbac-policy before_delete 55550000 {{(pid=108431) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:40:11.280441 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Creating instance of CountableResource for resource:rbac_policy Nov 02 12:40:11.280441 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Creating instance of TrackedResource for resource:security_group Nov 02 12:40:11.280783 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 02 12:40:11.280783 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.v2.resource_helper [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Service CORE assigned prefix: {{(pid=108431) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 02 12:40:11.280783 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Creating instance of TrackedResource for resource:subnetpool Nov 02 12:40:11.280783 dv-cinder-816324-1-iscsi neutron-server[108431]: WARNING neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] subnetpool is already registered Nov 02 12:40:11.280783 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.v2.resource_helper [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Service CORE assigned prefix: {{(pid=108431) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 02 12:40:11.281116 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Creating instance of TrackedResource for resource:subnetpool Nov 02 12:40:11.281492 dv-cinder-816324-1-iscsi neutron-server[108431]: WARNING neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] subnetpool is already registered Nov 02 12:40:11.283980 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.v2.resource_helper [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108431) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 02 12:40:11.284416 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.v2.resource_helper [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Service FLAVORS assigned prefix: {{(pid=108431) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 02 12:40:11.285040 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.v2.resource_helper [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108431) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 02 12:40:11.285479 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.v2.resource_helper [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Service L3_ROUTER_NAT assigned prefix: {{(pid=108431) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 02 12:40:11.285812 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Creating instance of TrackedResource for resource:router Nov 02 12:40:11.286154 dv-cinder-816324-1-iscsi neutron-server[108431]: WARNING neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] router is already registered Nov 02 12:40:11.286595 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Creating instance of TrackedResource for resource:floatingip Nov 02 12:40:11.286930 dv-cinder-816324-1-iscsi neutron-server[108431]: WARNING neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] floatingip is already registered Nov 02 12:40:11.287409 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.v2.resource_helper [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Service METERING assigned prefix: /metering {{(pid=108431) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 02 12:40:11.288136 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Creating instance of CountableResource for resource:rbac_policy Nov 02 12:40:11.288461 dv-cinder-816324-1-iscsi neutron-server[108431]: WARNING neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] rbac_policy is already registered Nov 02 12:40:11.288889 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Creating instance of TrackedResource for resource:security_group Nov 02 12:40:11.289225 dv-cinder-816324-1-iscsi neutron-server[108431]: WARNING neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] security_group is already registered Nov 02 12:40:11.289637 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Creating instance of TrackedResource for resource:security_group_rule Nov 02 12:40:11.289969 dv-cinder-816324-1-iscsi neutron-server[108431]: WARNING neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] security_group_rule is already registered Nov 02 12:40:11.290480 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.v2.resource_helper [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Service CORE assigned prefix: {{(pid=108431) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 02 12:40:11.290805 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Creating instance of TrackedResource for resource:subnetpool Nov 02 12:40:11.291133 dv-cinder-816324-1-iscsi neutron-server[108431]: WARNING neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] subnetpool is already registered Nov 02 12:40:11.291555 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.v2.resource_helper [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Service CORE assigned prefix: {{(pid=108431) build_resource_info /opt/stack/neutron/neutron/api/v2/resource_helper.py:77}} Nov 02 12:40:11.291873 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Creating instance of TrackedResource for resource:subnetpool Nov 02 12:40:11.292232 dv-cinder-816324-1-iscsi neutron-server[108431]: WARNING neutron.quota.resource_registry [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] subnetpool is already registered Nov 02 12:40:11.293928 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: extensions {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.295443 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: address-groups {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.296937 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: address-scopes {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.298144 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: agents {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.299719 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: auto-allocated-topology {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.300962 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: availability_zones {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.302193 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: dhcp-networks {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.303649 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: dhcp-agents {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.305192 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: routers {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.307361 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: flavors {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.308628 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: service_profiles {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.309834 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: next_providers {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.311321 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: service_profiles {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.312794 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: floatingip-pools {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.314340 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: routers {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.316325 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: floatingips {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.317609 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: l3-routers {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.319052 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: l3-agents {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.321001 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: metering-labels {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.322264 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: metering-label-rules {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.323661 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: network-ip-availabilities {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.324914 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: bindings {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.326539 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: quotas {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.328207 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: quotas {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.329763 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: rbac-policies {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.330985 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: security-groups {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.332315 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: security-group-rules {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.333562 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: service-providers {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.335452 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: subnetpools {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.336871 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: subnetpools {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.338335 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: tags {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.340060 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: tags {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.341882 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: tags {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.343732 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: tags {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.345411 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: tags {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.354593 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: tags {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.354593 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: tags {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.354593 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: tags {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.354593 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: tags {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.355577 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron.api.extensions [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Extended resource: tags {{(pid=108431) __init__ /opt/stack/neutron/neutron/api/extensions.py:157}} Nov 02 12:40:11.361763 dv-cinder-816324-1-iscsi neutron-server[108431]: WARNING keystonemiddleware.auth_token [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Nov 02 12:40:11.366802 dv-cinder-816324-1-iscsi neutron-server[108431]: WARNING keystonemiddleware.auth_token [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Nov 02 12:40:11.375725 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_concurrency.lockutils [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Acquired lock "singleton_lock" {{(pid=108431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Nov 02 12:40:11.376203 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_concurrency.lockutils [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Releasing lock "singleton_lock" {{(pid=108431) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Nov 02 12:40:11.376850 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO oslo_service.service [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Starting 2 workers Nov 02 12:40:11.382239 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Started child 108542 {{(pid=108431) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 02 12:40:11.386942 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Started child 108543 {{(pid=108431) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 02 12:40:11.387711 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:11.388571 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO neutron.service [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Neutron service started, listening on 0.0.0.0:9696 Nov 02 12:40:11.389202 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Publish callbacks [] for process, before_spawn {{(pid=108431) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:11.389312 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [-] (108542) wsgi starting up on http://0.0.0.0:9696 Nov 02 12:40:11.391603 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO oslo_service.service [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Starting 1 workers Nov 02 12:40:11.391781 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:11.393343 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [-] (108543) wsgi starting up on http://0.0.0.0:9696 Nov 02 12:40:11.396804 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Started child 108544 {{(pid=108431) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 02 12:40:11.397385 dv-cinder-816324-1-iscsi neutron-server[108431]: INFO oslo_service.service [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Starting 1 workers Nov 02 12:40:11.400591 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.service [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] calling RpcWorker wait() {{(pid=108544) _wait /opt/stack/neutron/neutron/service.py:128}} Nov 02 12:40:11.401188 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.service [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] returning from RpcWorker wait() {{(pid=108544) _wait /opt/stack/neutron/neutron/service.py:135}} Nov 02 12:40:11.401979 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Started child 108545 {{(pid=108431) _start_child /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:575}} Nov 02 12:40:11.402432 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:11.402830 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG neutron_lib.callbacks.manager [None req-63ae5534-e3b4-40ef-9a21-2df8dca0a3d4 None None] Publish callbacks [] for process, after_spawn {{(pid=108431) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:11.402979 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [-] neutron.plugins.ml2.plugin.Ml2Plugin method start_rpc_listeners called with arguments () {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:40:11.404741 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=108431) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 02 12:40:11.406075 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 12:40:11.406075 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 12:40:11.406075 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 12:40:11.406075 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 12:40:11.406075 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 12:40:11.406423 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.406604 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.406858 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.407110 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.407346 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks [] for process, after_init {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:11.407806 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.407932 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.408367 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.408495 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:40:11.408599 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.409026 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.409300 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.409472 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.409646 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.409906 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.410157 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.410488 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.410746 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.410994 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.411255 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.411431 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.411684 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] config_source = [] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.411966 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.412217 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.412484 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] debug = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.412727 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.413306 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.413558 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.413820 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.414061 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.414330 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.414606 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.414860 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.415117 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.415429 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.415569 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.415847 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.416094 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.416345 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.416563 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.416837 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.417061 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.417545 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] host = dv-cinder-816324-1-iscsi {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.417773 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.417993 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.418256 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.418541 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.419107 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.419107 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.419358 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.419519 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.419784 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.420013 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.420284 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.420543 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.420780 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] log_dir = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.421017 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] log_file = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.421183 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] log_options = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.421444 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.421745 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.421949 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.422151 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.422330 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.422516 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.422789 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.422956 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.423238 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.423686 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.423947 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.424157 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.424409 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.424624 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.424878 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.425117 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.425363 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.425594 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.425873 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.426069 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.426286 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.426553 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.426800 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.435104 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.435104 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.435104 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.435104 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.435104 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.435104 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.435104 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.435104 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.436195 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.436195 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.436195 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.436195 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.436195 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.436195 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.436195 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.436195 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.437372 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.437372 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.437372 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.437372 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.437372 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.437372 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.437372 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] use_journal = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.437372 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] use_json = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.438795 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.438795 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.438795 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.438795 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.438795 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.438795 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.438795 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.438795 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.439856 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.439856 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.439856 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.440246 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.440246 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.440511 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.440721 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.440956 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.441214 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.441452 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.441778 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.442020 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.442320 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.442656 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.442930 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.443263 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.443537 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.443814 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.444753 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.444925 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.445130 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.445380 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.445639 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.445869 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.446103 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.446632 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.447060 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.447473 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.447652 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.447934 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.98/identity {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.448191 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.448413 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.448644 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.448883 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.449103 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.449319 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.449554 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.449817 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.450064 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.450302 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.450574 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.450810 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.451027 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.451275 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.451504 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.451774 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.452028 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.452253 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.452472 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.452760 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.452988 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.453206 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.453679 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.453903 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.454277 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.454570 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.454714 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.454943 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.455086 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.455440 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.456209 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.456209 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.456209 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.456209 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.456619 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.456619 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.456914 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.457177 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.457441 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.457567 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.457787 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.458015 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.458433 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.458665 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.458882 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.459134 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.461372 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.461372 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.461372 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.461372 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.461372 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.461372 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.461372 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.461372 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.461372 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.462433 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.462433 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.462433 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.462433 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.462433 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.464394 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.464394 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.464394 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.464394 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.464394 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.464394 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.464394 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.464394 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.468406 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.468406 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.468406 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.468406 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.468406 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.468406 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.468406 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.468406 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.469501 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.469501 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.469501 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.469501 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.469501 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.469501 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.469501 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.469501 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.470081 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.470081 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.470081 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.470081 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.470081 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.470081 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.470081 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.470081 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.470693 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.470693 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.470693 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.470917 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.471055 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.471287 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.471539 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.471779 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.472004 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.472222 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.472520 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.472781 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.474273 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.474273 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.474273 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.474273 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.474273 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.474273 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.475618 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.475618 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.475618 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.475618 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.475618 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.476931 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.476931 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.476931 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.476931 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.98/identity {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.476931 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.477769 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.477769 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.477769 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.477769 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.478548 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.478548 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.478548 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.478548 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.479013 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.479013 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.479259 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.479391 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.479787 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.479946 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.480145 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.480323 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 52604) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:40:11.480443 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.480581 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.480816 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.481033 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.481252 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.481482 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.481712 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.481940 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.482182 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.482485 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.484401 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.484401 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.484401 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.484401 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.484401 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.484401 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.484401 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.484401 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.485256 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.485256 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.485256 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.485256 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.485659 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.485659 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.485863 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.486073 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.486308 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.486670 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.486920 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.487149 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.489577 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.489834 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.490567 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.490567 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.492494 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.492494 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.492494 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.492494 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.492494 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.492494 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.493338 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.493338 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.493338 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.493338 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.493870 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [-] 10.222.0.98 "GET / HTTP/1.1" status: 200 len: 253 time: 0.0109179 Nov 02 12:40:11.494027 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.494027 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.495008 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.495293 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.495563 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.497090 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.497090 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.497852 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.498114 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.498338 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.498585 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.498808 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.499029 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.499498 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.499498 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.499788 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.499962 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.500176 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.501147 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.501147 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.501147 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.501147 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.501598 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.501598 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.501741 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.501866 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.502199 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.502334 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.503396 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.503396 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.503396 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.503396 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.503396 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.505403 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.505403 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.505403 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.505403 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.505403 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.505403 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.505403 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.505403 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.507248 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.507248 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.507248 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.507248 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.508053 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.508211 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.508350 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.508594 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.508763 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.508977 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.509247 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.509576 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.509849 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.510106 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.510341 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.510655 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.510932 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:850:899'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.511190 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.512410 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.512410 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.512410 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.512410 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.512733 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.512809 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.512995 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.513976 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.513976 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.513976 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.513976 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.514257 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.514362 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.515510 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.515743 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.516625 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.516625 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.516625 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.516844 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.516921 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.517135 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.517373 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.517546 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 12:40:11.518039 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] Full set of CONF: {{(pid=108431) wait /usr/local/lib/python3.8/dist-packages/oslo_service/service.py:649}} Nov 02 12:40:11.518200 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Nov 02 12:40:11.518355 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] Configuration options gathered from: {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Nov 02 12:40:11.519467 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Nov 02 12:40:11.519643 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Nov 02 12:40:11.519797 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ================================================================================ {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Nov 02 12:40:11.520006 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] agent_down_time = 75 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.520170 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] allow_automatic_dhcp_failover = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.520332 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] allow_automatic_l3agent_failover = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.520491 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] allow_bulk = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.520650 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] allow_overlapping_ips = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.520848 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.521011 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] api_extensions_path = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.521169 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] api_paste_config = api-paste.ini {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.521328 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] api_workers = 2 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.521486 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] auth_strategy = keystone {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.521646 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] backdoor_port = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.521803 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] backdoor_socket = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.521961 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] backlog = 4096 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.522120 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] base_mac = fa:16:3e:00:00:00 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.522303 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] bind_host = 0.0.0.0 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.523383 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] bind_port = 9696 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.523383 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] client_socket_timeout = 900 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.523538 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] config_dir = [] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.523636 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.523794 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] config_source = [] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.524031 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] control_exchange = neutron {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.524123 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] core_plugin = ml2 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.524253 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] debug = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.524414 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] default_availability_zones = [] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.524606 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.524768 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] dhcp_agent_notification = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.524925 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] dhcp_agents_per_network = 1 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.525083 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] dhcp_lease_duration = 86400 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.525240 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] dhcp_load_type = networks {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.525397 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] dns_domain = openstacklocal {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.525553 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.525708 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] enable_dvr = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.525865 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] enable_new_agents = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.526023 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] enable_services_on_agents_with_admin_state_down = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.526181 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] enable_snat_by_default = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.526338 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] enable_traditional_dhcp = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.527388 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] external_dns_driver = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.527556 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] filter_validation = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.527717 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] global_physnet_mtu = 1500 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.527897 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] graceful_shutdown_timeout = 60 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.528044 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] host = dv-cinder-816324-1-iscsi {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.528189 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] host_dvr_for_dhcp = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.529227 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] http_retries = 3 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.529227 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] instance_format = [instance: %(uuid)s] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.529227 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.529227 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ipam_driver = internal {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.529227 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ipv6_pd_enabled = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.529227 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] l3_ha = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.529577 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.530504 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] l3_ha_network_physical_name = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.530770 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] l3_ha_network_type = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.531568 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] log_config_append = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.531568 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.531568 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] log_dir = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.531568 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] log_file = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.532718 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] log_options = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.532871 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] log_rotate_interval = 1 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.533083 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] log_rotate_interval_type = days {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.533289 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] log_rotation_type = none {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.533832 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.533832 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.533832 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.534204 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.534531 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.534697 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] max_allowed_address_pair = 10 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.535393 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] max_dns_nameservers = 5 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.535575 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] max_header_line = 16384 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.535809 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] max_l3_agents_per_router = 3 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.535977 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] max_logfile_count = 30 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.536538 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] max_logfile_size_mb = 200 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.536538 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] max_routes = 30 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.536538 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] max_subnet_host_routes = 20 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.536744 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] network_auto_schedule = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.536744 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] network_link_prefix = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.536862 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.537051 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] notify_nova_on_port_data_changes = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.537195 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] notify_nova_on_port_status_changes = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.537340 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] pagination_max_limit = -1 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.537469 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] periodic_fuzzy_delay = 5 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.537622 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] periodic_interval = 40 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.537777 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] publish_errors = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.537954 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] rate_limit_burst = 0 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.538109 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] rate_limit_except_level = CRITICAL {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.538264 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] rate_limit_interval = 0 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.538547 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] retry_until_window = 30 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.538701 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] router_auto_schedule = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.538846 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] router_distributed = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.539018 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] router_scheduler_driver = neutron.scheduler.l3_agent_scheduler.LeastRoutersScheduler {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.539161 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] rpc_resources_processing_step = 20 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.539300 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] rpc_response_max_timeout = 600 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.539439 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] rpc_response_timeout = 60 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.539581 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] rpc_state_report_workers = 0 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.539738 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] rpc_workers = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.539898 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] send_events_interval = 2 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.540057 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] service_plugins = ['router', 'neutron.services.metering.metering_plugin.MeteringPlugin'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.540215 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] setproctitle = on {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.540361 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] state_path = /opt/stack/data/neutron {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.540526 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] syslog_log_facility = LOG_USER {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.540667 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] tcp_keepidle = 600 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.540823 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] transport_url = **** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.540975 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] use_eventlog = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.541588 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] use_journal = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.541588 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] use_json = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.541588 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] use_ssl = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.541991 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] use_stderr = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.541991 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] use_syslog = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.541991 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] vlan_transparent = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.543222 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] watch_log_file = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.543222 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] wsgi_default_pool_size = 100 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.543222 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] wsgi_keep_alive = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.543222 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Nov 02 12:40:11.543222 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_concurrency.disable_process_locking = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.543222 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.543222 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] profiler.connection_string = messaging:// {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.543222 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] profiler.enabled = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.544280 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] profiler.es_doc_type = notification {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.544280 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] profiler.es_scroll_size = 10000 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.544280 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] profiler.es_scroll_time = 2m {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.544280 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] profiler.filter_error_trace = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.544280 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] profiler.hmac_keys = SECRET_KEY {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.544280 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] profiler.sentinel_service_name = mymaster {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.544280 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] profiler.socket_timeout = 0.1 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.545171 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] profiler.trace_sqlalchemy = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.545171 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_policy.enforce_new_defaults = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.545171 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_policy.enforce_scope = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.545171 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_policy.policy_default_rule = default {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.545171 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.546598 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.546598 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.546598 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.546598 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.546598 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.546598 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.546598 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.546598 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.547655 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_process_name = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.547655 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.547655 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.547655 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.auth_section = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.547655 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.auth_type = password {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.547655 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.auth_url = http://10.222.0.98/identity {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.547655 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.547655 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.certfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.548928 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.collect_timing = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.548928 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.default_domain_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.548928 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.default_domain_name = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.548928 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.domain_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.548928 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.domain_name = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.548928 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.endpoint_type = public {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.549712 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.insecure = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.549712 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.keyfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.549712 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.live_migration_events = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.549712 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.password = **** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.549712 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.project_domain_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.550340 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.project_domain_name = Default {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.550340 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.project_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.550340 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.project_name = service {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.550340 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.region_name = RegionOne {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.550877 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.split_loggers = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.550877 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.system_scope = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.550877 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.timeout = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.550877 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.trust_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.551372 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.user_domain_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.551372 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.user_domain_name = Default {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.551626 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.user_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.551626 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] nova.username = nova {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.551900 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] placement.auth_section = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.551900 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] placement.auth_type = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.554362 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] placement.cafile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.554362 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] placement.certfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.554362 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] placement.collect_timing = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.554362 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] placement.endpoint_type = public {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.554362 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] placement.insecure = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.554362 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] placement.keyfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.554362 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] placement.region_name = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.554362 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] placement.split_loggers = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.554362 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] placement.timeout = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.555595 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.auth_section = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.555595 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.auth_type = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.555595 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.cafile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.555595 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.certfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.555595 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.collect_timing = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.555595 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.connect_retries = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.555595 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.connect_retry_delay = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.555595 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.enable_notifications = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.555595 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.endpoint_override = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.556720 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.insecure = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.556720 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.interface = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.556720 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.keyfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.556720 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.max_version = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.556720 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.min_version = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.556720 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.region_name = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.556720 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.service_name = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.556720 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.service_type = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.556720 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.split_loggers = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.557854 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.status_code_retries = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.557854 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.status_code_retry_delay = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.557854 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.timeout = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.557854 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.valid_interfaces = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.557854 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ironic.version = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.557854 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] service_providers.service_provider = [] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.557854 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.557854 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.558887 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.558887 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.558887 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.559282 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.559428 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.559563 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.559776 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.559913 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.560047 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.560181 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.560319 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.560454 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.560588 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.560753 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.560895 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.561058 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.561308 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.561482 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.561630 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.561787 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.561928 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.562087 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.562228 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.562515 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_rabbit.ssl_version = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.562682 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_notifications.driver = [] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.562818 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_notifications.retry = -1 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.562953 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.563086 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_messaging_notifications.transport_url = **** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.563220 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.563366 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] QUOTAS.default_quota = -1 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.563502 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.563638 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] QUOTAS.quota_floatingip = 50 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.563772 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] QUOTAS.quota_network = 100 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.563914 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] QUOTAS.quota_port = 500 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.564050 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] QUOTAS.quota_rbac_policy = 10 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.564958 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] QUOTAS.quota_router = 100 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.564958 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group = 100 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.564958 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] QUOTAS.quota_security_group_rule = 100 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.564958 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] QUOTAS.quota_subnet = 100 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.564958 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] QUOTAS.track_quota_usage = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.564958 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] oslo_middleware.enable_proxy_headers_parsing = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.565740 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] healthcheck.backends = ['disable_by_file'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.565978 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] healthcheck.detailed = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.566139 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] healthcheck.disable_by_file_path = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.566828 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] healthcheck.path = /healthcheck {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.567019 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.admin_password = **** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.567162 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.admin_tenant_name = admin {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.567343 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.admin_token = **** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.567485 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.admin_user = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.567731 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.auth_admin_prefix = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.567855 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.570537 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.auth_port = 35357 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.570537 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.auth_protocol = https {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.570537 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.auth_section = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.570537 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.auth_type = password {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.570537 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.auth_uri = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.570537 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.auth_url = http://10.222.0.98/identity {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.570537 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.auth_version = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.570537 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.cache = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.571595 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.571595 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.certfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.571595 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.571595 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.default_domain_name = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.571595 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.delay_auth_decision = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.571595 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.domain_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.571595 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.domain_name = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.571595 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.572616 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.http_connect_timeout = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.572616 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.572616 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.identity_uri = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.572616 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.include_service_catalog = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.572616 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.insecure = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.572616 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.interface = public {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.572616 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.keyfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.572616 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.574566 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.574566 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.574566 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.574566 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.574566 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_secret_key = **** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.574566 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_security_strategy = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.574566 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.574566 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.575624 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.password = **** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.575624 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.575624 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.project_domain_name = Default {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.575624 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.project_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.575624 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.project_name = service {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.575624 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.region_name = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.575624 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.575624 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.service_token_roles_required = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.576616 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.service_type = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.576616 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.system_scope = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.576616 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.token_cache_time = 300 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.576616 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.trust_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.576616 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.576616 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.user_domain_name = Default {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.576616 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.user_id = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.576616 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.username = neutron {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.578585 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] keystone_authtoken.www_authenticate_uri = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.578585 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.backend = dogpile.cache.null {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.578585 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.backend_argument = **** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.578585 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.config_prefix = cache.oslo {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.578585 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.debug_cache_backend = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.578585 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.enabled = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.578585 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.expiration_time = 600 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.578585 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.memcache_dead_retry = 300 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.580387 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.580387 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.580387 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.memcache_pool_maxsize = 10 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.580387 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.580387 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.580387 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.memcache_socket_timeout = 1.0 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.580387 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.proxies = [] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.580387 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.tls_allowed_ciphers = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.581517 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.tls_cafile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.581517 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.tls_certfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.581517 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.tls_enabled = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.581517 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] cache.tls_keyfile = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.581517 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.581517 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep.group = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.581517 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep.helper_command = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.581517 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep.logger_name = oslo_privsep.daemon {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.582562 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep.thread_pool_size = 4 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.582562 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep.user = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.582562 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.582562 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_dhcp_release.group = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.582562 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_dhcp_release.helper_command = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.582562 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.582562 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_dhcp_release.thread_pool_size = 4 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.582562 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_dhcp_release.user = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.583659 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.583659 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.group = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.583659 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.helper_command = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.583659 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.583659 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.thread_pool_size = 4 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.583659 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_ovs_vsctl.user = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.583659 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_namespace.capabilities = [21] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.583659 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_namespace.group = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.584802 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_namespace.helper_command = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.584802 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.584802 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_namespace.thread_pool_size = 4 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.584802 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_namespace.user = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.584802 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_conntrack.capabilities = [12] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.584802 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_conntrack.group = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.584802 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_conntrack.helper_command = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.584802 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.585693 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_conntrack.thread_pool_size = 4 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.585693 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_conntrack.user = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.585693 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_link.capabilities = [12, 21] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.585693 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_link.group = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.585693 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_link.helper_command = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.585693 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.585693 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_link.thread_pool_size = 4 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.585693 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] privsep_link.user = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.586222 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] AGENT.root_helper = sudo /usr/local/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.586222 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] AGENT.root_helper_daemon = sudo /usr/local/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.586222 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] AGENT.use_helper_for_ns_read = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.586222 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_ipset = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.586222 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] SECURITYGROUP.enable_security_group = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.586222 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] SECURITYGROUP.firewall_driver = openvswitch {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.586222 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.586222 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2.extension_drivers = ['port_security'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.586776 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2.external_network_type = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.586776 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2.mechanism_drivers = ['openvswitch', 'hyperv'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.586776 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2.overlay_ip_version = 4 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.586945 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2.path_mtu = 0 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.587009 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2.physical_network_mtus = [] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.587160 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2.tenant_network_types = ['vlan'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.587936 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'gre', 'vxlan', 'geneve'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.587936 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2_type_flat.flat_networks = ['physnet1'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.587936 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2_type_geneve.max_header_size = 30 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.587936 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2_type_geneve.vni_ranges = ['1:1000'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.587936 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2_type_gre.tunnel_id_ranges = ['1:1000'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.589226 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2_type_vlan.network_vlan_ranges = ['physnet1:850:899'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.589226 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2_type_vxlan.vni_ranges = ['1:1000'] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.589226 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ml2_type_vxlan.vxlan_group = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.589226 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] OVS_DRIVER.vnic_type_prohibit_list = [] {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.589226 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.backend = sqlalchemy {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.589226 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.connection = **** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.589226 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.connection_debug = 0 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.589226 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.connection_parameters = {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.589663 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.connection_recycle_time = 3600 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.589663 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.connection_trace = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.589663 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.db_inc_retry_interval = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.589829 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.db_max_retries = 20 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.589903 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.db_max_retry_interval = 10 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.590615 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.db_retry_interval = 1 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.590615 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.max_overflow = 50 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.590615 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.max_pool_size = 50 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.590615 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.max_retries = 10 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.590615 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.mysql_enable_ndb = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.590941 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.590941 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.pool_timeout = None {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.591194 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.retry_interval = 10 {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.591194 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.slave_connection = **** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.592197 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.sqlite_synchronous = True {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.592197 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] database.use_db_reconnect = False {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Nov 02 12:40:11.592197 dv-cinder-816324-1-iscsi neutron-server[108431]: DEBUG oslo_service.service [-] ******************************************************************************** {{(pid=108431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Nov 02 12:40:11.592719 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.services.l3_router.l3_router_plugin [-] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method start_rpc_listeners called with arguments () {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:40:23.526514 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e29e8d56-6e83-4886-91d5-4116560785b2 None None] get_active_networks_info from dv-cinder-816324-1-iscsi {{(pid=108544) get_active_networks_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:158}} Nov 02 12:40:23.576361 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-e29e8d56-6e83-4886-91d5-4116560785b2 None None] No non-hosted networks {{(pid=108544) auto_schedule_networks /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:60}} Nov 02 12:40:23.586175 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.agentschedulers_db [None req-e29e8d56-6e83-4886-91d5-4116560785b2 None None] DHCP Agent not found on host dv-cinder-816324-1-iscsi {{(pid=108544) list_active_networks_on_active_dhcp_agent /opt/stack/neutron/neutron/db/agentschedulers_db.py:455}} Nov 02 12:40:23.706613 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-e9cf500f-3587-4cfd-872a-6811d34c568a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1591445'] for agent, after_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:25.652933 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-b0ad431c-6a9d-4d10-b9d6-d34c67f9b141 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1591445'] for agent, after_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:25.707441 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.db.api [None req-715c98e9-b4f9-43d0-a6f9-df8ff01e1aa1 None None] Retry wrapper got retriable exception: Failed to create a duplicate Agent: for attribute(s) ['agent_type', 'host'] with value(s) L3 agent-dv-cinder-816324-1-iscsi {{(pid=108544) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 02 12:40:25.708245 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG oslo_db.api [None req-715c98e9-b4f9-43d0-a6f9-df8ff01e1aa1 None None] Performing DB retry for function neutron.db.agents_db.AgentDbMixin.create_or_update_agent {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 02 12:40:26.227242 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-715c98e9-b4f9-43d0-a6f9-df8ff01e1aa1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:26.832368 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1591445'] for agent, after_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:28.313443 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1591445'] for agent, after_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:29.800152 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 52692) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:40:30.348774 dv-cinder-816324-1-iscsi neutron-server[108543]: WARNING oslo_policy.policy [None req-94913da2-e568-4ff0-a4e2-aa36e7dadd19 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 02 12:40:30.349546 dv-cinder-816324-1-iscsi neutron-server[108543]: WARNING oslo_policy.policy [None req-94913da2-e568-4ff0-a4e2-aa36e7dadd19 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 02 12:40:30.574535 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [None req-94913da2-e568-4ff0-a4e2-aa36e7dadd19 admin admin] http://10.222.0.98:9696/v2.0/extensions returned with HTTP 200 {{(pid=108543) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 02 12:40:30.575784 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-94913da2-e568-4ff0-a4e2-aa36e7dadd19 admin admin] 10.222.0.98 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13869 time: 0.7746003 Nov 02 12:40:30.809467 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1591445'] for agent, after_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:30.810860 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:30.811400 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:30.811968 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:30.812607 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:30.812963 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:30.813373 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:30.813654 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:30.814001 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:30.814327 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:30.819174 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:30.819174 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:30.819174 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:30.819174 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServersRpcApi method report_agent_resource_versions called with arguments (, 'Open vSwitch agent', 'dv-cinder-816324-1-iscsi', {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:40:30.824167 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] neutron.api.rpc.handlers.resources_rpc.ResourcesPushToServerRpcCallback method report_agent_resource_versions called with arguments (,) {'agent_type': 'Open vSwitch agent', 'agent_host': 'dv-cinder-816324-1-iscsi', 'version_map': {'QosPolicy': '1.10', 'Trunk': '1.1', 'SubPort': '1.0', 'Port': '1.7', 'Subnet': '1.1', 'Network': '1.1', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'Log': '1.0', 'PortForwarding': '1.2', 'ConntrackHelper': '1.0', 'AddressGroup': '1.2'}} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:40:31.233648 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.db.l3_hamode_db [None req-4657b18c-6e0d-4194-8797-a4e71a591d5a None None] Number of active agents lower than max_l3_agents_per_router. L3 agents available: 1 Nov 02 12:40:31.315950 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4657b18c-6e0d-4194-8797-a4e71a591d5a None None] Routers set() bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:40:31.316356 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4657b18c-6e0d-4194-8797-a4e71a591d5a None None] Router IDs set() for agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:462}} Nov 02 12:40:33.190392 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 52718) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:40:33.738324 dv-cinder-816324-1-iscsi neutron-server[108542]: WARNING oslo_policy.policy [None req-f6aeb91d-679d-4995-9e62-6dbf834041b0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 02 12:40:33.739000 dv-cinder-816324-1-iscsi neutron-server[108542]: WARNING oslo_policy.policy [None req-f6aeb91d-679d-4995-9e62-6dbf834041b0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 02 12:40:33.963346 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-f6aeb91d-679d-4995-9e62-6dbf834041b0 admin admin] Request body: {'subnetpool': {'default_prefixlen': 26, 'is_default': True, 'shared': True, 'name': 'shared-default-subnetpool-v4', 'prefixes': ['172.20.0.0/16']}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:40:34.060544 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.policy [None req-f6aeb91d-679d-4995-9e62-6dbf834041b0 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=108542) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 02 12:40:34.107557 dv-cinder-816324-1-iscsi neutron-server[108542]: WARNING oslo_policy.policy [None req-f6aeb91d-679d-4995-9e62-6dbf834041b0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 02 12:40:34.107934 dv-cinder-816324-1-iscsi neutron-server[108542]: WARNING oslo_policy.policy [None req-f6aeb91d-679d-4995-9e62-6dbf834041b0 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 02 12:40:34.117214 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.quota [None req-f6aeb91d-679d-4995-9e62-6dbf834041b0 admin admin] Loaded quota_driver: . Nov 02 12:40:34.265806 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f6aeb91d-679d-4995-9e62-6dbf834041b0 admin admin] Publish callbacks ['neutron.objects.securitygroup.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8738447202594', 'neutron.objects.address_group.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8738447203151', 'neutron.objects.network.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8738447223287', 'neutron.objects.qos.policy.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8738447221683', 'neutron.objects.subnetpool.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8738447761506', 'neutron.objects.address_scope.RbacNeutronDbObjectMixin.validate_rbac_policy_change-8738447171355', 'neutron.plugins.ml2.plugin.External_net_db_mixin._process_ext_policy_create-972621', 'neutron.plugins.ml2.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-800012', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1924679', 'neutron.services.network_ip_availability.plugin.NeutronDbPluginV2.validate_network_rbac_policy_change-1717603'] for rbac-policy, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:34.445654 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f6aeb91d-679d-4995-9e62-6dbf834041b0 admin admin] Publish callbacks [] for subnetpool, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:34.447150 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-f6aeb91d-679d-4995-9e62-6dbf834041b0 admin admin] 10.222.0.98 "POST /v2.0/subnetpools HTTP/1.1" status: 201 len: 739 time: 1.2543998 Nov 02 12:40:37.276468 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 52736) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:40:37.599753 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Request body: {'network': {'project_id': '32b8be9a4673430686c2ab5175b0d5a3', 'admin_state_up': True, 'tenant_id': '32b8be9a4673430686c2ab5175b0d5a3', 'name': 'private'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:40:37.701897 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Made reservation on behalf of 32b8be9a4673430686c2ab5175b0d5a3 for: {'network': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:40:37.704957 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for network, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:37.722215 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:37.836796 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:37.905769 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:37.926280 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 893} {{(pid=108542) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 02 12:40:37.955855 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8738449897957', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:37.956357 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Unsubscribe: segment precommit_create {{(pid=108542) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 02 12:40:37.956889 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.db.segments_db [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Added segment b061f042-2b67-420a-bd5f-e8d867e8682e of type vlan for network 7a24adba-610c-42dc-b2b6-0650a50fba6b Nov 02 12:40:37.973784 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a3e1b654-11f9-4532-8acf-5fbed2c4c9d0,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:40:38.023872 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:38.024229 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:38.024571 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:38.024905 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:38.025228 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:38.025569 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:38.025897 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:38.026232 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:38.026601 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:38.026925 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:38.027242 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:38.027556 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Tracked resource versions report: Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: pushed versions: Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: { 'AddressGroup': {'1.2'}, Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: 'ConntrackHelper': {'1.0'}, Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: 'Log': {'1.0'}, Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: 'Network': {'1.1'}, Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: 'Port': {'1.7'}, Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: 'PortForwarding': {'1.2'}, Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: 'QosPolicy': {'1.10'}, Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: 'SecurityGroup': {'1.5'}, Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: 'SecurityGroupRule': {'1.2'}, Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: 'SubPort': {'1.0'}, Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: 'Subnet': {'1.1'}, Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: 'Trunk': {'1.1'}} Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: consumer versions: Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: { DHCP agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: L3 agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: Metadata agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: Metering agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: Open vSwitch agent@dv-cinder-816324-1-iscsi: { 'AddressGroup': '1.2', Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: 'ConntrackHelper': '1.0', Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: 'Log': '1.0', Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: 'Network': '1.1', Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: 'Port': '1.7', Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: 'PortForwarding': '1.2', Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: 'QosPolicy': '1.10', Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: 'SecurityGroup': '1.5', Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: 'SecurityGroupRule': '1.2', Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: 'SubPort': '1.0', Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: 'Subnet': '1.1', Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: 'Trunk': '1.1'}} Nov 02 12:40:38.028596 dv-cinder-816324-1-iscsi neutron-server[108542]: {{(pid=108542) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 02 12:40:38.082834 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738449409639'] for network, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:38.209045 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for network, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:38.210190 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:40:38.210929 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:38.310906 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] Pushing event updated for resources: {'Network': ['ID=7a24adba-610c-42dc-b2b6-0650a50fba6b,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:40:38.323343 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Network 7a24adba-610c-42dc-b2b6-0650a50fba6b details requested by agent ovs-agent-dv-cinder-816324-1-iscsi with host dv-cinder-816324-1-iscsi {{(pid=108544) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 02 12:40:38.342649 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-070aa371-e842-4c08-b5fe-6c1f7e492ff3 admin admin] 10.222.0.98 "POST /v2.0/networks HTTP/1.1" status: 201 len: 849 time: 1.0650561 Nov 02 12:40:41.179037 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 52750) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:40:41.571511 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-23d0ae8b-ac03-4719-a650-c38c1c0ce051 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:40:41.572903 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-23d0ae8b-ac03-4719-a650-c38c1c0ce051 admin admin] 10.222.0.98 "GET /v2.0/networks/7a24adba-610c-42dc-b2b6-0650a50fba6b HTTP/1.1" status: 200 len: 825 time: 0.3928871 Nov 02 12:40:41.598684 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-36cda63c-0fd9-40f4-b62f-7cfd05d81c6b admin admin] 10.222.0.98 "GET /v2.0/subnetpools/fa021d63-1b84-45eb-a6e2-d039a6fae399 HTTP/1.1" status: 200 len: 734 time: 0.0191450 Nov 02 12:40:41.608318 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-94d08bf8-d136-4d7e-b9c1-3ae8c9be726c admin admin] Request body: {'subnet': {'name': 'private-subnet', 'gateway_ip': '172.20.0.1', 'subnetpool_id': 'fa021d63-1b84-45eb-a6e2-d039a6fae399', 'ip_version': 4, 'tenant_id': '32b8be9a4673430686c2ab5175b0d5a3', 'network_id': '7a24adba-610c-42dc-b2b6-0650a50fba6b'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:40:41.695021 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-94d08bf8-d136-4d7e-b9c1-3ae8c9be726c admin admin] Made reservation on behalf of 32b8be9a4673430686c2ab5175b0d5a3 for: {'subnet': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:40:41.698718 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-94d08bf8-d136-4d7e-b9c1-3ae8c9be726c admin admin] Publish callbacks [] for subnet, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:42.077377 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-94d08bf8-d136-4d7e-b9c1-3ae8c9be726c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for subnet, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:42.146167 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-94d08bf8-d136-4d7e-b9c1-3ae8c9be726c admin admin] Checking segment: {'id': 'b061f042-2b67-420a-bd5f-e8d867e8682e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '7a24adba-610c-42dc-b2b6-0650a50fba6b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108542) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:40:42.147069 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94d08bf8-d136-4d7e-b9c1-3ae8c9be726c admin admin] Network hostable DHCP agents. Network: 7a24adba-610c-42dc-b2b6-0650a50fba6b, hostable agents: ['1b947f40-f8bf-4088-a5dc-35ee29d90d78'], hosted agents: [] {{(pid=108542) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 02 12:40:42.151648 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94d08bf8-d136-4d7e-b9c1-3ae8c9be726c admin admin] Pushing event updated for resources: {'Subnet': ['ID=3489ab30-1600-4db0-84aa-7973200b6577,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:40:42.236880 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-94d08bf8-d136-4d7e-b9c1-3ae8c9be726c admin admin] Network 7a24adba-610c-42dc-b2b6-0650a50fba6b is scheduled to be hosted by DHCP agent 1b947f40-f8bf-4088-a5dc-35ee29d90d78 with binding_index 1 {{(pid=108542) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 02 12:40:42.299651 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-94d08bf8-d136-4d7e-b9c1-3ae8c9be726c admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816324-1-iscsi, 7a24adba-610c-42dc-b2b6-0650a50fba6b) {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:40:42.304962 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-94d08bf8-d136-4d7e-b9c1-3ae8c9be726c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:40:42.305549 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-94d08bf8-d136-4d7e-b9c1-3ae8c9be726c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for subnet, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:42.310186 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-509436f6-9ae8-46d4-bf49-c56cb3c091d6 None None] Network 7a24adba-610c-42dc-b2b6-0650a50fba6b requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:40:42.401641 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-94d08bf8-d136-4d7e-b9c1-3ae8c9be726c admin admin] 10.222.0.98 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 854 time: 0.7967501 Nov 02 12:40:42.639562 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp94ac73f7-a43e-5b43-a0b7-503cbb5c76bd-7a24adba-610c-42dc-b2b6-0650a50fba6b', 'network_id': '7a24adba-610c-42dc-b2b6-0650a50fba6b', 'tenant_id': '32b8be9a4673430686c2ab5175b0d5a3', 'fixed_ips': [{'subnet_id': '3489ab30-1600-4db0-84aa-7973200b6577'}]}} from dv-cinder-816324-1-iscsi. {{(pid=108544) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 02 12:40:42.640761 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:42.944000 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.db_base_plugin_common [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Allocated IP 172.20.0.2 (7a24adba-610c-42dc-b2b6-0650a50fba6b/3489ab30-1600-4db0-84aa-7973200b6577/6b080fe5-bf7e-4cfd-973b-56212bb03c5e) {{(pid=108544) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:40:43.204805 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Publish callbacks [] for port, precommit_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:43.294945 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669'] for port, after_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:43.368017 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Network 7a24adba-610c-42dc-b2b6-0650a50fba6b is already hosted by enough agents. {{(pid=108544) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:40:43.373822 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.scheduler.base_scheduler [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Resources bound (agent type, host, resource id): {{(pid=108544) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:40:43.385717 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Received port after_create {{(pid=108544) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:40:43.393368 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Pushing event updated for resources: {'Port': ['ID=6b080fe5-bf7e-4cfd-973b-56212bb03c5e,revision_number=1']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:40:43.439161 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:43.439539 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:43.439887 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:43.440225 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:43.440560 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:43.440892 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:43.441221 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:43.441545 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:43.441887 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:43.442213 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:43.442565 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:43.442894 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Tracked resource versions report: Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: pushed versions: Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: { 'AddressGroup': {'1.2'}, Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: 'ConntrackHelper': {'1.0'}, Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: 'Log': {'1.0'}, Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: 'Network': {'1.1'}, Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: 'Port': {'1.7'}, Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: 'PortForwarding': {'1.2'}, Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: 'QosPolicy': {'1.10'}, Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: 'SecurityGroup': {'1.5'}, Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: 'SecurityGroupRule': {'1.2'}, Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: 'SubPort': {'1.0'}, Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: 'Subnet': {'1.1'}, Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: 'Trunk': {'1.1'}} Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: consumer versions: Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: { DHCP agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: L3 agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: Metadata agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: Metering agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: Open vSwitch agent@dv-cinder-816324-1-iscsi: { 'AddressGroup': '1.2', Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: 'ConntrackHelper': '1.0', Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: 'Log': '1.0', Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: 'Network': '1.1', Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: 'Port': '1.7', Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: 'PortForwarding': '1.2', Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: 'QosPolicy': '1.10', Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: 'SecurityGroup': '1.5', Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: 'SecurityGroupRule': '1.2', Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: 'SubPort': '1.0', Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: 'Subnet': '1.1', Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: 'Trunk': '1.1'}} Nov 02 12:40:43.444217 dv-cinder-816324-1-iscsi neutron-server[108544]: {{(pid=108544) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 02 12:40:43.475622 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Attempting to bind port 6b080fe5-bf7e-4cfd-973b-56212bb03c5e on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:40:43.475965 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Attempting to bind port 6b080fe5-bf7e-4cfd-973b-56212bb03c5e by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': 'b061f042-2b67-420a-bd5f-e8d867e8682e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '7a24adba-610c-42dc-b2b6-0650a50fba6b'}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:40:43.476403 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Attempting to bind port 6b080fe5-bf7e-4cfd-973b-56212bb03c5e on network 7a24adba-610c-42dc-b2b6-0650a50fba6b {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:40:43.481209 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 40, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:40:43.481604 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Checking segment: {'id': 'b061f042-2b67-420a-bd5f-e8d867e8682e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '7a24adba-610c-42dc-b2b6-0650a50fba6b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108544) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:40:43.482103 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:43.482524 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Bound using segment: {'id': 'b061f042-2b67-420a-bd5f-e8d867e8682e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '7a24adba-610c-42dc-b2b6-0650a50fba6b'} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:40:43.483020 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Bound port: 6b080fe5-bf7e-4cfd-973b-56212bb03c5e, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b061f042-2b67-420a-bd5f-e8d867e8682e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '7a24adba-610c-42dc-b2b6-0650a50fba6b'}}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:40:43.483439 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:43.566288 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] For port 6b080fe5-bf7e-4cfd-973b-56212bb03c5e, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108544) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:40:43.597401 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] For port 6b080fe5-bf7e-4cfd-973b-56212bb03c5e, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=6b080fe5-bf7e-4cfd-973b-56212bb03c5e,segment=NetworkSegment(b061f042-2b67-420a-bd5f-e8d867e8682e),segment_id=b061f042-2b67-420a-bd5f-e8d867e8682e)] {{(pid=108544) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:40:43.668596 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:43.728664 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bf87d8f-2ba8-4712-8dad-e5c7ae7bb4c8 None None] Pushing event updated for resources: {'Port': ['ID=6b080fe5-bf7e-4cfd-973b-56212bb03c5e,revision_number=2']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:40:45.027892 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 52758) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:40:45.360578 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [None req-ca6b553f-029e-4b4e-8cc8-d9ddf0efeabb admin admin] http://10.222.0.98:9696/v2.0/extensions returned with HTTP 200 {{(pid=108542) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 02 12:40:45.361598 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-ca6b553f-029e-4b4e-8cc8-d9ddf0efeabb admin admin] 10.222.0.98 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13869 time: 0.3327656 Nov 02 12:40:47.942774 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 52766) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:40:48.264502 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [None req-f1e6e028-3920-43a4-9182-4114b8e05ef7 admin admin] http://10.222.0.98:9696/v2.0/extensions returned with HTTP 200 {{(pid=108542) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 02 12:40:48.265524 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-f1e6e028-3920-43a4-9182-4114b8e05ef7 admin admin] 10.222.0.98 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13869 time: 0.3213065 Nov 02 12:40:51.131288 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 52776) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:40:51.460918 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-65e944f3-2108-40b0-9bca-84a9f6303571 admin admin] Request body: {'router': {'admin_state_up': True, 'name': 'router1', 'tenant_id': '32b8be9a4673430686c2ab5175b0d5a3'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:40:51.558840 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-65e944f3-2108-40b0-9bca-84a9f6303571 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1593342', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-25677'] for router, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:51.560388 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-65e944f3-2108-40b0-9bca-84a9f6303571 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1593154', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1595081', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1973616', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-25716'] for router, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:51.698736 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-65e944f3-2108-40b0-9bca-84a9f6303571 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:51.773663 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-65e944f3-2108-40b0-9bca-84a9f6303571 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1593163', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1595034'] for router, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:51.863502 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-65e944f3-2108-40b0-9bca-84a9f6303571 admin admin] Publish callbacks [] for router, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:51.864913 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-65e944f3-2108-40b0-9bca-84a9f6303571 admin admin] 10.222.0.98 "POST /v2.0/routers HTTP/1.1" status: 201 len: 709 time: 0.7326257 Nov 02 12:40:52.565231 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 6b080fe5-bf7e-4cfd-973b-56212bb03c5e up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:40:52.661907 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 6b080fe5-bf7e-4cfd-973b-56212bb03c5e triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:40:52.662491 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:52.778548 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:52.815387 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] For port 6b080fe5-bf7e-4cfd-973b-56212bb03c5e, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=6b080fe5-bf7e-4cfd-973b-56212bb03c5e,segment=NetworkSegment(b061f042-2b67-420a-bd5f-e8d867e8682e),segment_id=b061f042-2b67-420a-bd5f-e8d867e8682e)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:40:52.894106 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:52.959021 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Pushing event updated for resources: {'Port': ['ID=6b080fe5-bf7e-4cfd-973b-56212bb03c5e,revision_number=3']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:40:53.169829 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b754e2d0-e4cb-43e9-ae3d-a439d7e8e0df None None] Network 7a24adba-610c-42dc-b2b6-0650a50fba6b requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:40:53.244957 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-caed4ab0-7eaf-436c-883f-9a6ddc0544b0 None None] Provisioning complete for port 6b080fe5-bf7e-4cfd-973b-56212bb03c5e triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:40:53.245332 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-caed4ab0-7eaf-436c-883f-9a6ddc0544b0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:53.495869 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-a9c692ab-8ded-4a06-bba1-e6e7c1352e48 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:53.635590 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-0fe0038d-fee4-4ed8-a8a1-aad4cc658aa4 None None] Provisioning complete for port 6b080fe5-bf7e-4cfd-973b-56212bb03c5e triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:40:53.636260 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0fe0038d-fee4-4ed8-a8a1-aad4cc658aa4 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:54.454776 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 52790) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:40:54.518885 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 6b080fe5-bf7e-4cfd-973b-56212bb03c5e up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:40:54.569530 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 6b080fe5-bf7e-4cfd-973b-56212bb03c5e triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:40:54.569901 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:54.782778 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [None req-715b9eed-20cd-4bfc-b425-b63615b421f9 admin admin] http://10.222.0.98:9696/v2.0/extensions returned with HTTP 200 {{(pid=108543) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 02 12:40:54.783752 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-715b9eed-20cd-4bfc-b425-b63615b421f9 admin admin] 10.222.0.98 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13869 time: 0.3279982 Nov 02 12:40:55.610148 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0827149f-3f43-4dc8-932d-62a63f4482a3 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:56.802355 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:57.341983 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 52808) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:40:57.489255 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-dbaf7cc7-d486-4d8e-bf1f-6ad6e6b9277b admin admin] Request body: {'network': {'provider:network_type': 'flat', 'is_default': True, 'router:external': True, 'name': 'public', 'provider:physical_network': 'physnet1', 'admin_state_up': True}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:40:57.607684 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dbaf7cc7-d486-4d8e-bf1f-6ad6e6b9277b admin admin] Made reservation on behalf of f0f28d7144b0429b9938ca83a996bf44 for: {'network': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:40:57.610116 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dbaf7cc7-d486-4d8e-bf1f-6ad6e6b9277b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for network, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:57.619833 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dbaf7cc7-d486-4d8e-bf1f-6ad6e6b9277b admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:57.693752 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dbaf7cc7-d486-4d8e-bf1f-6ad6e6b9277b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:57.758328 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dbaf7cc7-d486-4d8e-bf1f-6ad6e6b9277b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:57.776079 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.type_flat [None req-dbaf7cc7-d486-4d8e-bf1f-6ad6e6b9277b admin admin] Reserving flat network on physical network physnet1 {{(pid=108542) reserve_provider_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_flat.py:100}} Nov 02 12:40:57.793089 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbaf7cc7-d486-4d8e-bf1f-6ad6e6b9277b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=200e7f81-f5dd-4cab-9d76-8248063757f6,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:40:57.798060 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dbaf7cc7-d486-4d8e-bf1f-6ad6e6b9277b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:57.798420 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.db.segments_db [None req-dbaf7cc7-d486-4d8e-bf1f-6ad6e6b9277b admin admin] Added segment 64efaa63-f19c-4383-a10b-56b16f82f716 of type flat for network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf Nov 02 12:40:57.858237 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dbaf7cc7-d486-4d8e-bf1f-6ad6e6b9277b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738449409639'] for network, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:57.947025 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dbaf7cc7-d486-4d8e-bf1f-6ad6e6b9277b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for network, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:57.948019 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dbaf7cc7-d486-4d8e-bf1f-6ad6e6b9277b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:40:57.948671 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dbaf7cc7-d486-4d8e-bf1f-6ad6e6b9277b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:40:58.010855 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dbaf7cc7-d486-4d8e-bf1f-6ad6e6b9277b admin admin] Pushing event updated for resources: {'Network': ['ID=43464fa8-eb00-46fb-9ca0-be7342f9ddbf,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:40:58.021932 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf details requested by agent ovs-agent-dv-cinder-816324-1-iscsi with host dv-cinder-816324-1-iscsi {{(pid=108544) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 02 12:40:58.110402 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-dbaf7cc7-d486-4d8e-bf1f-6ad6e6b9277b admin admin] 10.222.0.98 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.7672410 Nov 02 12:40:58.227634 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:00.556752 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 52826) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:41:00.661271 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0cf2d8b8-19f2-4e85-953f-5aac2864a779 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:41:00.663022 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-0cf2d8b8-19f2-4e85-953f-5aac2864a779 admin admin] 10.222.0.98 "GET /v2.0/subnets/3489ab30-1600-4db0-84aa-7973200b6577 HTTP/1.1" status: 200 len: 849 time: 0.1049435 Nov 02 12:41:00.780956 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:00.789165 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-e7cbb47d-e94b-468c-b46e-2e28584ac167 admin admin] 10.222.0.98 "GET /v2.0/routers/45c32243-437d-47d1-a4d4-8073125e2fd4 HTTP/1.1" status: 200 len: 704 time: 0.1201038 Nov 02 12:41:01.078845 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5db60268-bb5e-42d9-93d5-48d22f220b28 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:01.396796 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_common [None req-5db60268-bb5e-42d9-93d5-48d22f220b28 admin admin] Allocated IP 172.20.0.1 (7a24adba-610c-42dc-b2b6-0650a50fba6b/3489ab30-1600-4db0-84aa-7973200b6577/a74ddbb7-0315-45e6-a447-df6612be9e98) {{(pid=108542) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:41:01.605024 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5db60268-bb5e-42d9-93d5-48d22f220b28 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:01.719251 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5db60268-bb5e-42d9-93d5-48d22f220b28 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669'] for port, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:01.792883 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5db60268-bb5e-42d9-93d5-48d22f220b28 admin admin] Network 7a24adba-610c-42dc-b2b6-0650a50fba6b is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:41:01.803743 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-5db60268-bb5e-42d9-93d5-48d22f220b28 admin admin] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:41:01.806333 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5db60268-bb5e-42d9-93d5-48d22f220b28 admin admin] Received port after_create {{(pid=108542) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:41:01.807011 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5db60268-bb5e-42d9-93d5-48d22f220b28 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1590217'] for router_interface, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:01.828774 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5db60268-bb5e-42d9-93d5-48d22f220b28 admin admin] Pushing event updated for resources: {'Port': ['ID=a74ddbb7-0315-45e6-a447-df6612be9e98,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:41:01.990680 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-a30269f4-7d45-42ba-9f88-f4cb5ecec1da None None] Provisioning complete for port a74ddbb7-0315-45e6-a447-df6612be9e98 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:41:01.991295 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-a30269f4-7d45-42ba-9f88-f4cb5ecec1da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:02.023992 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-a30269f4-7d45-42ba-9f88-f4cb5ecec1da None None] Port a74ddbb7-0315-45e6-a447-df6612be9e98 cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:41:02.101054 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5db60268-bb5e-42d9-93d5-48d22f220b28 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:02.322470 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5db60268-bb5e-42d9-93d5-48d22f220b28 admin admin] Publish callbacks [] for port, precommit_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:02.413671 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5db60268-bb5e-42d9-93d5-48d22f220b28 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:02.414520 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5db60268-bb5e-42d9-93d5-48d22f220b28 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1649136', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1590109'] for router_interface, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:02.474909 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5db60268-bb5e-42d9-93d5-48d22f220b28 admin admin] Pushing event updated for resources: {'Port': ['ID=a74ddbb7-0315-45e6-a447-df6612be9e98,revision_number=2']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:41:02.541997 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5db60268-bb5e-42d9-93d5-48d22f220b28 admin admin] Network 7a24adba-610c-42dc-b2b6-0650a50fba6b is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:41:02.543336 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-5db60268-bb5e-42d9-93d5-48d22f220b28 admin admin] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:41:02.752197 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-44569aa0-6216-4e1e-961a-de5f7d5deb5c None None] Provisioning complete for port a74ddbb7-0315-45e6-a447-df6612be9e98 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:41:02.752717 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-44569aa0-6216-4e1e-961a-de5f7d5deb5c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:02.795278 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-44569aa0-6216-4e1e-961a-de5f7d5deb5c None None] Port a74ddbb7-0315-45e6-a447-df6612be9e98 cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:41:02.799024 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5db60268-bb5e-42d9-93d5-48d22f220b28 admin admin] Router 45c32243-437d-47d1-a4d4-8073125e2fd4 is scheduled to L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc with binding_index 1 {{(pid=108542) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 02 12:41:02.895221 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5db60268-bb5e-42d9-93d5-48d22f220b28 admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108542) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:41:02.901164 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-5db60268-bb5e-42d9-93d5-48d22f220b28 admin admin] 10.222.0.98 "PUT /v2.0/routers/45c32243-437d-47d1-a4d4-8073125e2fd4/add_router_interface HTTP/1.1" status: 200 len: 508 time: 2.1062026 Nov 02 12:41:02.905802 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] Sync routers for ids ['45c32243-437d-47d1-a4d4-8073125e2fd4'] in dv-cinder-816324-1-iscsi {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:41:02.918671 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] Routers {'45c32243-437d-47d1-a4d4-8073125e2fd4'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:41:02.919513 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:40:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['45c32243-437d-47d1-a4d4-8073125e2fd4'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:41:03.131364 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] Set router 45c32243-437d-47d1-a4d4-8073125e2fd4 gateway port host: None {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:41:03.596541 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '45c32243-437d-47d1-a4d4-8073125e2fd4', 'name': 'router1', 'tenant_id': '32b8be9a4673430686c2ab5175b0d5a3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:40:51Z', 'updated_at': '2021-11-02T12:41:01Z', 'revision_number': 2, 'project_id': '32b8be9a4673430686c2ab5175b0d5a3', 'gw_port_host': None, '_interfaces': [{'id': 'a74ddbb7-0315-45e6-a447-df6612be9e98', 'name': '', 'network_id': '7a24adba-610c-42dc-b2b6-0650a50fba6b', 'tenant_id': '32b8be9a4673430686c2ab5175b0d5a3', 'mac_address': 'fa:16:3e:8d:26:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '45c32243-437d-47d1-a4d4-8073125e2fd4', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '3489ab30-1600-4db0-84aa-7973200b6577', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:41:01Z', 'updated_at': '2021-11-02T12:41:02Z', 'revision_number': 2, 'project_id': '32b8be9a4673430686c2ab5175b0d5a3', 'subnets': [{'id': '3489ab30-1600-4db0-84aa-7973200b6577', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'fa021d63-1b84-45eb-a6e2-d039a6fae399'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:41:03.650133 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] Checking router: 45c32243-437d-47d1-a4d4-8073125e2fd4 for host: dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:41:03.650533 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] Updating router 45c32243-437d-47d1-a4d4-8073125e2fd4 port a74ddbb7-0315-45e6-a447-df6612be9e98 binding host dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 02 12:41:03.700859 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:04.250487 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] Publish callbacks [] for port, precommit_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:04.312710 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:04.487848 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] Attempting to bind port a74ddbb7-0315-45e6-a447-df6612be9e98 on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:41:04.487848 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] Attempting to bind port a74ddbb7-0315-45e6-a447-df6612be9e98 by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': 'b061f042-2b67-420a-bd5f-e8d867e8682e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '7a24adba-610c-42dc-b2b6-0650a50fba6b'}] {{(pid=108545) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:41:04.487848 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] Attempting to bind port a74ddbb7-0315-45e6-a447-df6612be9e98 on network 7a24adba-610c-42dc-b2b6-0650a50fba6b {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:41:04.492586 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86fcce98-cc75-4b95-a90a-e31c5a49cdc9 None None] Pushing event updated for resources: {'Port': ['ID=a74ddbb7-0315-45e6-a447-df6612be9e98,revision_number=3']} {{(pid=108545) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:41:04.504495 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 41, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:41:04.504848 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] Checking segment: {'id': 'b061f042-2b67-420a-bd5f-e8d867e8682e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '7a24adba-610c-42dc-b2b6-0650a50fba6b'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108545) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:41:04.505870 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:04.506279 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] Bound using segment: {'id': 'b061f042-2b67-420a-bd5f-e8d867e8682e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '7a24adba-610c-42dc-b2b6-0650a50fba6b'} {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:41:04.506811 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] Bound port: a74ddbb7-0315-45e6-a447-df6612be9e98, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b061f042-2b67-420a-bd5f-e8d867e8682e', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 893, 'network_id': '7a24adba-610c-42dc-b2b6-0650a50fba6b'}}] {{(pid=108545) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:41:04.507194 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:04.514187 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86fcce98-cc75-4b95-a90a-e31c5a49cdc9 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:41:04.514574 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86fcce98-cc75-4b95-a90a-e31c5a49cdc9 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:41:04.514916 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86fcce98-cc75-4b95-a90a-e31c5a49cdc9 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:41:04.515240 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86fcce98-cc75-4b95-a90a-e31c5a49cdc9 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:41:04.515562 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86fcce98-cc75-4b95-a90a-e31c5a49cdc9 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:41:04.515879 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86fcce98-cc75-4b95-a90a-e31c5a49cdc9 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:41:04.516192 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86fcce98-cc75-4b95-a90a-e31c5a49cdc9 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:41:04.516737 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86fcce98-cc75-4b95-a90a-e31c5a49cdc9 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:41:04.516848 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86fcce98-cc75-4b95-a90a-e31c5a49cdc9 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:41:04.517131 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86fcce98-cc75-4b95-a90a-e31c5a49cdc9 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:41:04.517550 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86fcce98-cc75-4b95-a90a-e31c5a49cdc9 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:41:04.517871 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86fcce98-cc75-4b95-a90a-e31c5a49cdc9 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86fcce98-cc75-4b95-a90a-e31c5a49cdc9 None None] Tracked resource versions report: Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: pushed versions: Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: { 'AddressGroup': {'1.2'}, Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: 'ConntrackHelper': {'1.0'}, Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: 'Log': {'1.0'}, Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: 'Network': {'1.1'}, Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: 'Port': {'1.7'}, Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: 'PortForwarding': {'1.2'}, Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: 'QosPolicy': {'1.10'}, Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: 'SecurityGroup': {'1.5'}, Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: 'SecurityGroupRule': {'1.2'}, Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: 'SubPort': {'1.0'}, Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: 'Subnet': {'1.1'}, Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: 'Trunk': {'1.1'}} Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: consumer versions: Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: { DHCP agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: L3 agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: Metadata agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: Metering agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: Open vSwitch agent@dv-cinder-816324-1-iscsi: { 'AddressGroup': '1.2', Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: 'ConntrackHelper': '1.0', Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: 'Log': '1.0', Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: 'Network': '1.1', Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: 'Port': '1.7', Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: 'PortForwarding': '1.2', Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: 'QosPolicy': '1.10', Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: 'SecurityGroup': '1.5', Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: 'SecurityGroupRule': '1.2', Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: 'SubPort': '1.0', Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: 'Subnet': '1.1', Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: 'Trunk': '1.1'}} Nov 02 12:41:04.518975 dv-cinder-816324-1-iscsi neutron-server[108545]: {{(pid=108545) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 02 12:41:04.527140 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-eb86ab79-89b4-4d1c-be94-9631eca3b2f7 None None] Provisioning complete for port a74ddbb7-0315-45e6-a447-df6612be9e98 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:41:04.528115 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-eb86ab79-89b4-4d1c-be94-9631eca3b2f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:04.563771 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-eb86ab79-89b4-4d1c-be94-9631eca3b2f7 None None] Port a74ddbb7-0315-45e6-a447-df6612be9e98 cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:41:04.596570 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.db [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] For port a74ddbb7-0315-45e6-a447-df6612be9e98, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108545) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:41:04.617190 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.db [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] For port a74ddbb7-0315-45e6-a447-df6612be9e98, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=a74ddbb7-0315-45e6-a447-df6612be9e98,segment=NetworkSegment(b061f042-2b67-420a-bd5f-e8d867e8682e),segment_id=b061f042-2b67-420a-bd5f-e8d867e8682e)] {{(pid=108545) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:41:04.688721 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:04.753480 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] Routers {'45c32243-437d-47d1-a4d4-8073125e2fd4'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:41:04.754116 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:40:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['45c32243-437d-47d1-a4d4-8073125e2fd4'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:41:04.827105 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86fcce98-cc75-4b95-a90a-e31c5a49cdc9 None None] Pushing event updated for resources: {'Port': ['ID=a74ddbb7-0315-45e6-a447-df6612be9e98,revision_number=4']} {{(pid=108545) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:41:04.855402 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] Set router 45c32243-437d-47d1-a4d4-8073125e2fd4 gateway port host: None {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:41:04.992946 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1f4c0df7-3747-420f-a9cd-525cefeb047d None None] Provisioning complete for port a74ddbb7-0315-45e6-a447-df6612be9e98 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:41:04.993526 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1f4c0df7-3747-420f-a9cd-525cefeb047d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:05.087434 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '45c32243-437d-47d1-a4d4-8073125e2fd4', 'name': 'router1', 'tenant_id': '32b8be9a4673430686c2ab5175b0d5a3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:40:51Z', 'updated_at': '2021-11-02T12:41:01Z', 'revision_number': 2, 'project_id': '32b8be9a4673430686c2ab5175b0d5a3', 'gw_port_host': None, '_interfaces': [{'id': 'a74ddbb7-0315-45e6-a447-df6612be9e98', 'name': '', 'network_id': '7a24adba-610c-42dc-b2b6-0650a50fba6b', 'tenant_id': '32b8be9a4673430686c2ab5175b0d5a3', 'mac_address': 'fa:16:3e:8d:26:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '45c32243-437d-47d1-a4d4-8073125e2fd4', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '3489ab30-1600-4db0-84aa-7973200b6577', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:41:01Z', 'updated_at': '2021-11-02T12:41:04Z', 'revision_number': 4, 'project_id': '32b8be9a4673430686c2ab5175b0d5a3', 'subnets': [{'id': '3489ab30-1600-4db0-84aa-7973200b6577', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'fa021d63-1b84-45eb-a6e2-d039a6fae399'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:41:05.114221 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4eef079f-263f-4213-8b36-365816eb0556 None None] The sync data for ids ['45c32243-437d-47d1-a4d4-8073125e2fd4'] in dv-cinder-816324-1-iscsi is: [{'id': '45c32243-437d-47d1-a4d4-8073125e2fd4', 'name': 'router1', 'tenant_id': '32b8be9a4673430686c2ab5175b0d5a3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:40:51Z', 'updated_at': '2021-11-02T12:41:01Z', 'revision_number': 2, 'project_id': '32b8be9a4673430686c2ab5175b0d5a3', 'gw_port_host': None, '_interfaces': [{'id': 'a74ddbb7-0315-45e6-a447-df6612be9e98', 'name': '', 'network_id': '7a24adba-610c-42dc-b2b6-0650a50fba6b', 'tenant_id': '32b8be9a4673430686c2ab5175b0d5a3', 'mac_address': 'fa:16:3e:8d:26:a3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '45c32243-437d-47d1-a4d4-8073125e2fd4', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '3489ab30-1600-4db0-84aa-7973200b6577', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:41:01Z', 'updated_at': '2021-11-02T12:41:04Z', 'revision_number': 4, 'project_id': '32b8be9a4673430686c2ab5175b0d5a3', 'subnets': [{'id': '3489ab30-1600-4db0-84aa-7973200b6577', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'fa021d63-1b84-45eb-a6e2-d039a6fae399'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:41:05.121879 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1f4c0df7-3747-420f-a9cd-525cefeb047d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:05.166841 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1f4c0df7-3747-420f-a9cd-525cefeb047d None None] For port a74ddbb7-0315-45e6-a447-df6612be9e98, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=a74ddbb7-0315-45e6-a447-df6612be9e98,segment=NetworkSegment(b061f042-2b67-420a-bd5f-e8d867e8682e),segment_id=b061f042-2b67-420a-bd5f-e8d867e8682e)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:41:05.225351 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1f4c0df7-3747-420f-a9cd-525cefeb047d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:05.277203 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1f4c0df7-3747-420f-a9cd-525cefeb047d None None] Pushing event updated for resources: {'Port': ['ID=a74ddbb7-0315-45e6-a447-df6612be9e98,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:41:05.361958 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 52838) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:41:05.482712 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-37af63d9-b80b-4e49-91fa-cf55513bbdc7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:41:05.484083 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-37af63d9-b80b-4e49-91fa-cf55513bbdc7 admin admin] 10.222.0.98 "GET /v2.0/networks/43464fa8-eb00-46fb-9ca0-be7342f9ddbf HTTP/1.1" status: 200 len: 842 time: 0.1211545 Nov 02 12:41:05.494396 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-649deb75-defc-42a4-8b4f-802fbb1b9a30 admin admin] Request body: {'subnet': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'gateway_ip': '172.27.0.1', 'ip_version': 4, 'enable_dhcp': False, 'name': 'public-subnet', 'cidr': '172.27.0.0/24'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:41:05.578774 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-649deb75-defc-42a4-8b4f-802fbb1b9a30 admin admin] Made reservation on behalf of f0f28d7144b0429b9938ca83a996bf44 for: {'subnet': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:41:05.581134 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-649deb75-defc-42a4-8b4f-802fbb1b9a30 admin admin] Publish callbacks [] for subnet, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:05.997480 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.objects.ports [None req-649deb75-defc-42a4-8b4f-802fbb1b9a30 admin admin] Time-cost: Fetching 0 ports in 0 security groups {{(pid=108542) get_objects /opt/stack/neutron/neutron/objects/ports.py:444}} Nov 02 12:41:05.997935 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-649deb75-defc-42a4-8b4f-802fbb1b9a30 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for subnet, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:06.054952 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-649deb75-defc-42a4-8b4f-802fbb1b9a30 admin admin] Pushing event updated for resources: {'Subnet': ['ID=44a807bc-f2b6-41f0-b765-e5d3393fe305,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:41:06.063147 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-649deb75-defc-42a4-8b4f-802fbb1b9a30 admin admin] Checking segment: {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108542) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:41:06.063502 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-649deb75-defc-42a4-8b4f-802fbb1b9a30 admin admin] Network hostable DHCP agents. Network: 43464fa8-eb00-46fb-9ca0-be7342f9ddbf, hostable agents: ['1b947f40-f8bf-4088-a5dc-35ee29d90d78'], hosted agents: [] {{(pid=108542) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 02 12:41:06.144870 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-649deb75-defc-42a4-8b4f-802fbb1b9a30 admin admin] Network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf is scheduled to be hosted by DHCP agent 1b947f40-f8bf-4088-a5dc-35ee29d90d78 with binding_index 1 {{(pid=108542) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 02 12:41:06.213162 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-649deb75-defc-42a4-8b4f-802fbb1b9a30 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816324-1-iscsi, 43464fa8-eb00-46fb-9ca0-be7342f9ddbf) {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:41:06.217738 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-649deb75-defc-42a4-8b4f-802fbb1b9a30 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:41:06.218809 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-649deb75-defc-42a4-8b4f-802fbb1b9a30 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for subnet, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:06.223057 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3072b066-3bac-41a1-96bd-fd2c5f440167 None None] Network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:41:06.314495 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-649deb75-defc-42a4-8b4f-802fbb1b9a30 admin admin] 10.222.0.98 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 821 time: 0.8119664 Nov 02 12:41:06.364090 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-1fbde3e3-0d49-4f29-b805-b6567f5116c4 None None] Network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:41:08.831424 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 52846) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:41:08.958444 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.policy [None req-0fb61e33-ee72-41d3-ba00-5effdd5b1fc1 admin admin] Loaded default policies from ['neutron'] under neutron.policies entry points {{(pid=108543) register_rules /opt/stack/neutron/neutron/policy.py:73}} Nov 02 12:41:09.007364 dv-cinder-816324-1-iscsi neutron-server[108543]: WARNING oslo_policy.policy [None req-0fb61e33-ee72-41d3-ba00-5effdd5b1fc1 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 02 12:41:09.007759 dv-cinder-816324-1-iscsi neutron-server[108543]: WARNING oslo_policy.policy [None req-0fb61e33-ee72-41d3-ba00-5effdd5b1fc1 admin admin] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Nov 02 12:41:09.255185 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-0fb61e33-ee72-41d3-ba00-5effdd5b1fc1 admin admin] 10.222.0.98 "GET /v2.0/routers/45c32243-437d-47d1-a4d4-8073125e2fd4 HTTP/1.1" status: 200 len: 710 time: 0.4226460 Nov 02 12:41:09.447438 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9ec7cce2-2e63-4316-a496-cf1793d86913 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:41:09.449243 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-9ec7cce2-2e63-4316-a496-cf1793d86913 admin admin] 10.222.0.98 "GET /v2.0/networks/43464fa8-eb00-46fb-9ca0-be7342f9ddbf HTTP/1.1" status: 200 len: 886 time: 0.1879878 Nov 02 12:41:09.459887 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Request body: {'router': {'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:41:09.729505 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:10.071291 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:10.160920 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:10.353567 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Allocated IP 172.27.0.85 (43464fa8-eb00-46fb-9ca0-be7342f9ddbf/44a807bc-f2b6-41f0-b765-e5d3393fe305/31b94bc5-e5e1-49d0-91f7-5dee93d4221a) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:41:10.477389 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:10.598417 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:10.657571 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:41:10.663686 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:41:10.725033 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Pushing event updated for resources: {'Port': ['ID=31b94bc5-e5e1-49d0-91f7-5dee93d4221a,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:41:10.727927 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:41:10.767964 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:41:10.768314 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:41:10.768653 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:41:10.768986 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:41:10.769317 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:41:10.769670 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:41:10.770029 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:41:10.770307 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:41:10.771206 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:41:10.771527 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:41:10.771842 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:41:10.772156 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Tracked resource versions report: Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: pushed versions: Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: { 'AddressGroup': {'1.2'}, Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: 'ConntrackHelper': {'1.0'}, Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: 'Log': {'1.0'}, Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: 'Network': {'1.1'}, Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: 'Port': {'1.7'}, Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: 'PortForwarding': {'1.2'}, Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: 'QosPolicy': {'1.10'}, Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: 'SecurityGroup': {'1.5'}, Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: 'SecurityGroupRule': {'1.2'}, Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: 'SubPort': {'1.0'}, Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: 'Subnet': {'1.1'}, Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: 'Trunk': {'1.1'}} Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: consumer versions: Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: { DHCP agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: L3 agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: Metadata agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: Metering agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: Open vSwitch agent@dv-cinder-816324-1-iscsi: { 'AddressGroup': '1.2', Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: 'ConntrackHelper': '1.0', Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: 'Log': '1.0', Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: 'Network': '1.1', Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: 'Port': '1.7', Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: 'PortForwarding': '1.2', Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: 'QosPolicy': '1.10', Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: 'SecurityGroup': '1.5', Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: 'SecurityGroupRule': '1.2', Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: 'SubPort': '1.0', Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: 'Subnet': '1.1', Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: 'Trunk': '1.1'}} Nov 02 12:41:10.773304 dv-cinder-816324-1-iscsi neutron-server[108543]: {{(pid=108543) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 02 12:41:11.099243 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:11.337943 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._handle_distributed_migration-1595111', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._validate_migration-1593200', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._update_router_provider-25706'] for router, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:11.343776 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1595034', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_distributed_port_bindings_after_change-1595116', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_snat_interfaces_after_change-1595029', 'neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._reconfigure_ha_resources-1593209'] for router, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:11.488776 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Router 45c32243-437d-47d1-a4d4-8073125e2fd4 has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108543) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 12:41:11.652269 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108543) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:41:11.657210 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-162b7461-386a-407d-8e54-88627505294f admin admin] Publish callbacks [] for router, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:11.658461 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-162b7461-386a-407d-8e54-88627505294f admin admin] 10.222.0.98 "PUT /v2.0/routers/45c32243-437d-47d1-a4d4-8073125e2fd4 HTTP/1.1" status: 200 len: 889 time: 2.2027173 Nov 02 12:41:12.231036 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] Sync routers for ids ['45c32243-437d-47d1-a4d4-8073125e2fd4'] in dv-cinder-816324-1-iscsi {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:41:12.242360 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] Routers {'45c32243-437d-47d1-a4d4-8073125e2fd4'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:41:12.243039 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:40:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['45c32243-437d-47d1-a4d4-8073125e2fd4'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:41:12.451220 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] Set router 45c32243-437d-47d1-a4d4-8073125e2fd4 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:41:12.561832 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device a74ddbb7-0315-45e6-a447-df6612be9e98 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:41:12.771557 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port a74ddbb7-0315-45e6-a447-df6612be9e98 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:41:12.771880 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:13.012264 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '45c32243-437d-47d1-a4d4-8073125e2fd4', 'name': 'router1', 'tenant_id': '32b8be9a4673430686c2ab5175b0d5a3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.85'}], 'enable_snat': True}, 'gw_port_id': '31b94bc5-e5e1-49d0-91f7-5dee93d4221a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:40:51Z', 'updated_at': '2021-11-02T12:41:10Z', 'revision_number': 4, 'project_id': '32b8be9a4673430686c2ab5175b0d5a3', 'gw_port': {'id': '31b94bc5-e5e1-49d0-91f7-5dee93d4221a', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:58:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '45c32243-437d-47d1-a4d4-8073125e2fd4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:41:10Z', 'updated_at': '2021-11-02T12:41:10Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': 'a74ddbb7-0315-45e6-a447-df6612be9e98', 'name': '', 'network_id': '7a24adba-610c-42dc-b2b6-0650a50fba6b', 'tenant_id': '32b8be9a4673430686c2ab5175b0d5a3', 'mac_address': 'fa:16:3e:8d:26:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '45c32243-437d-47d1-a4d4-8073125e2fd4', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '3489ab30-1600-4db0-84aa-7973200b6577', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:41:01Z', 'updated_at': '2021-11-02T12:41:05Z', 'revision_number': 5, 'project_id': '32b8be9a4673430686c2ab5175b0d5a3', 'subnets': [{'id': '3489ab30-1600-4db0-84aa-7973200b6577', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'fa021d63-1b84-45eb-a6e2-d039a6fae399'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:41:13.063144 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] Checking router: 45c32243-437d-47d1-a4d4-8073125e2fd4 for host: dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:41:13.063489 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] Updating router 45c32243-437d-47d1-a4d4-8073125e2fd4 port 31b94bc5-e5e1-49d0-91f7-5dee93d4221a binding host dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 02 12:41:13.111765 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:13.427700 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] Publish callbacks [] for port, precommit_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:13.478208 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:13.534467 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] Attempting to bind port 31b94bc5-e5e1-49d0-91f7-5dee93d4221a on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:41:13.534840 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] Attempting to bind port 31b94bc5-e5e1-49d0-91f7-5dee93d4221a by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:41:13.536409 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] Attempting to bind port 31b94bc5-e5e1-49d0-91f7-5dee93d4221a on network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:41:13.538164 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4352986d-6708-44ca-afa3-11fb8a0c619f None None] Pushing event updated for resources: {'Port': ['ID=31b94bc5-e5e1-49d0-91f7-5dee93d4221a,revision_number=2']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:41:13.543822 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 41, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:41:13.544197 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] Checking segment: {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108544) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:41:13.544598 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:13.545380 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] Bound using segment: {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:41:13.545466 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] Bound port: 31b94bc5-e5e1-49d0-91f7-5dee93d4221a, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:41:13.545807 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:13.599456 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] For port 31b94bc5-e5e1-49d0-91f7-5dee93d4221a, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108544) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:41:13.602907 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] For port 31b94bc5-e5e1-49d0-91f7-5dee93d4221a, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=31b94bc5-e5e1-49d0-91f7-5dee93d4221a,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108544) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:41:13.704833 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:13.764048 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] Routers {'45c32243-437d-47d1-a4d4-8073125e2fd4'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:41:13.764660 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 0, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 0, "log_agent_heartbeats": false, "routers": 0},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:40:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['45c32243-437d-47d1-a4d4-8073125e2fd4'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:41:13.766600 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4352986d-6708-44ca-afa3-11fb8a0c619f None None] Pushing event updated for resources: {'Port': ['ID=31b94bc5-e5e1-49d0-91f7-5dee93d4221a,revision_number=3']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:41:13.902343 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] Set router 45c32243-437d-47d1-a4d4-8073125e2fd4 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:41:14.120742 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '45c32243-437d-47d1-a4d4-8073125e2fd4', 'name': 'router1', 'tenant_id': '32b8be9a4673430686c2ab5175b0d5a3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.85'}], 'enable_snat': True}, 'gw_port_id': '31b94bc5-e5e1-49d0-91f7-5dee93d4221a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:40:51Z', 'updated_at': '2021-11-02T12:41:10Z', 'revision_number': 4, 'project_id': '32b8be9a4673430686c2ab5175b0d5a3', 'gw_port': {'id': '31b94bc5-e5e1-49d0-91f7-5dee93d4221a', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:58:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '45c32243-437d-47d1-a4d4-8073125e2fd4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:41:10Z', 'updated_at': '2021-11-02T12:41:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': 'a74ddbb7-0315-45e6-a447-df6612be9e98', 'name': '', 'network_id': '7a24adba-610c-42dc-b2b6-0650a50fba6b', 'tenant_id': '32b8be9a4673430686c2ab5175b0d5a3', 'mac_address': 'fa:16:3e:8d:26:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '45c32243-437d-47d1-a4d4-8073125e2fd4', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '3489ab30-1600-4db0-84aa-7973200b6577', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:41:01Z', 'updated_at': '2021-11-02T12:41:05Z', 'revision_number': 5, 'project_id': '32b8be9a4673430686c2ab5175b0d5a3', 'subnets': [{'id': '3489ab30-1600-4db0-84aa-7973200b6577', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'fa021d63-1b84-45eb-a6e2-d039a6fae399'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:41:14.149576 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ed6be2ca-a47b-4d1e-b168-3b39e5eec3e3 None None] The sync data for ids ['45c32243-437d-47d1-a4d4-8073125e2fd4'] in dv-cinder-816324-1-iscsi is: [{'id': '45c32243-437d-47d1-a4d4-8073125e2fd4', 'name': 'router1', 'tenant_id': '32b8be9a4673430686c2ab5175b0d5a3', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.85'}], 'enable_snat': True}, 'gw_port_id': '31b94bc5-e5e1-49d0-91f7-5dee93d4221a', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:40:51Z', 'updated_at': '2021-11-02T12:41:10Z', 'revision_number': 4, 'project_id': '32b8be9a4673430686c2ab5175b0d5a3', 'gw_port': {'id': '31b94bc5-e5e1-49d0-91f7-5dee93d4221a', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:4f:58:ef', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '45c32243-437d-47d1-a4d4-8073125e2fd4', 'device_owner': 'network:router_gateway', 'standard_attr_id': 21, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.85', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:41:10Z', 'updated_at': '2021-11-02T12:41:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': 'a74ddbb7-0315-45e6-a447-df6612be9e98', 'name': '', 'network_id': '7a24adba-610c-42dc-b2b6-0650a50fba6b', 'tenant_id': '32b8be9a4673430686c2ab5175b0d5a3', 'mac_address': 'fa:16:3e:8d:26:a3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '45c32243-437d-47d1-a4d4-8073125e2fd4', 'device_owner': 'network:router_interface', 'standard_attr_id': 19, 'fixed_ips': [{'subnet_id': '3489ab30-1600-4db0-84aa-7973200b6577', 'ip_address': '172.20.0.1', 'prefixlen': 26}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:41:01Z', 'updated_at': '2021-11-02T12:41:05Z', 'revision_number': 5, 'project_id': '32b8be9a4673430686c2ab5175b0d5a3', 'subnets': [{'id': '3489ab30-1600-4db0-84aa-7973200b6577', 'cidr': '172.20.0.0/26', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': 'fa021d63-1b84-45eb-a6e2-d039a6fae399'}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:41:14.221820 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 52864) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:41:14.352691 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-c577c187-bff9-468d-83f4-c949f413fae1 admin admin] 10.222.0.98 "GET /v2.0/ports?device_owner=network%3Arouter_gateway&fields=id&fields=name&fields=mac_address&fields=fixed_ips&fields=status HTTP/1.1" status: 200 len: 410 time: 0.1295674 Nov 02 12:41:14.581422 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 31b94bc5-e5e1-49d0-91f7-5dee93d4221a up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:41:14.639632 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 31b94bc5-e5e1-49d0-91f7-5dee93d4221a triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:41:14.640152 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:14.734898 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:14.758152 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] For port 31b94bc5-e5e1-49d0-91f7-5dee93d4221a, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=31b94bc5-e5e1-49d0-91f7-5dee93d4221a,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:41:14.832359 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:14.886703 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Pushing event updated for resources: {'Port': ['ID=31b94bc5-e5e1-49d0-91f7-5dee93d4221a,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:41:16.542126 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 31b94bc5-e5e1-49d0-91f7-5dee93d4221a up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:41:16.604881 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 31b94bc5-e5e1-49d0-91f7-5dee93d4221a triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:41:16.605455 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:21.466547 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 5 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:41:23.484160 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-a8237480-7a87-47ca-9b22-b41eb4a5c823 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:25.629639 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-d5d4f088-b759-4f92-adf3-c7193a5c0e9a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:26.812735 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:28.334809 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:30.792457 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:53.480518 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-482f95a5-b750-483c-9606-21a524cc32c8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:55.655495 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-660a928a-9c51-4774-8e4f-748600eb06e2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:56.777814 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:58.223752 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:41:58.466144 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 5 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:42:00.807654 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:42:23.481213 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-f56f323d-80cb-4144-aa3a-c3f41532aa8d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:42:25.618027 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-3ab8dbd4-3f5c-4388-a2d1-cc74ea43483c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:42:26.755489 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:42:28.222746 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:42:30.810552 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:42:35.464096 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 5 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:42:53.463219 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-6fb349ba-bf00-423c-a9f2-e6bacaf45836 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:42:55.615470 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-56f9769e-13e1-4a4d-b30e-04ad96ec585c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:42:56.781473 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:42:58.222772 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:00.817157 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:01.003509 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 53426) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:43:01.075313 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.pecan_wsgi.hooks.translation [None req-2c94ca33-d03b-4fb4-bfe3-d74bcc055fc7 admin admin] GET failed (client error): The resource could not be found. Nov 02 12:43:01.076640 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-2c94ca33-d03b-4fb4-bfe3-d74bcc055fc7 admin admin] 10.222.0.98 "GET /v2.0/networks/private HTTP/1.1" status: 404 len: 315 time: 0.0721653 Nov 02 12:43:01.270643 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-48422fa4-0f5c-4b7b-8f79-d4bab85e6650 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:43:01.272186 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-48422fa4-0f5c-4b7b-8f79-d4bab85e6650 admin admin] 10.222.0.98 "GET /v2.0/networks?name=private HTTP/1.1" status: 200 len: 872 time: 0.1907811 Nov 02 12:43:03.628369 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 53436) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:43:03.724478 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ee6e12b8-a6cd-4b2f-8ea3-819957fc44ea admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:43:03.725863 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-ee6e12b8-a6cd-4b2f-8ea3-819957fc44ea admin admin] 10.222.0.98 "GET /v2.0/subnets/3489ab30-1600-4db0-84aa-7973200b6577 HTTP/1.1" status: 200 len: 849 time: 0.0965390 Nov 02 12:43:03.735932 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-4e79ff44-d01f-444c-9ae1-626b28cd2523 admin admin] Request body: {'subnet': {'dns_nameservers': ['8.8.8.8', '8.8.4.4']}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:43:03.831201 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4e79ff44-d01f-444c-9ae1-626b28cd2523 admin admin] Publish callbacks [] for subnet, before_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:04.146573 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4e79ff44-d01f-444c-9ae1-626b28cd2523 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_subnet_gateway_ip_update-8738449974092'] for subnet, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:04.178687 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e79ff44-d01f-444c-9ae1-626b28cd2523 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:43:04.179279 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4e79ff44-d01f-444c-9ae1-626b28cd2523 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for subnet, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:04.180593 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-4e79ff44-d01f-444c-9ae1-626b28cd2523 admin admin] 10.222.0.98 "PUT /v2.0/subnets/3489ab30-1600-4db0-84aa-7973200b6577 HTTP/1.1" status: 200 len: 868 time: 0.4484148 Nov 02 12:43:04.193697 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d5a69138-3a38-40a3-be61-0b0e9f111205 None None] Network 7a24adba-610c-42dc-b2b6-0650a50fba6b requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:43:04.201189 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e79ff44-d01f-444c-9ae1-626b28cd2523 admin admin] Pushing event updated for resources: {'Subnet': ['ID=3489ab30-1600-4db0-84aa-7973200b6577,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:43:04.209253 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e79ff44-d01f-444c-9ae1-626b28cd2523 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:04.209604 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e79ff44-d01f-444c-9ae1-626b28cd2523 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:04.209961 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e79ff44-d01f-444c-9ae1-626b28cd2523 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:04.210286 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e79ff44-d01f-444c-9ae1-626b28cd2523 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:04.210672 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e79ff44-d01f-444c-9ae1-626b28cd2523 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:04.211036 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e79ff44-d01f-444c-9ae1-626b28cd2523 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:04.211408 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e79ff44-d01f-444c-9ae1-626b28cd2523 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:04.211753 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e79ff44-d01f-444c-9ae1-626b28cd2523 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:04.212045 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e79ff44-d01f-444c-9ae1-626b28cd2523 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:04.212375 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e79ff44-d01f-444c-9ae1-626b28cd2523 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:04.212713 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e79ff44-d01f-444c-9ae1-626b28cd2523 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:04.213018 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4e79ff44-d01f-444c-9ae1-626b28cd2523 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:04.600546 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-69411c1f-ed6c-4489-b312-01cf4e39b7ff None None] Provisioning complete for port 6b080fe5-bf7e-4cfd-973b-56212bb03c5e triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:43:04.600910 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-69411c1f-ed6c-4489-b312-01cf4e39b7ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:04.695676 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-69411c1f-ed6c-4489-b312-01cf4e39b7ff None None] Provisioning complete for port a74ddbb7-0315-45e6-a447-df6612be9e98 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:43:04.695927 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-69411c1f-ed6c-4489-b312-01cf4e39b7ff None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:06.573641 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 53444) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:43:06.786204 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-744ba2fd-563f-4796-b82a-733d183d9d56 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:43:06.786595 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-744ba2fd-563f-4796-b82a-733d183d9d56 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:43:06.788144 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-744ba2fd-563f-4796-b82a-733d183d9d56 admin admin] 10.222.0.98 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2135391 Nov 02 12:43:09.127903 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 53452) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:43:09.331598 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b81707be-3cd3-4066-be1e-b66e79818e71 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:43:09.332049 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-b81707be-3cd3-4066-be1e-b66e79818e71 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:43:09.333657 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-b81707be-3cd3-4066-be1e-b66e79818e71 admin admin] 10.222.0.98 "GET /v2.0/networks HTTP/1.1" status: 200 len: 1549 time: 0.2048094 Nov 02 12:43:11.721561 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 53462) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:43:11.870975 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-717a743c-e82a-4d7c-b5db-9b9bf69ef577 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:43:11.872267 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-717a743c-e82a-4d7c-b5db-9b9bf69ef577 admin admin] 10.222.0.98 "GET /v2.0/networks/43464fa8-eb00-46fb-9ca0-be7342f9ddbf HTTP/1.1" status: 200 len: 886 time: 0.1529288 Nov 02 12:43:12.463236 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 5 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:43:14.214553 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 53470) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:43:14.347548 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3236ea18-9a1d-4876-86f5-6a5693959671 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:43:14.348942 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-3236ea18-9a1d-4876-86f5-6a5693959671 admin admin] 10.222.0.98 "GET /v2.0/networks/7a24adba-610c-42dc-b2b6-0650a50fba6b HTTP/1.1" status: 200 len: 869 time: 0.1334035 Nov 02 12:43:16.656650 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 53478) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:43:16.786617 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a335fc37-a15b-4fc0-bd84-b2a7c98a4954 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:43:16.787069 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a335fc37-a15b-4fc0-bd84-b2a7c98a4954 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:43:16.788854 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-a335fc37-a15b-4fc0-bd84-b2a7c98a4954 admin admin] 10.222.0.98 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1311810 Nov 02 12:43:19.140178 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 53486) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:43:19.263000 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c654376-9d6c-4cb2-a45f-4e406377c7d3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:43:19.263448 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-3c654376-9d6c-4cb2-a45f-4e406377c7d3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:43:19.264940 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-3c654376-9d6c-4cb2-a45f-4e406377c7d3 admin admin] 10.222.0.98 "GET /v2.0/subnets HTTP/1.1" status: 200 len: 1479 time: 0.1238303 Nov 02 12:43:21.562766 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 53494) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:43:21.663048 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9d40f71b-5cb3-4302-9769-e3a53aecad10 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:43:21.664404 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-9d40f71b-5cb3-4302-9769-e3a53aecad10 admin admin] 10.222.0.98 "GET /v2.0/subnets/3489ab30-1600-4db0-84aa-7973200b6577 HTTP/1.1" status: 200 len: 868 time: 0.1001990 Nov 02 12:43:23.478977 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-24b216dc-5b92-41a6-ab15-cf17292e303b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:23.947727 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 53502) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:43:24.034206 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01731d09-7a84-41dd-9af1-368cbb813924 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:43:24.035586 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-01731d09-7a84-41dd-9af1-368cbb813924 admin admin] 10.222.0.98 "GET /v2.0/subnets/44a807bc-f2b6-41f0-b765-e5d3393fe305 HTTP/1.1" status: 200 len: 816 time: 0.0869267 Nov 02 12:43:25.604424 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-360a8d13-fe9b-40bd-b48e-f22b44b0cba0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:26.775792 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:28.251100 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:30.787367 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:49.214111 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 53558) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:43:49.263167 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [None req-d8753e9d-028d-4b52-957f-bd10242f8778 admin admin] http://10.222.0.98:9696/v2.0/extensions returned with HTTP 200 {{(pid=108543) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 02 12:43:49.264167 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-d8753e9d-028d-4b52-957f-bd10242f8778 admin admin] 10.222.0.98 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13869 time: 0.0489776 Nov 02 12:43:49.462631 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 5 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:43:51.714512 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 53566) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:43:51.778677 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.pecan_wsgi.hooks.translation [None req-a8879564-a605-47d1-bd3a-c6bde32fb07c admin admin] GET failed (client error): The resource could not be found. Nov 02 12:43:51.780057 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-a8879564-a605-47d1-bd3a-c6bde32fb07c admin admin] 10.222.0.98 "GET /v2.0/networks/public HTTP/1.1" status: 404 len: 314 time: 0.0646152 Nov 02 12:43:51.928718 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-72b9c377-da15-4ad7-ac22-3dc0cec1b5dc admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:43:51.930196 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-72b9c377-da15-4ad7-ac22-3dc0cec1b5dc admin admin] 10.222.0.98 "GET /v2.0/networks?name=public HTTP/1.1" status: 200 len: 889 time: 0.1453698 Nov 02 12:43:53.482234 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c1c83541-a8da-478e-989f-8eab31e6249f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:54.326189 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 53574) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:43:54.375287 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] Request body: {'network': {'name': 'shared', 'admin_state_up': True, 'shared': True}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:43:54.376381 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.quota [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] Loaded quota_driver: . Nov 02 12:43:54.476268 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] Made reservation on behalf of f0f28d7144b0429b9938ca83a996bf44 for: {'network': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:43:54.478946 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for network, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:54.528284 dv-cinder-816324-1-iscsi neutron-server[108543]: WARNING neutron.services.revisions.revision_plugin [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] Could not find related network for resource to bump revision. Nov 02 12:43:54.545475 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 879} {{(pid=108543) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 02 12:43:54.558792 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] Publish callbacks ['neutron.services.segments.db._add_segment_host_mapping_for_segment-8738449897957', 'neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:54.559348 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] Unsubscribe: segment precommit_create {{(pid=108543) unsubscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:83}} Nov 02 12:43:54.559840 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.db.segments_db [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] Added segment 914624d2-b577-476c-8aac-4af5f5930ab2 of type vlan for network 41ba5328-8dc5-4a66-a20d-744b82293eda Nov 02 12:43:54.614439 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738449409639'] for network, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:54.722077 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for network, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:54.723104 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:43:54.723711 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:54.824652 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] Pushing event updated for resources: {'Network': ['ID=41ba5328-8dc5-4a66-a20d-744b82293eda,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:43:54.831789 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:54.832153 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:54.832489 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:54.832816 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:54.833143 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:54.833461 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:54.833780 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:54.834114 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:54.834458 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:54.834886 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:54.835186 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:54.835501 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:54.845305 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-7c409541-c0de-43c4-b97d-359614725550 admin admin] 10.222.0.98 "POST /v2.0/networks HTTP/1.1" status: 201 len: 847 time: 0.5159855 Nov 02 12:43:54.848602 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Network 41ba5328-8dc5-4a66-a20d-744b82293eda details requested by agent ovs-agent-dv-cinder-816324-1-iscsi with host dv-cinder-816324-1-iscsi {{(pid=108544) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 02 12:43:55.631007 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-762e0790-223a-4146-9a2f-33204bf13902 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:56.780983 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:57.274531 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 53582) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:43:57.360766 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.pecan_wsgi.hooks.translation [None req-56933291-0832-4c84-bbbf-97da65e5bc62 admin admin] GET failed (client error): The resource could not be found. Nov 02 12:43:57.362135 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-56933291-0832-4c84-bbbf-97da65e5bc62 admin admin] 10.222.0.98 "GET /v2.0/networks/shared HTTP/1.1" status: 404 len: 314 time: 0.0866492 Nov 02 12:43:57.512668 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-f1fabc2d-6cc1-4283-8835-bcce3c33148a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:43:57.514082 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-f1fabc2d-6cc1-4283-8835-bcce3c33148a admin admin] 10.222.0.98 "GET /v2.0/networks?name=shared HTTP/1.1" status: 200 len: 826 time: 0.1471460 Nov 02 12:43:57.524468 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-fe75ff4a-590b-4856-9df5-9af646eb6b03 admin admin] Request body: {'subnet': {'network_id': '41ba5328-8dc5-4a66-a20d-744b82293eda', 'name': 'shared-subnet', 'ip_version': 4, 'cidr': '192.168.233.0/24', 'description': 'shared-subnet'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:43:57.603700 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fe75ff4a-590b-4856-9df5-9af646eb6b03 admin admin] Made reservation on behalf of f0f28d7144b0429b9938ca83a996bf44 for: {'subnet': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:43:57.606248 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-fe75ff4a-590b-4856-9df5-9af646eb6b03 admin admin] Publish callbacks [] for subnet, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:57.889348 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-fe75ff4a-590b-4856-9df5-9af646eb6b03 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for subnet, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:57.948047 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fe75ff4a-590b-4856-9df5-9af646eb6b03 admin admin] Pushing event updated for resources: {'Subnet': ['ID=842a3ec7-e9a3-40a5-b477-63472d7a5707,revision_number=0']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:43:57.962840 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-fe75ff4a-590b-4856-9df5-9af646eb6b03 admin admin] Checking segment: {'id': '914624d2-b577-476c-8aac-4af5f5930ab2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '41ba5328-8dc5-4a66-a20d-744b82293eda'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108543) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:43:57.963139 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe75ff4a-590b-4856-9df5-9af646eb6b03 admin admin] Network hostable DHCP agents. Network: 41ba5328-8dc5-4a66-a20d-744b82293eda, hostable agents: ['1b947f40-f8bf-4088-a5dc-35ee29d90d78'], hosted agents: [] {{(pid=108543) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 02 12:43:58.072185 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-fe75ff4a-590b-4856-9df5-9af646eb6b03 admin admin] Network 41ba5328-8dc5-4a66-a20d-744b82293eda is scheduled to be hosted by DHCP agent 1b947f40-f8bf-4088-a5dc-35ee29d90d78 with binding_index 1 {{(pid=108543) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 02 12:43:58.129087 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [None req-fe75ff4a-590b-4856-9df5-9af646eb6b03 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816324-1-iscsi, 41ba5328-8dc5-4a66-a20d-744b82293eda) {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:43:58.133221 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fe75ff4a-590b-4856-9df5-9af646eb6b03 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:43:58.133799 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-fe75ff4a-590b-4856-9df5-9af646eb6b03 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for subnet, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:58.138538 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-507107a3-31a2-4f06-8b43-ddcece6a96f0 None None] Network 41ba5328-8dc5-4a66-a20d-744b82293eda requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:43:58.200466 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-fe75ff4a-590b-4856-9df5-9af646eb6b03 admin admin] 10.222.0.98 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 0.6793215 Nov 02 12:43:58.270021 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:58.308074 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp94ac73f7-a43e-5b43-a0b7-503cbb5c76bd-41ba5328-8dc5-4a66-a20d-744b82293eda', 'network_id': '41ba5328-8dc5-4a66-a20d-744b82293eda', 'tenant_id': 'f0f28d7144b0429b9938ca83a996bf44', 'fixed_ips': [{'subnet_id': '842a3ec7-e9a3-40a5-b477-63472d7a5707'}]}} from dv-cinder-816324-1-iscsi. {{(pid=108544) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 02 12:43:58.308998 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:58.460645 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.db_base_plugin_common [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Allocated IP 192.168.233.2 (41ba5328-8dc5-4a66-a20d-744b82293eda/842a3ec7-e9a3-40a5-b477-63472d7a5707/b126fb86-7a22-4555-be88-659629a3dd6c) {{(pid=108544) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:43:58.625342 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Publish callbacks [] for port, precommit_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:58.694656 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669'] for port, after_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:58.742117 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Network 41ba5328-8dc5-4a66-a20d-744b82293eda is already hosted by enough agents. {{(pid=108544) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:43:58.747642 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.scheduler.base_scheduler [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Resources bound (agent type, host, resource id): {{(pid=108544) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:43:58.750318 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Received port after_create {{(pid=108544) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:43:58.764477 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Pushing event updated for resources: {'Port': ['ID=b126fb86-7a22-4555-be88-659629a3dd6c,revision_number=1']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:43:58.785091 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:58.785452 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:58.785794 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:58.786122 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:58.786470 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:58.786796 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:58.787114 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:58.787432 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:58.787768 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:58.788089 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:58.788403 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:58.788716 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:43:58.825899 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Attempting to bind port b126fb86-7a22-4555-be88-659629a3dd6c on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:43:58.826265 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Attempting to bind port b126fb86-7a22-4555-be88-659629a3dd6c by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': '914624d2-b577-476c-8aac-4af5f5930ab2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '41ba5328-8dc5-4a66-a20d-744b82293eda'}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:43:58.826694 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Attempting to bind port b126fb86-7a22-4555-be88-659629a3dd6c on network 41ba5328-8dc5-4a66-a20d-744b82293eda {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:43:58.832896 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 43, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:43:58.833256 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Checking segment: {'id': '914624d2-b577-476c-8aac-4af5f5930ab2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '41ba5328-8dc5-4a66-a20d-744b82293eda'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108544) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:43:58.833655 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:58.834039 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Bound using segment: {'id': '914624d2-b577-476c-8aac-4af5f5930ab2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '41ba5328-8dc5-4a66-a20d-744b82293eda'} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:43:58.834545 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Bound port: b126fb86-7a22-4555-be88-659629a3dd6c, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '914624d2-b577-476c-8aac-4af5f5930ab2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '41ba5328-8dc5-4a66-a20d-744b82293eda'}}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:43:58.834935 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:58.909390 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] For port b126fb86-7a22-4555-be88-659629a3dd6c, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108544) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:43:58.915236 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] For port b126fb86-7a22-4555-be88-659629a3dd6c, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=b126fb86-7a22-4555-be88-659629a3dd6c,segment=NetworkSegment(914624d2-b577-476c-8aac-4af5f5930ab2),segment_id=914624d2-b577-476c-8aac-4af5f5930ab2)] {{(pid=108544) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:43:59.005604 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:43:59.079415 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ecd827ca-1864-49d1-aac0-0cc19092771e None None] Pushing event updated for resources: {'Port': ['ID=b126fb86-7a22-4555-be88-659629a3dd6c,revision_number=2']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:43:59.937821 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-cf84b536-6c0f-43ed-bbaf-eb47bc5e67b4 None None] Network 41ba5328-8dc5-4a66-a20d-744b82293eda requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:44:00.007533 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-0b13ae40-6f21-408f-b978-c609182048df None None] Provisioning complete for port b126fb86-7a22-4555-be88-659629a3dd6c triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:44:00.007872 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0b13ae40-6f21-408f-b978-c609182048df None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:44:00.157021 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0b13ae40-6f21-408f-b978-c609182048df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:44:00.201694 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-0b13ae40-6f21-408f-b978-c609182048df None None] For port b126fb86-7a22-4555-be88-659629a3dd6c, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=b126fb86-7a22-4555-be88-659629a3dd6c,segment=NetworkSegment(914624d2-b577-476c-8aac-4af5f5930ab2),segment_id=914624d2-b577-476c-8aac-4af5f5930ab2)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:44:00.276294 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0b13ae40-6f21-408f-b978-c609182048df None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:44:00.339688 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b13ae40-6f21-408f-b978-c609182048df None None] Pushing event updated for resources: {'Port': ['ID=b126fb86-7a22-4555-be88-659629a3dd6c,revision_number=3']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:44:00.396346 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-d195d23a-fb44-472d-abed-c1390bb69a0b None None] Provisioning complete for port b126fb86-7a22-4555-be88-659629a3dd6c triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:44:00.396706 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-d195d23a-fb44-472d-abed-c1390bb69a0b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:44:00.664696 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device b126fb86-7a22-4555-be88-659629a3dd6c up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:44:00.734130 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port b126fb86-7a22-4555-be88-659629a3dd6c triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:44:00.734457 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:44:00.802161 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:44:23.471497 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-cc9a3592-e10f-4371-8c58-2f8b8fa18dde None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:44:25.631389 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-f3035f0b-3ccf-4a9c-9ea8-1b665f95d1ed None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:44:26.461562 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 5 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:44:26.780209 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:44:28.247946 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:44:30.790863 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:44:53.588290 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-aa892bca-ce6e-424e-8fea-bbce027be48e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:44:55.635941 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-3456464e-36cf-4cf4-ba32-0fae8dce600b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:44:56.801699 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:44:58.303994 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:45:00.810835 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:45:03.460586 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 5 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:45:22.511292 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 53626) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:45:22.517348 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [None req-9e71cb08-7789-4044-a2fd-5bc93fb90506 tempest-verify_tempest_config-900863301 tempest-verify_tempest_config-900863301-project] http://10.222.0.98:9696/v2.0/extensions returned with HTTP 200 {{(pid=108543) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 02 12:45:22.518362 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-9e71cb08-7789-4044-a2fd-5bc93fb90506 tempest-verify_tempest_config-900863301 tempest-verify_tempest_config-900863301-project] 10.222.0.98 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13864 time: 0.0059927 Nov 02 12:45:23.239738 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 53644) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:45:23.359617 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-48011aaf-9cdf-4e56-ae05-abbe591bfd35 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:45:23.436243 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-48011aaf-9cdf-4e56-ae05-abbe591bfd35 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:45:23.515044 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c660f8b2-34b7-4da2-b400-e44e74e19a92 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:45:23.548834 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-48011aaf-9cdf-4e56-ae05-abbe591bfd35 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:45:23.595390 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-48011aaf-9cdf-4e56-ae05-abbe591bfd35 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=e9b888235509430c9c2fce48a8a23e0d&name=default HTTP/1.1" status: 200 len: 2992 time: 0.3544450 Nov 02 12:45:23.596114 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48011aaf-9cdf-4e56-ae05-abbe591bfd35 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5ad27638-44cb-4aaa-975f-1a9a88b60d49,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:45:23.598184 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 53650) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:45:23.603180 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48011aaf-9cdf-4e56-ae05-abbe591bfd35 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:45:23.603549 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48011aaf-9cdf-4e56-ae05-abbe591bfd35 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:45:23.603893 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48011aaf-9cdf-4e56-ae05-abbe591bfd35 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:45:23.604236 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48011aaf-9cdf-4e56-ae05-abbe591bfd35 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:45:23.604688 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48011aaf-9cdf-4e56-ae05-abbe591bfd35 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:45:23.605021 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48011aaf-9cdf-4e56-ae05-abbe591bfd35 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:45:23.605297 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48011aaf-9cdf-4e56-ae05-abbe591bfd35 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:45:23.606121 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48011aaf-9cdf-4e56-ae05-abbe591bfd35 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:45:23.606495 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48011aaf-9cdf-4e56-ae05-abbe591bfd35 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:45:23.606818 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48011aaf-9cdf-4e56-ae05-abbe591bfd35 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:45:23.607133 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48011aaf-9cdf-4e56-ae05-abbe591bfd35 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:45:23.607481 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-48011aaf-9cdf-4e56-ae05-abbe591bfd35 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:45:23.683045 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-e8b3ac44-4fad-4000-b99d-225f5e22c7d8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:45:23.704339 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-e8b3ac44-4fad-4000-b99d-225f5e22c7d8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:45:23.892229 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-e8b3ac44-4fad-4000-b99d-225f5e22c7d8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:45:23.894854 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-e8b3ac44-4fad-4000-b99d-225f5e22c7d8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:45:23.897010 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-e8b3ac44-4fad-4000-b99d-225f5e22c7d8 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/5ad27638-44cb-4aaa-975f-1a9a88b60d49 HTTP/1.1" status: 204 len: 168 time: 0.2964306 Nov 02 12:45:23.905766 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8b3ac44-4fad-4000-b99d-225f5e22c7d8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5ad27638-44cb-4aaa-975f-1a9a88b60d49,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:45:23.913313 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8b3ac44-4fad-4000-b99d-225f5e22c7d8 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:45:23.913654 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8b3ac44-4fad-4000-b99d-225f5e22c7d8 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:45:23.913989 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8b3ac44-4fad-4000-b99d-225f5e22c7d8 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:45:23.914353 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8b3ac44-4fad-4000-b99d-225f5e22c7d8 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:45:23.915031 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8b3ac44-4fad-4000-b99d-225f5e22c7d8 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:45:23.915376 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8b3ac44-4fad-4000-b99d-225f5e22c7d8 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:45:23.915706 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8b3ac44-4fad-4000-b99d-225f5e22c7d8 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:45:23.916042 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8b3ac44-4fad-4000-b99d-225f5e22c7d8 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:45:23.916388 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8b3ac44-4fad-4000-b99d-225f5e22c7d8 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:45:23.916711 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8b3ac44-4fad-4000-b99d-225f5e22c7d8 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:45:23.917026 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8b3ac44-4fad-4000-b99d-225f5e22c7d8 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:45:23.917340 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-e8b3ac44-4fad-4000-b99d-225f5e22c7d8 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:45:25.645832 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-b47ce53f-54be-40a4-8682-9265452b8a6b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:45:26.874599 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:45:28.263326 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:45:30.811785 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:45:40.459080 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 5 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:45:53.479147 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-979649af-29d4-4ccd-ae1f-61f132458f71 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:45:55.622304 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-95ce402f-ce83-4348-93c5-a5239a8dc1ee None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:45:56.799154 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:45:58.301810 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:46:00.787764 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:46:17.458007 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 5 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:46:23.501012 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-d233e114-945d-41ca-a4a2-63b586405133 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:46:25.660737 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-bbd4dc8b-269e-4069-88ac-70ffab7ca0a5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:46:26.819312 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:46:28.323855 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:46:30.836189 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:46:53.476632 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-d76f60be-4af1-43a2-a7bc-9af2baf34a33 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:46:54.460596 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 5 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:46:55.614193 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-e65c79f9-5b2a-41eb-89f9-c60175f0646d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:46:56.853965 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:46:58.280994 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:47:00.797785 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:47:03.151065 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.create_fip_agent_gw_ports-1591445'] for agent, after_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:47:19.642912 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 53724) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:47:19.748566 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-908588fc-c123-4c2e-97e9-86889e83f12b admin admin] 10.222.0.98 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.1045470 Nov 02 12:47:22.139311 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 53734) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:47:22.210690 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-dc72d5b4-4beb-4b19-b227-5fee4f42513d admin admin] 10.222.0.98 "GET /v2.0/agents HTTP/1.1" status: 200 len: 4553 time: 0.0701365 Nov 02 12:47:23.470029 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-91e93411-495a-4c68-ba97-4669ab8b5700 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:47:25.687113 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-f9000260-9dbe-4ea9-8d9d-065138659048 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:47:26.807276 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:47:28.287363 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:47:30.816805 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:47:31.460533 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:47:33.110064 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:47:53.492134 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-f17dc208-8327-4cce-8d8a-9ecba416cedb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:47:55.635161 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-21e12e11-54d6-427a-95e7-8b7675fb4ae8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:47:56.806258 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:47:58.309040 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:48:00.794748 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:48:03.108649 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:48:08.462303 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:48:23.537046 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-b0c2528b-104f-4509-892c-5cfefd50aef5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:48:25.645599 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-2ba60ec3-7616-434d-bc42-8307a69bbf3b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:48:26.833800 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:48:28.358496 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:48:30.862677 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:48:33.102609 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:48:45.461310 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:48:53.496051 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-672e8f11-885b-496d-97ec-82604ef4f69f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:48:55.678823 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-8703669d-c4e8-4a4d-8a0f-a435be6d1c8d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:48:56.816074 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:48:58.335878 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:00.821333 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:03.141242 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:07.013322 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 53976) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:07.054339 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 53984) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:07.122159 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 53992) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:07.408025 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Request body: {'network': {'name': 'tempest-DeleteServersTestJSON-1100241585-network', 'tenant_id': 'ae50c135750c4418b0b05f5bf2979217'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:49:07.410071 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Request body: {'network': {'name': 'tempest-ServerRescueNegativeTestJSON-2129619320-network', 'tenant_id': '28a90b1659054909ab64ba5320160f74'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:49:07.462780 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.db.api [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Retry wrapper got retriable exception: (pymysql.err.OperationalError) (1213, 'Deadlock found when trying to get lock; try restarting transaction') Nov 02 12:49:07.462780 dv-cinder-816324-1-iscsi neutron-server[108543]: [SQL: INSERT INTO reservations (project_id, id, expiration) VALUES (%(project_id)s, %(id)s, %(expiration)s)] Nov 02 12:49:07.462780 dv-cinder-816324-1-iscsi neutron-server[108543]: [parameters: {'project_id': 'ae50c135750c4418b0b05f5bf2979217', 'id': 'a6ad5d34-4141-4f99-a7cc-c599b9a84b3a', 'expiration': datetime.datetime(2021, 11, 2, 12, 51, 7, 443700)}] Nov 02 12:49:07.462780 dv-cinder-816324-1-iscsi neutron-server[108543]: (Background on this error at: https://sqlalche.me/e/14/e3q8) {{(pid=108543) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 02 12:49:07.465705 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG oslo_db.api [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Performing DB retry for function neutron.db.quota.driver_nolock.DbQuotaNoLockDriver.make_reservation {{(pid=108543) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 02 12:49:07.479937 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-fb146cd8-9d53-4465-ae27-49cef84a4daf admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeShelveTestJSON-199949485-network', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:49:07.562986 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Made reservation on behalf of 28a90b1659054909ab64ba5320160f74 for: {'network': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:49:07.565431 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for network, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:07.584184 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:07.687980 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-fb146cd8-9d53-4465-ae27-49cef84a4daf admin admin] Made reservation on behalf of aaddc046689441b8ab3641f2afd07c0e for: {'network': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:49:07.692005 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-fb146cd8-9d53-4465-ae27-49cef84a4daf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for network, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:07.704432 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:07.717937 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-fb146cd8-9d53-4465-ae27-49cef84a4daf admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:07.794127 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:07.855463 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 884} {{(pid=108542) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 02 12:49:07.884661 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=19d9438a-e04a-457d-9eb4-d4547a94b10f,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:07.895258 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-fb146cd8-9d53-4465-ae27-49cef84a4daf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:07.902587 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:07.902947 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:07.903624 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:07.904938 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:07.905362 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:07.905779 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:07.906223 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:07.906536 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:07.906872 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:07.907197 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:07.907520 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:07.908186 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Tracked resource versions report: Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: pushed versions: Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: { 'AddressGroup': {'1.2'}, Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: 'ConntrackHelper': {'1.0'}, Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: 'Log': {'1.0'}, Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: 'Network': {'1.1'}, Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: 'Port': {'1.7'}, Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: 'PortForwarding': {'1.2'}, Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: 'QosPolicy': {'1.10'}, Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: 'SecurityGroup': {'1.5'}, Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: 'SecurityGroupRule': {'1.2'}, Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: 'SubPort': {'1.0'}, Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: 'Subnet': {'1.1'}, Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: 'Trunk': {'1.1'}} Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: consumer versions: Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: { DHCP agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: HyperV agent@hv-cinder-81632: {}, Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: L3 agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: Metadata agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: Metering agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: Open vSwitch agent@dv-cinder-816324-1-iscsi: { 'AddressGroup': '1.2', Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: 'ConntrackHelper': '1.0', Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: 'Log': '1.0', Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: 'Network': '1.1', Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: 'Port': '1.7', Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: 'PortForwarding': '1.2', Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: 'QosPolicy': '1.10', Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: 'SecurityGroup': '1.5', Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: 'SecurityGroupRule': '1.2', Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: 'SubPort': '1.0', Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: 'Subnet': '1.1', Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: 'Trunk': '1.1'}} Nov 02 12:49:07.909530 dv-cinder-816324-1-iscsi neutron-server[108542]: {{(pid=108542) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 02 12:49:07.918310 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:07.918310 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.db.segments_db [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Added segment db93b928-f362-4483-9a9d-ce7880e2d162 of type vlan for network c965eaf1-5fb6-4689-8b12-fa3913e4f081 Nov 02 12:49:07.965637 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738449409639'] for network, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:08.014478 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-fb146cd8-9d53-4465-ae27-49cef84a4daf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:08.048076 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb146cd8-9d53-4465-ae27-49cef84a4daf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bad40fce-afd8-4ab0-8623-494bc1eab9e0,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:08.054414 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-fb146cd8-9d53-4465-ae27-49cef84a4daf admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 854} {{(pid=108542) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 02 12:49:08.068511 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-fb146cd8-9d53-4465-ae27-49cef84a4daf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:08.069074 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.db.segments_db [None req-fb146cd8-9d53-4465-ae27-49cef84a4daf admin admin] Added segment b2bc3e69-86f7-4524-92d5-933aa81f8f2f of type vlan for network c468f0e1-3636-49b9-90c6-b90c643ed7d1 Nov 02 12:49:08.116443 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Made reservation on behalf of ae50c135750c4418b0b05f5bf2979217 for: {'network': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:49:08.116443 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for network, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:08.145756 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:08.157899 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for network, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:08.162060 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:08.174522 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:08.425854 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:08.432840 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-fb146cd8-9d53-4465-ae27-49cef84a4daf admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738449409639'] for network, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:08.447000 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54030) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:08.451548 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] 10.222.0.98 "POST /v2.0/networks HTTP/1.1" status: 201 len: 892 time: 1.4345598 Nov 02 12:49:08.453560 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-d412928c-8061-4ea0-a2a0-838148e7d4e3 admin admin] Request body: {'subnet': {'network_id': 'c965eaf1-5fb6-4689-8b12-fa3913e4f081', 'cidr': '172.20.0.0/28', 'name': 'tempest-ServerRescueNegativeTestJSON-2129619320-subnet', 'tenant_id': '28a90b1659054909ab64ba5320160f74', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:49:08.476812 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-950c4a09-1eb7-4025-b834-a8d998eb3502 admin admin] Pushing event updated for resources: {'Network': ['ID=c965eaf1-5fb6-4689-8b12-fa3913e4f081,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:08.495189 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Network c965eaf1-5fb6-4689-8b12-fa3913e4f081 details requested by agent ovs-agent-dv-cinder-816324-1-iscsi with host dv-cinder-816324-1-iscsi {{(pid=108544) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 02 12:49:08.519862 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:08.550699 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 894} {{(pid=108543) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 02 12:49:08.585901 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-fb146cd8-9d53-4465-ae27-49cef84a4daf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for network, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:08.589331 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-fb146cd8-9d53-4465-ae27-49cef84a4daf admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:08.590688 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-fb146cd8-9d53-4465-ae27-49cef84a4daf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:08.618833 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f69cb03a-7a4d-435f-9600-1ab96756bd18,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:08.640389 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:08.640780 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:08.641664 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:08.641664 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:08.641911 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:08.642160 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:08.654706 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:08.655222 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:08.655626 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:08.656008 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:08.656347 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:08.656681 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Tracked resource versions report: Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: pushed versions: Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: { 'AddressGroup': {'1.2'}, Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: 'ConntrackHelper': {'1.0'}, Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: 'Log': {'1.0'}, Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: 'Network': {'1.1'}, Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: 'Port': {'1.7'}, Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: 'PortForwarding': {'1.2'}, Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: 'QosPolicy': {'1.10'}, Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: 'SecurityGroup': {'1.5'}, Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: 'SecurityGroupRule': {'1.2'}, Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: 'SubPort': {'1.0'}, Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: 'Subnet': {'1.1'}, Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: 'Trunk': {'1.1'}} Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: consumer versions: Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: { DHCP agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: HyperV agent@hv-cinder-81632: {}, Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: L3 agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: Metadata agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: Metering agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: Open vSwitch agent@dv-cinder-816324-1-iscsi: { 'AddressGroup': '1.2', Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: 'ConntrackHelper': '1.0', Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: 'Log': '1.0', Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: 'Network': '1.1', Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: 'Port': '1.7', Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: 'PortForwarding': '1.2', Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: 'QosPolicy': '1.10', Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: 'SecurityGroup': '1.5', Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: 'SecurityGroupRule': '1.2', Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: 'SubPort': '1.0', Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: 'Subnet': '1.1', Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: 'Trunk': '1.1'}} Nov 02 12:49:08.658199 dv-cinder-816324-1-iscsi neutron-server[108543]: {{(pid=108543) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 02 12:49:08.665771 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d412928c-8061-4ea0-a2a0-838148e7d4e3 admin admin] Made reservation on behalf of 28a90b1659054909ab64ba5320160f74 for: {'subnet': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:49:08.671956 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d412928c-8061-4ea0-a2a0-838148e7d4e3 admin admin] Publish callbacks [] for subnet, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:08.766645 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:08.767027 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.db.segments_db [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Added segment 5e5859da-3633-448b-b117-00d1ace2041b of type vlan for network 73093621-5f08-4d97-a54e-da0042e8dde7 Nov 02 12:49:08.792433 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-fb146cd8-9d53-4465-ae27-49cef84a4daf admin admin] 10.222.0.98 "POST /v2.0/networks HTTP/1.1" status: 201 len: 889 time: 1.6681995 Nov 02 12:49:08.793114 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 54040) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:08.803630 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-eb1c9321-f809-4ff6-8a0c-ea37fbbb17f2 admin admin] Request body: {'subnet': {'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeShelveTestJSON-199949485-subnet', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:49:08.814493 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb146cd8-9d53-4465-ae27-49cef84a4daf admin admin] Pushing event updated for resources: {'Network': ['ID=c468f0e1-3636-49b9-90c6-b90c643ed7d1,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:08.828265 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738449409639'] for network, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:08.836795 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Network c468f0e1-3636-49b9-90c6-b90c643ed7d1 details requested by agent ovs-agent-dv-cinder-816324-1-iscsi with host dv-cinder-816324-1-iscsi {{(pid=108544) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 02 12:49:08.923542 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-eb1c9321-f809-4ff6-8a0c-ea37fbbb17f2 admin admin] Made reservation on behalf of aaddc046689441b8ab3641f2afd07c0e for: {'subnet': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:49:08.925925 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-eb1c9321-f809-4ff6-8a0c-ea37fbbb17f2 admin admin] Publish callbacks [] for subnet, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:08.967226 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for network, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:08.968559 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:08.969339 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:09.048876 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] Pushing event updated for resources: {'Network': ['ID=73093621-5f08-4d97-a54e-da0042e8dde7,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:09.063322 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Network 73093621-5f08-4d97-a54e-da0042e8dde7 details requested by agent ovs-agent-dv-cinder-816324-1-iscsi with host dv-cinder-816324-1-iscsi {{(pid=108544) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 02 12:49:09.118033 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d412928c-8061-4ea0-a2a0-838148e7d4e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for subnet, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:09.185516 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-ed8a1ce7-0118-4fe2-b7d1-b30b890f75b1 admin admin] 10.222.0.98 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 2.1291654 Nov 02 12:49:09.190686 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54054) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:09.198916 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-01c9e2ed-e2c6-4f73-ace6-fa85ad029f40 admin admin] Request body: {'subnet': {'network_id': '73093621-5f08-4d97-a54e-da0042e8dde7', 'cidr': '172.20.0.0/28', 'name': 'tempest-DeleteServersTestJSON-1100241585-subnet', 'tenant_id': 'ae50c135750c4418b0b05f5bf2979217', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:49:09.243730 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d412928c-8061-4ea0-a2a0-838148e7d4e3 admin admin] Pushing event updated for resources: {'Subnet': ['ID=b29075d9-9995-4f6f-8ebd-8f7d748977ef,revision_number=0']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:09.255005 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d412928c-8061-4ea0-a2a0-838148e7d4e3 admin admin] Checking segment: {'id': 'db93b928-f362-4483-9a9d-ce7880e2d162', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': 'c965eaf1-5fb6-4689-8b12-fa3913e4f081'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108543) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:49:09.255634 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d412928c-8061-4ea0-a2a0-838148e7d4e3 admin admin] Network hostable DHCP agents. Network: c965eaf1-5fb6-4689-8b12-fa3913e4f081, hostable agents: ['1b947f40-f8bf-4088-a5dc-35ee29d90d78'], hosted agents: [] {{(pid=108543) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 02 12:49:09.356427 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-01c9e2ed-e2c6-4f73-ace6-fa85ad029f40 admin admin] Made reservation on behalf of ae50c135750c4418b0b05f5bf2979217 for: {'subnet': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:49:09.358879 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-01c9e2ed-e2c6-4f73-ace6-fa85ad029f40 admin admin] Publish callbacks [] for subnet, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:09.361054 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d412928c-8061-4ea0-a2a0-838148e7d4e3 admin admin] Network c965eaf1-5fb6-4689-8b12-fa3913e4f081 is scheduled to be hosted by DHCP agent 1b947f40-f8bf-4088-a5dc-35ee29d90d78 with binding_index 1 {{(pid=108543) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 02 12:49:09.402997 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-eb1c9321-f809-4ff6-8a0c-ea37fbbb17f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for subnet, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:09.471435 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [None req-d412928c-8061-4ea0-a2a0-838148e7d4e3 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816324-1-iscsi, c965eaf1-5fb6-4689-8b12-fa3913e4f081) {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:49:09.484680 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4cfd58ef-e430-4276-a860-85642ec6f41f None None] Network c965eaf1-5fb6-4689-8b12-fa3913e4f081 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:49:09.512180 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d412928c-8061-4ea0-a2a0-838148e7d4e3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:09.513263 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d412928c-8061-4ea0-a2a0-838148e7d4e3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for subnet, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:09.518584 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb1c9321-f809-4ff6-8a0c-ea37fbbb17f2 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ec48fe57-a1cd-4e7c-874f-073624f71f4b,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:09.539999 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-eb1c9321-f809-4ff6-8a0c-ea37fbbb17f2 admin admin] Checking segment: {'id': 'b2bc3e69-86f7-4524-92d5-933aa81f8f2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108542) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:49:09.541910 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb1c9321-f809-4ff6-8a0c-ea37fbbb17f2 admin admin] Network hostable DHCP agents. Network: c468f0e1-3636-49b9-90c6-b90c643ed7d1, hostable agents: ['1b947f40-f8bf-4088-a5dc-35ee29d90d78'], hosted agents: [] {{(pid=108542) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 02 12:49:09.635091 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb1c9321-f809-4ff6-8a0c-ea37fbbb17f2 admin admin] Network c468f0e1-3636-49b9-90c6-b90c643ed7d1 is scheduled to be hosted by DHCP agent 1b947f40-f8bf-4088-a5dc-35ee29d90d78 with binding_index 1 {{(pid=108542) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 02 12:49:09.648032 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-eb1c9321-f809-4ff6-8a0c-ea37fbbb17f2 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816324-1-iscsi, c468f0e1-3636-49b9-90c6-b90c643ed7d1) {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:49:09.659542 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-eb1c9321-f809-4ff6-8a0c-ea37fbbb17f2 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:09.660165 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-eb1c9321-f809-4ff6-8a0c-ea37fbbb17f2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for subnet, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:09.678825 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-558d2426-3759-4055-83c2-039bb9401d78 None None] Network c468f0e1-3636-49b9-90c6-b90c643ed7d1 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:49:09.686227 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-d412928c-8061-4ea0-a2a0-838148e7d4e3 admin admin] 10.222.0.98 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 856 time: 1.2369683 Nov 02 12:49:09.690434 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 54068) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:09.695504 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-aa9a47a5-6eff-41e0-949e-92362ad3a304 admin admin] Request body: {'router': {'name': 'tempest-ServerRescueNegativeTestJSON-2129619320-router', 'tenant_id': '28a90b1659054909ab64ba5320160f74', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:49:09.786077 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-eb1c9321-f809-4ff6-8a0c-ea37fbbb17f2 admin admin] 10.222.0.98 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 0.9880493 Nov 02 12:49:09.793758 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 54072) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:09.842632 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-c9a5d0ab-16b3-41ee-a851-bc89b7aa133c admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeShelveTestJSON-199949485-router', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:49:09.911525 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-01c9e2ed-e2c6-4f73-ace6-fa85ad029f40 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for subnet, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:09.995460 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-aa9a47a5-6eff-41e0-949e-92362ad3a304 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1593342', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-25677'] for router, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:10.001329 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-aa9a47a5-6eff-41e0-949e-92362ad3a304 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1593154', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1595081', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1973616', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-25716'] for router, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:10.055186 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-01c9e2ed-e2c6-4f73-ace6-fa85ad029f40 admin admin] Pushing event updated for resources: {'Subnet': ['ID=4d3908d6-4378-401d-b0c3-b220a11a4a6a,revision_number=0']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:10.057935 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6f769cd-c0c1-43d7-976e-01bdb01e8bd7 None None] Network c965eaf1-5fb6-4689-8b12-fa3913e4f081 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:49:10.097253 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-01c9e2ed-e2c6-4f73-ace6-fa85ad029f40 admin admin] Checking segment: {'id': '5e5859da-3633-448b-b117-00d1ace2041b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': '73093621-5f08-4d97-a54e-da0042e8dde7'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108543) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:49:10.097826 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-01c9e2ed-e2c6-4f73-ace6-fa85ad029f40 admin admin] Network hostable DHCP agents. Network: 73093621-5f08-4d97-a54e-da0042e8dde7, hostable agents: ['1b947f40-f8bf-4088-a5dc-35ee29d90d78'], hosted agents: [] {{(pid=108543) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 02 12:49:10.220819 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-aa9a47a5-6eff-41e0-949e-92362ad3a304 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:10.249834 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-01c9e2ed-e2c6-4f73-ace6-fa85ad029f40 admin admin] Network 73093621-5f08-4d97-a54e-da0042e8dde7 is scheduled to be hosted by DHCP agent 1b947f40-f8bf-4088-a5dc-35ee29d90d78 with binding_index 1 {{(pid=108543) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 02 12:49:10.285074 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp94ac73f7-a43e-5b43-a0b7-503cbb5c76bd-c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'fixed_ips': [{'subnet_id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b'}]}} from dv-cinder-816324-1-iscsi. {{(pid=108544) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 02 12:49:10.287415 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:10.312671 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c9a5d0ab-16b3-41ee-a851-bc89b7aa133c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1593342', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-25677'] for router, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:10.314199 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c9a5d0ab-16b3-41ee-a851-bc89b7aa133c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1593154', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1595081', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1973616', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-25716'] for router, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:10.342577 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [None req-01c9e2ed-e2c6-4f73-ace6-fa85ad029f40 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816324-1-iscsi, 73093621-5f08-4d97-a54e-da0042e8dde7) {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:49:10.349404 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-01c9e2ed-e2c6-4f73-ace6-fa85ad029f40 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:10.350869 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-01c9e2ed-e2c6-4f73-ace6-fa85ad029f40 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for subnet, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:10.411578 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9db46378-4217-4f8b-96c3-a61cb9ca5357 None None] Network 73093621-5f08-4d97-a54e-da0042e8dde7 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:49:10.458001 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-01c9e2ed-e2c6-4f73-ace6-fa85ad029f40 admin admin] 10.222.0.98 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 1.2644384 Nov 02 12:49:10.557211 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c9a5d0ab-16b3-41ee-a851-bc89b7aa133c admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:10.693450 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.db_base_plugin_common [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Allocated IP 172.20.0.2 (c468f0e1-3636-49b9-90c6-b90c643ed7d1/ec48fe57-a1cd-4e7c-874f-073624f71f4b/a19591c0-ae4e-427d-a5ad-28a0c283eec4) {{(pid=108544) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:49:10.720100 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-aa9a47a5-6eff-41e0-949e-92362ad3a304 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:10.840406 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-fa8ac2be-4f66-4bfc-87d0-de6cb88b2470 None None] Network 73093621-5f08-4d97-a54e-da0042e8dde7 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:49:11.009878 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c9a5d0ab-16b3-41ee-a851-bc89b7aa133c admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:11.470765 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54156) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:11.475833 dv-cinder-816324-1-iscsi neutron-server[108543]: WARNING keystonemiddleware.auth_token [-] A valid token was submitted as a service token, but it was not a valid service token. This is incorrect but backwards compatible behaviour. This will be removed in future releases. Nov 02 12:49:11.494049 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 54158) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:11.605118 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Publish callbacks [] for port, precommit_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:11.688220 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669'] for port, after_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:11.697589 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-aa9a47a5-6eff-41e0-949e-92362ad3a304 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:11.741023 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-aa9a47a5-6eff-41e0-949e-92362ad3a304 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:11.839550 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Network c468f0e1-3636-49b9-90c6-b90c643ed7d1 is already hosted by enough agents. {{(pid=108544) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:49:11.887434 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.scheduler.base_scheduler [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Resources bound (agent type, host, resource id): {{(pid=108544) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:49:11.900048 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Pushing event updated for resources: {'Port': ['ID=a19591c0-ae4e-427d-a5ad-28a0c283eec4,revision_number=1']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:11.914742 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Received port after_create {{(pid=108544) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:49:11.961219 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:11.964345 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:11.965152 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:11.968664 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:11.969445 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:11.969980 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:11.971447 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:11.972239 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:11.975282 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:11.975282 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:11.975282 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:11.975282 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Tracked resource versions report: Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: pushed versions: Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: { 'AddressGroup': {'1.2'}, Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: 'ConntrackHelper': {'1.0'}, Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: 'Log': {'1.0'}, Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: 'Network': {'1.1'}, Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: 'Port': {'1.7'}, Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: 'PortForwarding': {'1.2'}, Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: 'QosPolicy': {'1.10'}, Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: 'SecurityGroup': {'1.5'}, Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: 'SecurityGroupRule': {'1.2'}, Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: 'SubPort': {'1.0'}, Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: 'Subnet': {'1.1'}, Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: 'Trunk': {'1.1'}} Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: consumer versions: Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: { DHCP agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: HyperV agent@hv-cinder-81632: {}, Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: L3 agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: Metadata agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: Metering agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: Open vSwitch agent@dv-cinder-816324-1-iscsi: { 'AddressGroup': '1.2', Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: 'ConntrackHelper': '1.0', Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: 'Log': '1.0', Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: 'Network': '1.1', Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: 'Port': '1.7', Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: 'PortForwarding': '1.2', Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: 'QosPolicy': '1.10', Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: 'SecurityGroup': '1.5', Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: 'SecurityGroupRule': '1.2', Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: 'SubPort': '1.0', Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: 'Subnet': '1.1', Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: 'Trunk': '1.1'}} Nov 02 12:49:11.978223 dv-cinder-816324-1-iscsi neutron-server[108544]: {{(pid=108544) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 02 12:49:12.059537 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-748702b9-968b-44b1-ba44-46b8682d04bc tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:12.062590 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-748702b9-968b-44b1-ba44-46b8682d04bc tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/networks?id=73093621-5f08-4d97-a54e-da0042e8dde7 HTTP/1.1" status: 200 len: 812 time: 0.5887303 Nov 02 12:49:12.072705 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Attempting to bind port a19591c0-ae4e-427d-a5ad-28a0c283eec4 on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:49:12.074080 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Attempting to bind port a19591c0-ae4e-427d-a5ad-28a0c283eec4 by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': 'b2bc3e69-86f7-4524-92d5-933aa81f8f2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1'}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:49:12.074755 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Attempting to bind port a19591c0-ae4e-427d-a5ad-28a0c283eec4 on network c468f0e1-3636-49b9-90c6-b90c643ed7d1 {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:49:12.084564 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 49, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:49:12.085242 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Checking segment: {'id': 'b2bc3e69-86f7-4524-92d5-933aa81f8f2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108544) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:49:12.085897 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:12.086657 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Bound using segment: {'id': 'b2bc3e69-86f7-4524-92d5-933aa81f8f2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1'} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:49:12.087994 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Bound port: a19591c0-ae4e-427d-a5ad-28a0c283eec4, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b2bc3e69-86f7-4524-92d5-933aa81f8f2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1'}}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:49:12.088643 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:12.090772 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-a3a31744-4787-4750-8d43-d699b143fda9 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/quotas/ae50c135750c4418b0b05f5bf2979217 HTTP/1.1" status: 200 len: 375 time: 0.0189908 Nov 02 12:49:12.131190 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b14cd1d7-b886-49e4-bbc6-a88dc759a569 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:12.177182 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c9a5d0ab-16b3-41ee-a851-bc89b7aa133c admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:12.206058 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-f27c577e-8de5-4c22-8274-02ab93ca598b tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?tenant_id=ae50c135750c4418b0b05f5bf2979217&fields=id HTTP/1.1" status: 200 len: 210 time: 0.1074331 Nov 02 12:49:12.224799 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] For port a19591c0-ae4e-427d-a5ad-28a0c283eec4, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108544) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:49:12.230648 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] For port a19591c0-ae4e-427d-a5ad-28a0c283eec4, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=a19591c0-ae4e-427d-a5ad-28a0c283eec4,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108544) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:49:12.247320 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c9a5d0ab-16b3-41ee-a851-bc89b7aa133c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:12.285672 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_common [None req-aa9a47a5-6eff-41e0-949e-92362ad3a304 admin admin] Allocated IP 172.27.0.115 (43464fa8-eb00-46fb-9ca0-be7342f9ddbf/44a807bc-f2b6-41f0-b765-e5d3393fe305/b4d5a738-c102-44ca-ae66-2d125f202102) {{(pid=108542) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:49:12.352213 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54180) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:12.370551 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:12.473841 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7788ebb9-49ef-4e31-9b12-b4b0e6eedbbe None None] Pushing event updated for resources: {'Port': ['ID=a19591c0-ae4e-427d-a5ad-28a0c283eec4,revision_number=2']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:12.635600 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b14cd1d7-b886-49e4-bbc6-a88dc759a569 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:12.657290 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-299fdf9d-0029-488c-ae08-8749e13c576f admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:12.718466 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-aa9a47a5-6eff-41e0-949e-92362ad3a304 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:12.798324 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 54190) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:12.835152 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-6b944a2d-9161-4884-97ab-ce08e17b590d service neutron] http://10.222.0.98:9696/v2.0/extensions returned with HTTP 200 {{(pid=108543) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 02 12:49:12.836941 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-6b944a2d-9161-4884-97ab-ce08e17b590d service neutron] 10.222.0.98 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13869 time: 0.3019154 Nov 02 12:49:12.968219 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-299fdf9d-0029-488c-ae08-8749e13c576f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:12.969347 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b14cd1d7-b886-49e4-bbc6-a88dc759a569 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:12.979507 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-aa9a47a5-6eff-41e0-949e-92362ad3a304 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669'] for port, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:13.006510 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-299fdf9d-0029-488c-ae08-8749e13c576f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:13.023616 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-b14cd1d7-b886-49e4-bbc6-a88dc759a569 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=1f70ebf7e5ea47269d1f97ff05f12630&name=default HTTP/1.1" status: 200 len: 2992 time: 1.5053756 Nov 02 12:49:13.024948 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 54204) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:13.039546 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b14cd1d7-b886-49e4-bbc6-a88dc759a569 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7dcb8972-57a0-49d8-ad7e-f92b350d53c2,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:13.051339 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-aa9a47a5-6eff-41e0-949e-92362ad3a304 admin admin] Network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:49:13.064025 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-aa9a47a5-6eff-41e0-949e-92362ad3a304 admin admin] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:49:13.084461 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [None req-aa9a47a5-6eff-41e0-949e-92362ad3a304 admin admin] Received port after_create {{(pid=108542) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:49:13.088576 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-46e55369-ae5c-4538-b577-94c06911cd76 service neutron] 10.222.0.98 "GET /v2.0/networks/73093621-5f08-4d97-a54e-da0042e8dde7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2427826 Nov 02 12:49:13.092074 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-ff03a7f4-eb52-4a6a-976a-e4d91de72ad0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:13.155335 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-299fdf9d-0029-488c-ae08-8749e13c576f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=639fe2ae-12fe-4251-b54e-476dbd260f63,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:13.163804 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-299fdf9d-0029-488c-ae08-8749e13c576f admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=5a9056ce145f4658b25723b37d3da535&name=default HTTP/1.1" status: 200 len: 2992 time: 0.8101707 Nov 02 12:49:13.178600 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54206) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:13.343938 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_common [None req-c9a5d0ab-16b3-41ee-a851-bc89b7aa133c admin admin] Allocated IP 172.27.0.207 (43464fa8-eb00-46fb-9ca0-be7342f9ddbf/44a807bc-f2b6-41f0-b765-e5d3393fe305/516275c5-8682-4dd0-8e44-89a67ec57721) {{(pid=108542) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:49:13.364943 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-cdba4d5d-d93c-435c-8625-f34c583183da admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:13.370255 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-8c61601b-831d-411b-8225-03146827c635 service neutron] 10.222.0.98 "GET /v2.0/networks/73093621-5f08-4d97-a54e-da0042e8dde7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2598188 Nov 02 12:49:13.407172 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa9a47a5-6eff-41e0-949e-92362ad3a304 admin admin] Pushing event updated for resources: {'Port': ['ID=b4d5a738-c102-44ca-ae66-2d125f202102,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:13.432920 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-cdba4d5d-d93c-435c-8625-f34c583183da admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:13.538877 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-af549751-ab00-437c-b887-d3b2c69c94de admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:13.616660 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-af549751-ab00-437c-b887-d3b2c69c94de admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:13.834912 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-ff03a7f4-eb52-4a6a-976a-e4d91de72ad0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:13.855531 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-cdba4d5d-d93c-435c-8625-f34c583183da admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:13.861345 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-cdba4d5d-d93c-435c-8625-f34c583183da admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:13.867168 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-cdba4d5d-d93c-435c-8625-f34c583183da admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/639fe2ae-12fe-4251-b54e-476dbd260f63 HTTP/1.1" status: 204 len: 168 time: 0.6834581 Nov 02 12:49:13.912437 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cdba4d5d-d93c-435c-8625-f34c583183da admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=639fe2ae-12fe-4251-b54e-476dbd260f63,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:14.006665 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54224) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:14.033606 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c9a5d0ab-16b3-41ee-a851-bc89b7aa133c admin admin] Publish callbacks [] for port, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:14.037170 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-ff03a7f4-eb52-4a6a-976a-e4d91de72ad0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:14.180286 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-273c40c1-7a83-48e9-8dd2-c3bece8fde72 None None] Network c468f0e1-3636-49b9-90c6-b90c643ed7d1 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:49:14.196391 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-73eab02f-7841-4aca-9f27-c72d5cdfe7c6 req-cd680a92-0115-47c2-964e-dea6a2eed23e tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 210 time: 0.1848135 Nov 02 12:49:14.266499 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ff03a7f4-eb52-4a6a-976a-e4d91de72ad0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cd7d2b6d-aa55-4106-991a-130b90a4ac5c,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:14.274521 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-ff03a7f4-eb52-4a6a-976a-e4d91de72ad0 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=edbfaee64df948c4ae98c38589922299&name=default HTTP/1.1" status: 200 len: 2992 time: 1.4744539 Nov 02 12:49:14.278676 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54238) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:14.284030 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-aa9a47a5-6eff-41e0-949e-92362ad3a304 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:14.299957 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-af549751-ab00-437c-b887-d3b2c69c94de admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:14.303742 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-af549751-ab00-437c-b887-d3b2c69c94de admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:14.305797 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-af549751-ab00-437c-b887-d3b2c69c94de admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/7dcb8972-57a0-49d8-ad7e-f92b350d53c2 HTTP/1.1" status: 204 len: 168 time: 1.2670112 Nov 02 12:49:14.406814 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-af549751-ab00-437c-b887-d3b2c69c94de admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7dcb8972-57a0-49d8-ad7e-f92b350d53c2,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:14.431042 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-39b28936-60a8-4bb6-8f46-938d8d8cd7f2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:14.504903 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-d9997780-5f6f-4273-bf40-e703d54e3061 None None] Provisioning complete for port a19591c0-ae4e-427d-a5ad-28a0c283eec4 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:49:14.505489 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-d9997780-5f6f-4273-bf40-e703d54e3061 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:14.518075 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-39b28936-60a8-4bb6-8f46-938d8d8cd7f2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:14.544259 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c9a5d0ab-16b3-41ee-a851-bc89b7aa133c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669'] for port, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:14.731737 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c9a5d0ab-16b3-41ee-a851-bc89b7aa133c admin admin] Network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:49:14.753188 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-c9a5d0ab-16b3-41ee-a851-bc89b7aa133c admin admin] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:49:14.755891 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9a5d0ab-16b3-41ee-a851-bc89b7aa133c admin admin] Received port after_create {{(pid=108542) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:49:14.804737 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-39b28936-60a8-4bb6-8f46-938d8d8cd7f2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:14.804737 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-39b28936-60a8-4bb6-8f46-938d8d8cd7f2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:14.806054 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-39b28936-60a8-4bb6-8f46-938d8d8cd7f2 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/cd7d2b6d-aa55-4106-991a-130b90a4ac5c HTTP/1.1" status: 204 len: 168 time: 0.5251822 Nov 02 12:49:14.835512 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9a5d0ab-16b3-41ee-a851-bc89b7aa133c admin admin] Pushing event updated for resources: {'Port': ['ID=516275c5-8682-4dd0-8e44-89a67ec57721,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:14.844721 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39b28936-60a8-4bb6-8f46-938d8d8cd7f2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cd7d2b6d-aa55-4106-991a-130b90a4ac5c,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:14.851751 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-d9997780-5f6f-4273-bf40-e703d54e3061 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:15.022337 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-d9997780-5f6f-4273-bf40-e703d54e3061 None None] For port a19591c0-ae4e-427d-a5ad-28a0c283eec4, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=a19591c0-ae4e-427d-a5ad-28a0c283eec4,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:49:15.146792 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-d9997780-5f6f-4273-bf40-e703d54e3061 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:15.288210 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device a19591c0-ae4e-427d-a5ad-28a0c283eec4 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:49:15.338997 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-aa9a47a5-6eff-41e0-949e-92362ad3a304 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1593163', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1595034'] for router, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:15.470325 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d1e39f04-d954-4400-b3ff-a1dab813a34c req-e555f68f-489f-48be-a014-cf95cc6c0eda tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 210 time: 0.1392391 Nov 02 12:49:15.546095 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9997780-5f6f-4273-bf40-e703d54e3061 None None] Pushing event updated for resources: {'Port': ['ID=a19591c0-ae4e-427d-a5ad-28a0c283eec4,revision_number=3']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:15.553277 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port a19591c0-ae4e-427d-a5ad-28a0c283eec4 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:49:15.554001 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:15.586576 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54272) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:15.635533 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c0a1cfca-293a-4b3f-bbf2-b8399d5367f3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:15.820767 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-17889862-85ac-4f85-b929-8f26d95fddc3 None None] Provisioning complete for port a19591c0-ae4e-427d-a5ad-28a0c283eec4 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:49:15.820767 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-17889862-85ac-4f85-b929-8f26d95fddc3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:15.840690 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c0a1cfca-293a-4b3f-bbf2-b8399d5367f3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:15.912689 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c0a1cfca-293a-4b3f-bbf2-b8399d5367f3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:15.998836 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-c0a1cfca-293a-4b3f-bbf2-b8399d5367f3 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=984a9c13fa134cff9d025028f8a1b74f&name=default HTTP/1.1" status: 200 len: 2992 time: 0.4101918 Nov 02 12:49:16.003621 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54286) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:16.008471 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0a1cfca-293a-4b3f-bbf2-b8399d5367f3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7e6ced75-cfb0-4642-b7db-5f2d2b561ef7,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:16.056815 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c9a5d0ab-16b3-41ee-a851-bc89b7aa133c admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:16.113144 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-58bcd0ed-f48f-4c5f-b5ae-28963a7aa17e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:16.166059 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-58bcd0ed-f48f-4c5f-b5ae-28963a7aa17e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:16.386709 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-58bcd0ed-f48f-4c5f-b5ae-28963a7aa17e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:16.393890 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-58bcd0ed-f48f-4c5f-b5ae-28963a7aa17e admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:16.396919 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-58bcd0ed-f48f-4c5f-b5ae-28963a7aa17e admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/7e6ced75-cfb0-4642-b7db-5f2d2b561ef7 HTTP/1.1" status: 204 len: 168 time: 0.3904748 Nov 02 12:49:16.409658 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aa9a47a5-6eff-41e0-949e-92362ad3a304 admin admin] Router 4b99bdb0-b8b9-4f04-8c39-efb93626ff5b is scheduled to L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc with binding_index 1 {{(pid=108542) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 02 12:49:16.417508 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58bcd0ed-f48f-4c5f-b5ae-28963a7aa17e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7e6ced75-cfb0-4642-b7db-5f2d2b561ef7,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:16.715148 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-db8b73a7-24d5-479d-8e2d-9ca909b43448 req-9eeda1c9-68a3-4533-9d40-f430e484fde1 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 210 time: 0.0777421 Nov 02 12:49:16.739876 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c9a5d0ab-16b3-41ee-a851-bc89b7aa133c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1593163', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1595034'] for router, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:16.888783 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54318) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:16.947399 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aa9a47a5-6eff-41e0-949e-92362ad3a304 admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108542) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:49:16.954338 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device a19591c0-ae4e-427d-a5ad-28a0c283eec4 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:49:16.961166 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7b30ef05-5598-4e32-828f-0f24b515a869 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:16.975094 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] Sync routers for ids ['4b99bdb0-b8b9-4f04-8c39-efb93626ff5b'] in dv-cinder-816324-1-iscsi {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:49:17.005976 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] Routers {'4b99bdb0-b8b9-4f04-8c39-efb93626ff5b'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:49:17.010674 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:48:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['4b99bdb0-b8b9-4f04-8c39-efb93626ff5b'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:49:17.067397 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-aa9a47a5-6eff-41e0-949e-92362ad3a304 admin admin] Publish callbacks [] for router, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:17.069537 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-aa9a47a5-6eff-41e0-949e-92362ad3a304 admin admin] 10.222.0.98 "POST /v2.0/routers HTTP/1.1" status: 201 len: 931 time: 7.3778014 Nov 02 12:49:17.082561 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 54322) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:17.200602 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port a19591c0-ae4e-427d-a5ad-28a0c283eec4 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:49:17.202262 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:17.217309 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7b30ef05-5598-4e32-828f-0f24b515a869 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:17.311431 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7b30ef05-5598-4e32-828f-0f24b515a869 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:17.455190 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c9a5d0ab-16b3-41ee-a851-bc89b7aa133c admin admin] Router 308142a4-46ba-42ef-a1f2-5df4b969cc8f is scheduled to L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc with binding_index 1 {{(pid=108542) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 02 12:49:17.548203 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-7b30ef05-5598-4e32-828f-0f24b515a869 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=3430f6b1550a4619884a42e50c2be76c&name=default HTTP/1.1" status: 200 len: 2992 time: 0.6574786 Nov 02 12:49:17.549947 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54336) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:17.581539 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] Set router 4b99bdb0-b8b9-4f04-8c39-efb93626ff5b gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:49:17.584425 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b30ef05-5598-4e32-828f-0f24b515a869 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1ed4d46d-f411-4bbf-94be-aea9bd7d4917,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:17.739202 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7a19ed5f-a7e8-4232-8b05-1b47a8209df1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:17.897775 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7a19ed5f-a7e8-4232-8b05-1b47a8209df1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:18.076782 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b99bdb0-b8b9-4f04-8c39-efb93626ff5b', 'name': 'tempest-ServerRescueNegativeTestJSON-2129619320-router', 'tenant_id': '28a90b1659054909ab64ba5320160f74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.115'}], 'enable_snat': True}, 'gw_port_id': 'b4d5a738-c102-44ca-ae66-2d125f202102', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:49:13Z', 'revision_number': 3, 'project_id': '28a90b1659054909ab64ba5320160f74', 'gw_port': {'id': 'b4d5a738-c102-44ca-ae66-2d125f202102', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:07:49', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b99bdb0-b8b9-4f04-8c39-efb93626ff5b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:11Z', 'updated_at': '2021-11-02T12:49:12Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:49:18.081608 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a98a607-de0a-4630-b47a-05563cae96b5 req-b188838e-9c00-47c5-a29f-76d16f77912b tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 210 time: 0.1011293 Nov 02 12:49:18.161900 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] Checking router: 4b99bdb0-b8b9-4f04-8c39-efb93626ff5b for host: dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:49:18.162917 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] Updating router 4b99bdb0-b8b9-4f04-8c39-efb93626ff5b port b4d5a738-c102-44ca-ae66-2d125f202102 binding host dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 02 12:49:18.210842 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7a19ed5f-a7e8-4232-8b05-1b47a8209df1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:18.213516 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:18.213917 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7a19ed5f-a7e8-4232-8b05-1b47a8209df1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:18.218922 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-7a19ed5f-a7e8-4232-8b05-1b47a8209df1 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/1ed4d46d-f411-4bbf-94be-aea9bd7d4917 HTTP/1.1" status: 204 len: 168 time: 0.6623650 Nov 02 12:49:18.231959 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a19ed5f-a7e8-4232-8b05-1b47a8209df1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1ed4d46d-f411-4bbf-94be-aea9bd7d4917,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:18.330524 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c9a5d0ab-16b3-41ee-a851-bc89b7aa133c admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108542) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:49:18.347794 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] Sync routers for ids ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'] in dv-cinder-816324-1-iscsi {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:49:18.377081 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] Routers {'308142a4-46ba-42ef-a1f2-5df4b969cc8f'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:49:18.378673 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:48:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:49:18.566817 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c9a5d0ab-16b3-41ee-a851-bc89b7aa133c admin admin] Publish callbacks [] for router, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:18.576833 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54360) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:18.577191 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-c9a5d0ab-16b3-41ee-a851-bc89b7aa133c admin admin] 10.222.0.98 "POST /v2.0/routers HTTP/1.1" status: 201 len: 928 time: 8.7533121 Nov 02 12:49:18.723276 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5f943461-a04e-404f-835b-4797dc0f2766 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:18.735042 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] Set router 308142a4-46ba-42ef-a1f2-5df4b969cc8f gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:49:18.899344 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] Publish callbacks [] for port, precommit_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:19.008787 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:19.170210 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] Attempting to bind port b4d5a738-c102-44ca-ae66-2d125f202102 on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:49:19.175795 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] Attempting to bind port b4d5a738-c102-44ca-ae66-2d125f202102 by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}] {{(pid=108545) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:49:19.175795 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] Attempting to bind port b4d5a738-c102-44ca-ae66-2d125f202102 on network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:49:19.198986 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 49, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:49:19.201565 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] Checking segment: {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108545) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:49:19.202024 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:19.202931 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] Bound using segment: {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'} {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:49:19.205123 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] Bound port: b4d5a738-c102-44ca-ae66-2d125f202102, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}}] {{(pid=108545) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:49:19.206674 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:19.249447 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'name': 'tempest-AttachVolumeShelveTestJSON-199949485-router', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207'}], 'enable_snat': True}, 'gw_port_id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:49:15Z', 'revision_number': 3, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'gw_port': {'id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:4a:bd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:12Z', 'updated_at': '2021-11-02T12:49:13Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:49:19.278407 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_common [None req-5f943461-a04e-404f-835b-4797dc0f2766 admin admin] Allocated IP 172.20.0.1 (c965eaf1-5fb6-4689-8b12-fa3913e4f081/b29075d9-9995-4f6f-8ebd-8f7d748977ef/490fac23-7b22-4b5a-965d-a1dc3250589d) {{(pid=108542) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:49:19.318618 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] Checking router: 308142a4-46ba-42ef-a1f2-5df4b969cc8f for host: dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:49:19.318960 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] Updating router 308142a4-46ba-42ef-a1f2-5df4b969cc8f port 516275c5-8682-4dd0-8e44-89a67ec57721 binding host dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 02 12:49:19.339381 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.db [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] For port b4d5a738-c102-44ca-ae66-2d125f202102, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108545) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:49:19.354480 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.db [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] For port b4d5a738-c102-44ca-ae66-2d125f202102, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=b4d5a738-c102-44ca-ae66-2d125f202102,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108545) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:49:19.356088 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d654a1e8-c4e2-44ec-b118-cac739f94d32 None None] Pushing event updated for resources: {'Port': ['ID=b4d5a738-c102-44ca-ae66-2d125f202102,revision_number=2']} {{(pid=108545) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:19.379849 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:19.397099 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d654a1e8-c4e2-44ec-b118-cac739f94d32 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:19.397510 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d654a1e8-c4e2-44ec-b118-cac739f94d32 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:19.398004 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d654a1e8-c4e2-44ec-b118-cac739f94d32 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:19.398488 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d654a1e8-c4e2-44ec-b118-cac739f94d32 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:19.398927 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d654a1e8-c4e2-44ec-b118-cac739f94d32 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:19.399489 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d654a1e8-c4e2-44ec-b118-cac739f94d32 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:19.400103 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d654a1e8-c4e2-44ec-b118-cac739f94d32 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:19.400684 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d654a1e8-c4e2-44ec-b118-cac739f94d32 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:19.401112 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d654a1e8-c4e2-44ec-b118-cac739f94d32 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:19.402001 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d654a1e8-c4e2-44ec-b118-cac739f94d32 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:19.402447 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d654a1e8-c4e2-44ec-b118-cac739f94d32 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:19.402895 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d654a1e8-c4e2-44ec-b118-cac739f94d32 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d654a1e8-c4e2-44ec-b118-cac739f94d32 None None] Tracked resource versions report: Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: pushed versions: Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: { 'AddressGroup': {'1.2'}, Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: 'ConntrackHelper': {'1.0'}, Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: 'Log': {'1.0'}, Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: 'Network': {'1.1'}, Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: 'Port': {'1.7'}, Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: 'PortForwarding': {'1.2'}, Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: 'QosPolicy': {'1.10'}, Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: 'SecurityGroup': {'1.5'}, Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: 'SecurityGroupRule': {'1.2'}, Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: 'SubPort': {'1.0'}, Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: 'Subnet': {'1.1'}, Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: 'Trunk': {'1.1'}} Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: consumer versions: Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: { DHCP agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: HyperV agent@hv-cinder-81632: {}, Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: L3 agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: Metadata agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: Metering agent@dv-cinder-816324-1-iscsi: {}, Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: Open vSwitch agent@dv-cinder-816324-1-iscsi: { 'AddressGroup': '1.2', Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: 'ConntrackHelper': '1.0', Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: 'Log': '1.0', Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: 'Network': '1.1', Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: 'Port': '1.7', Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: 'PortForwarding': '1.2', Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: 'QosPolicy': '1.10', Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: 'SecurityGroup': '1.5', Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: 'SecurityGroupRule': '1.2', Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: 'SubPort': '1.0', Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: 'Subnet': '1.1', Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: 'Trunk': '1.1'}} Nov 02 12:49:19.404997 dv-cinder-816324-1-iscsi neutron-server[108545]: {{(pid=108545) report /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:175}} Nov 02 12:49:19.430976 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:19.506640 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] Routers {'4b99bdb0-b8b9-4f04-8c39-efb93626ff5b'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:49:19.507310 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:48:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['4b99bdb0-b8b9-4f04-8c39-efb93626ff5b'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:49:19.557885 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ff565bc4-3f03-4532-a795-35bfb50d2bb8 req-9590c9e8-00fc-456b-a4e1-99b3c472a824 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 210 time: 0.0711231 Nov 02 12:49:19.561647 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5f943461-a04e-404f-835b-4797dc0f2766 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:19.691399 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d654a1e8-c4e2-44ec-b118-cac739f94d32 None None] Pushing event updated for resources: {'Port': ['ID=b4d5a738-c102-44ca-ae66-2d125f202102,revision_number=3']} {{(pid=108545) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:19.695627 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] Set router 4b99bdb0-b8b9-4f04-8c39-efb93626ff5b gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:49:19.719786 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5f943461-a04e-404f-835b-4797dc0f2766 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669'] for port, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:19.808101 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f943461-a04e-404f-835b-4797dc0f2766 admin admin] Network c965eaf1-5fb6-4689-8b12-fa3913e4f081 is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:49:19.813626 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-5f943461-a04e-404f-835b-4797dc0f2766 admin admin] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:49:19.823688 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [None req-5f943461-a04e-404f-835b-4797dc0f2766 admin admin] Received port after_create {{(pid=108542) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:49:19.826480 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5f943461-a04e-404f-835b-4797dc0f2766 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1590217'] for router_interface, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:19.964104 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] Publish callbacks [] for port, precommit_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:20.017369 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f943461-a04e-404f-835b-4797dc0f2766 admin admin] Pushing event updated for resources: {'Port': ['ID=490fac23-7b22-4b5a-965d-a1dc3250589d,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:20.049636 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c71c50a1-c733-4116-8b2d-00760d5ec3c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:20.054671 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b99bdb0-b8b9-4f04-8c39-efb93626ff5b', 'name': 'tempest-ServerRescueNegativeTestJSON-2129619320-router', 'tenant_id': '28a90b1659054909ab64ba5320160f74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.115'}], 'enable_snat': True}, 'gw_port_id': 'b4d5a738-c102-44ca-ae66-2d125f202102', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:49:13Z', 'revision_number': 3, 'project_id': '28a90b1659054909ab64ba5320160f74', 'gw_port': {'id': 'b4d5a738-c102-44ca-ae66-2d125f202102', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:07:49', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b99bdb0-b8b9-4f04-8c39-efb93626ff5b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:11Z', 'updated_at': '2021-11-02T12:49:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:49:20.056023 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:20.123620 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a54b763a-4a4b-4106-b1c5-dcf2b58f16c8 None None] The sync data for ids ['4b99bdb0-b8b9-4f04-8c39-efb93626ff5b'] in dv-cinder-816324-1-iscsi is: [{'id': '4b99bdb0-b8b9-4f04-8c39-efb93626ff5b', 'name': 'tempest-ServerRescueNegativeTestJSON-2129619320-router', 'tenant_id': '28a90b1659054909ab64ba5320160f74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.115'}], 'enable_snat': True}, 'gw_port_id': 'b4d5a738-c102-44ca-ae66-2d125f202102', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:49:13Z', 'revision_number': 3, 'project_id': '28a90b1659054909ab64ba5320160f74', 'gw_port': {'id': 'b4d5a738-c102-44ca-ae66-2d125f202102', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:07:49', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b99bdb0-b8b9-4f04-8c39-efb93626ff5b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:11Z', 'updated_at': '2021-11-02T12:49:19Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}] {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:49:20.205907 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] Attempting to bind port 516275c5-8682-4dd0-8e44-89a67ec57721 on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:49:20.206310 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] Attempting to bind port 516275c5-8682-4dd0-8e44-89a67ec57721 by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:49:20.207099 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] Attempting to bind port 516275c5-8682-4dd0-8e44-89a67ec57721 on network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:49:20.217537 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 49, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:49:20.217961 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] Checking segment: {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108544) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:49:20.218687 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:20.219076 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] Bound using segment: {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:49:20.220100 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] Bound port: 516275c5-8682-4dd0-8e44-89a67ec57721, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:49:20.220511 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:20.327539 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdef8c87-77f8-4e51-8577-4333953c584b None None] Pushing event updated for resources: {'Port': ['ID=516275c5-8682-4dd0-8e44-89a67ec57721,revision_number=2']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:20.330355 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5f943461-a04e-404f-835b-4797dc0f2766 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:20.347796 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 54414) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:20.402669 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] For port 516275c5-8682-4dd0-8e44-89a67ec57721, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108544) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:49:20.416197 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] For port 516275c5-8682-4dd0-8e44-89a67ec57721, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=516275c5-8682-4dd0-8e44-89a67ec57721,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108544) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:49:20.423169 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54418) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:20.519181 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:20.574241 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [None req-c71c50a1-c733-4116-8b2d-00760d5ec3c5 admin admin] Allocated IP 172.20.0.1 (c468f0e1-3636-49b9-90c6-b90c643ed7d1/ec48fe57-a1cd-4e7c-874f-073624f71f4b/91fe3ff8-cdf3-4761-8b27-27e55f6f6690) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:49:20.742029 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5f943461-a04e-404f-835b-4797dc0f2766 admin admin] Publish callbacks [] for port, precommit_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:20.804085 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] Routers {'308142a4-46ba-42ef-a1f2-5df4b969cc8f'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:49:20.805285 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:48:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:49:20.832067 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5f943461-a04e-404f-835b-4797dc0f2766 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:20.832833 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5f943461-a04e-404f-835b-4797dc0f2766 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1649136', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1590109'] for router_interface, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:20.968567 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5f943461-a04e-404f-835b-4797dc0f2766 admin admin] Pushing event updated for resources: {'Port': ['ID=490fac23-7b22-4b5a-965d-a1dc3250589d,revision_number=2']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:20.981570 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d8860ebd-00fa-481c-9028-3fbed236cb21 req-fc15cbd5-71d1-42a9-b651-0c902d26edd0 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 210 time: 0.1292443 Nov 02 12:49:21.083520 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-cad9dd4b-12a2-4e82-bca8-f5a6ea8962cd admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:21.100500 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-ea136084-2c13-4fa6-9af0-05ecd6f87338 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-1587286581-network', 'tenant_id': '35ca0fb82a8a492e99f76804c93d3218'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:49:21.180508 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5f943461-a04e-404f-835b-4797dc0f2766 admin admin] Network c965eaf1-5fb6-4689-8b12-fa3913e4f081 is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:49:21.183608 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-5f943461-a04e-404f-835b-4797dc0f2766 admin admin] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:49:21.256093 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c71c50a1-c733-4116-8b2d-00760d5ec3c5 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:21.284036 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] Set router 308142a4-46ba-42ef-a1f2-5df4b969cc8f gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:49:21.324414 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-ea136084-2c13-4fa6-9af0-05ecd6f87338 admin admin] Made reservation on behalf of 35ca0fb82a8a492e99f76804c93d3218 for: {'network': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:49:21.327873 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ea136084-2c13-4fa6-9af0-05ecd6f87338 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for network, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:21.340185 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ea136084-2c13-4fa6-9af0-05ecd6f87338 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:21.431230 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c71c50a1-c733-4116-8b2d-00760d5ec3c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:21.545220 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device b4d5a738-c102-44ca-ae66-2d125f202102 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:49:21.616199 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fdef8c87-77f8-4e51-8577-4333953c584b None None] Pushing event updated for resources: {'Port': ['ID=516275c5-8682-4dd0-8e44-89a67ec57721,revision_number=3']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:21.640222 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c71c50a1-c733-4116-8b2d-00760d5ec3c5 admin admin] Network c468f0e1-3636-49b9-90c6-b90c643ed7d1 is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:49:21.667453 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [None req-c71c50a1-c733-4116-8b2d-00760d5ec3c5 admin admin] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:49:21.693390 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c71c50a1-c733-4116-8b2d-00760d5ec3c5 admin admin] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:49:21.693984 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c71c50a1-c733-4116-8b2d-00760d5ec3c5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1590217'] for router_interface, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:21.925306 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port b4d5a738-c102-44ca-ae66-2d125f202102 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:49:21.925716 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:21.949983 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c71c50a1-c733-4116-8b2d-00760d5ec3c5 admin admin] Pushing event updated for resources: {'Port': ['ID=91fe3ff8-cdf3-4761-8b27-27e55f6f6690,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:21.971295 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-5f943461-a04e-404f-835b-4797dc0f2766 admin admin] Router 4b99bdb0-b8b9-4f04-8c39-efb93626ff5b has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108542) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 12:49:21.990003 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-cad9dd4b-12a2-4e82-bca8-f5a6ea8962cd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:22.086392 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'name': 'tempest-AttachVolumeShelveTestJSON-199949485-router', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207'}], 'enable_snat': True}, 'gw_port_id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:49:15Z', 'revision_number': 3, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'gw_port': {'id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:4a:bd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:12Z', 'updated_at': '2021-11-02T12:49:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:49:22.126168 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-cad9dd4b-12a2-4e82-bca8-f5a6ea8962cd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:22.174092 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-47a8a21e-3392-4df6-95f6-04783a92ea97 None None] The sync data for ids ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'] in dv-cinder-816324-1-iscsi is: [{'id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'name': 'tempest-AttachVolumeShelveTestJSON-199949485-router', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207'}], 'enable_snat': True}, 'gw_port_id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:49:15Z', 'revision_number': 3, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'gw_port': {'id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:4a:bd', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:12Z', 'updated_at': '2021-11-02T12:49:20Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}] {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:49:22.283790 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:22.322981 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] For port b4d5a738-c102-44ca-ae66-2d125f202102, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=b4d5a738-c102-44ca-ae66-2d125f202102,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:49:22.343565 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-f0bcab5f-c01f-4862-b4e6-70a14cd9a5b3 None None] Provisioning complete for port 91fe3ff8-cdf3-4761-8b27-27e55f6f6690 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:49:22.344087 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-f0bcab5f-c01f-4862-b4e6-70a14cd9a5b3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:22.359972 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-cad9dd4b-12a2-4e82-bca8-f5a6ea8962cd admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=33123de34f7d43858c2a11591344de98&name=default HTTP/1.1" status: 200 len: 2992 time: 2.0063128 Nov 02 12:49:22.359972 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cad9dd4b-12a2-4e82-bca8-f5a6ea8962cd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=deb59465-a191-4767-b7c4-1cdae6beeaf0,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:22.364455 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 54454) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:22.882088 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-f0bcab5f-c01f-4862-b4e6-70a14cd9a5b3 None None] Port 91fe3ff8-cdf3-4761-8b27-27e55f6f6690 cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:49:22.882088 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:22.891342 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-242ceff7-3132-404a-a1f9-57a5e03302ce admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:22.894430 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:49:22.902097 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-5f943461-a04e-404f-835b-4797dc0f2766 admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108542) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:49:22.902097 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-242ceff7-3132-404a-a1f9-57a5e03302ce admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:22.903967 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7d3f0ae5-0a52-4777-abe1-2e59344543b6 req-d1b13161-3ca5-4910-8d3f-7dfdc6bae0b5 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 210 time: 0.1619055 Nov 02 12:49:22.904674 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-5f943461-a04e-404f-835b-4797dc0f2766 admin admin] 10.222.0.98 "PUT /v2.0/routers/4b99bdb0-b8b9-4f04-8c39-efb93626ff5b/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.4130158 Nov 02 12:49:22.905150 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ea136084-2c13-4fa6-9af0-05ecd6f87338 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:22.905738 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Pushing event updated for resources: {'Port': ['ID=b4d5a738-c102-44ca-ae66-2d125f202102,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:22.906247 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ea136084-2c13-4fa6-9af0-05ecd6f87338 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:22.911468 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-242ceff7-3132-404a-a1f9-57a5e03302ce admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:22.911468 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-242ceff7-3132-404a-a1f9-57a5e03302ce admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:22.911468 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-242ceff7-3132-404a-a1f9-57a5e03302ce admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/deb59465-a191-4767-b7c4-1cdae6beeaf0 HTTP/1.1" status: 204 len: 168 time: 0.5421462 Nov 02 12:49:22.919850 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-242ceff7-3132-404a-a1f9-57a5e03302ce admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=deb59465-a191-4767-b7c4-1cdae6beeaf0,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:23.049234 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c71c50a1-c733-4116-8b2d-00760d5ec3c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:23.108262 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.90', 58447) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:23.233369 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 516275c5-8682-4dd0-8e44-89a67ec57721 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:49:23.247788 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-ea136084-2c13-4fa6-9af0-05ecd6f87338 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 885} {{(pid=108543) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 02 12:49:23.261415 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea136084-2c13-4fa6-9af0-05ecd6f87338 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5d20ac39-c08b-4dde-930f-1a52b0e4c1d0,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:23.280774 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ea136084-2c13-4fa6-9af0-05ecd6f87338 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:23.281660 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.db.segments_db [None req-ea136084-2c13-4fa6-9af0-05ecd6f87338 admin admin] Added segment 6bc6bc15-9107-4ef4-ad26-bc5190f505e3 of type vlan for network 5f91c4c2-564e-4b79-bf93-9e3787e39e15 Nov 02 12:49:23.343852 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-292bf870-9bde-4219-b242-762041ce983e None None] Sync routers for ids ['4b99bdb0-b8b9-4f04-8c39-efb93626ff5b'] in dv-cinder-816324-1-iscsi {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:49:23.384077 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 516275c5-8682-4dd0-8e44-89a67ec57721 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:49:23.384077 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:23.392430 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-292bf870-9bde-4219-b242-762041ce983e None None] Routers {'4b99bdb0-b8b9-4f04-8c39-efb93626ff5b'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:49:23.400745 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-292bf870-9bde-4219-b242-762041ce983e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:48:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['4b99bdb0-b8b9-4f04-8c39-efb93626ff5b'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:49:23.451843 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ea136084-2c13-4fa6-9af0-05ecd6f87338 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738449409639'] for network, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:23.524549 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c71c50a1-c733-4116-8b2d-00760d5ec3c5 admin admin] Publish callbacks [] for port, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:23.544563 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1a8bf4bc-1cd1-45d3-8775-d648ce32a127 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:23.577248 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:23.646024 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] For port 516275c5-8682-4dd0-8e44-89a67ec57721, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=516275c5-8682-4dd0-8e44-89a67ec57721,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:49:23.650050 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c71c50a1-c733-4116-8b2d-00760d5ec3c5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:23.650900 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c71c50a1-c733-4116-8b2d-00760d5ec3c5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1649136', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1590109'] for router_interface, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:23.652987 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ea136084-2c13-4fa6-9af0-05ecd6f87338 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for network, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:23.654157 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-ea136084-2c13-4fa6-9af0-05ecd6f87338 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:23.654806 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ea136084-2c13-4fa6-9af0-05ecd6f87338 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:23.830703 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:23.832866 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device b4d5a738-c102-44ca-ae66-2d125f202102 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:49:23.855412 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-292bf870-9bde-4219-b242-762041ce983e None None] Set router 4b99bdb0-b8b9-4f04-8c39-efb93626ff5b gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:49:23.892721 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ea136084-2c13-4fa6-9af0-05ecd6f87338 admin admin] Pushing event updated for resources: {'Network': ['ID=5f91c4c2-564e-4b79-bf93-9e3787e39e15,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:23.975756 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d40c5559-059a-4cbc-9062-cd638fc54020 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:23.978361 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d40c5559-059a-4cbc-9062-cd638fc54020 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.90 "GET /v2.0/networks?id=73093621-5f08-4d97-a54e-da0042e8dde7 HTTP/1.1" status: 200 len: 812 time: 0.8508561 Nov 02 12:49:24.017549 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Network 5f91c4c2-564e-4b79-bf93-9e3787e39e15 details requested by agent ovs-agent-dv-cinder-816324-1-iscsi with host dv-cinder-816324-1-iscsi {{(pid=108544) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 02 12:49:24.051282 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-5d69eaa0-9213-436a-af76-7d1236ae4f12 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Request body: {'port': {'device_id': 'b5f68f82-f48c-4ddc-9588-64082e35c753', 'network_id': '73093621-5f08-4d97-a54e-da0042e8dde7', 'admin_state_up': True, 'tenant_id': 'ae50c135750c4418b0b05f5bf2979217'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:49:24.077212 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-88432d3f-61f2-4d5f-b3fb-184141c0443f req-e08cd366-17ee-4958-9417-ab0fbe91ff43 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 210 time: 0.2343664 Nov 02 12:49:24.122091 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-ea136084-2c13-4fa6-9af0-05ecd6f87338 admin admin] 10.222.0.98 "POST /v2.0/networks HTTP/1.1" status: 201 len: 898 time: 3.6971900 Nov 02 12:49:24.132585 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54504) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:24.232895 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-2515399b-a813-4135-addf-94a2a67414a6 admin admin] Request body: {'subnet': {'network_id': '5f91c4c2-564e-4b79-bf93-9e3787e39e15', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-1587286581-subnet', 'tenant_id': '35ca0fb82a8a492e99f76804c93d3218', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:49:24.315193 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Pushing event updated for resources: {'Port': ['ID=516275c5-8682-4dd0-8e44-89a67ec57721,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:24.338745 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port b4d5a738-c102-44ca-ae66-2d125f202102 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:49:24.338745 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:24.426246 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c71c50a1-c733-4116-8b2d-00760d5ec3c5 admin admin] Pushing event updated for resources: {'Port': ['ID=91fe3ff8-cdf3-4761-8b27-27e55f6f6690,revision_number=2']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:24.462098 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c71c50a1-c733-4116-8b2d-00760d5ec3c5 admin admin] Network c468f0e1-3636-49b9-90c6-b90c643ed7d1 is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:49:24.475909 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [None req-c71c50a1-c733-4116-8b2d-00760d5ec3c5 admin admin] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:49:24.901397 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 516275c5-8682-4dd0-8e44-89a67ec57721 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:49:24.918275 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-292bf870-9bde-4219-b242-762041ce983e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b99bdb0-b8b9-4f04-8c39-efb93626ff5b', 'name': 'tempest-ServerRescueNegativeTestJSON-2129619320-router', 'tenant_id': '28a90b1659054909ab64ba5320160f74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.115'}], 'enable_snat': True}, 'gw_port_id': 'b4d5a738-c102-44ca-ae66-2d125f202102', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:49:20Z', 'revision_number': 4, 'project_id': '28a90b1659054909ab64ba5320160f74', 'gw_port': {'id': 'b4d5a738-c102-44ca-ae66-2d125f202102', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:07:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b99bdb0-b8b9-4f04-8c39-efb93626ff5b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:11Z', 'updated_at': '2021-11-02T12:49:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '490fac23-7b22-4b5a-965d-a1dc3250589d', 'name': '', 'network_id': 'c965eaf1-5fb6-4689-8b12-fa3913e4f081', 'tenant_id': '28a90b1659054909ab64ba5320160f74', 'mac_address': 'fa:16:3e:9b:09:75', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b99bdb0-b8b9-4f04-8c39-efb93626ff5b', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'b29075d9-9995-4f6f-8ebd-8f7d748977ef', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:18Z', 'updated_at': '2021-11-02T12:49:20Z', 'revision_number': 2, 'project_id': '28a90b1659054909ab64ba5320160f74', 'subnets': [{'id': 'b29075d9-9995-4f6f-8ebd-8f7d748977ef', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:49:24.982823 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-292bf870-9bde-4219-b242-762041ce983e None None] Checking router: 4b99bdb0-b8b9-4f04-8c39-efb93626ff5b for host: dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:49:24.983409 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-292bf870-9bde-4219-b242-762041ce983e None None] Updating router 4b99bdb0-b8b9-4f04-8c39-efb93626ff5b port 490fac23-7b22-4b5a-965d-a1dc3250589d binding host dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 02 12:49:25.012012 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 516275c5-8682-4dd0-8e44-89a67ec57721 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:49:25.012335 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:25.035738 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-292bf870-9bde-4219-b242-762041ce983e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:25.062674 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c71c50a1-c733-4116-8b2d-00760d5ec3c5 admin admin] Router 308142a4-46ba-42ef-a1f2-5df4b969cc8f has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108543) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 12:49:25.081461 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-df57586f-c5fd-47a0-b8e2-6ba41a592091 None None] Provisioning complete for port 91fe3ff8-cdf3-4761-8b27-27e55f6f6690 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:49:25.082419 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-df57586f-c5fd-47a0-b8e2-6ba41a592091 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:25.183508 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-df57586f-c5fd-47a0-b8e2-6ba41a592091 None None] Port 91fe3ff8-cdf3-4761-8b27-27e55f6f6690 cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:49:25.248820 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-232aea69-3320-4556-b0c7-b2adce00561f req-b27eadaf-24a2-4cec-8df2-7b32f04fb42b tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:25.252023 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-232aea69-3320-4556-b0c7-b2adce00561f req-b27eadaf-24a2-4cec-8df2-7b32f04fb42b tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/networks?id=c965eaf1-5fb6-4689-8b12-fa3913e4f081 HTTP/1.1" status: 200 len: 819 time: 0.5328150 Nov 02 12:49:25.416811 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c6adeae2-7a38-487c-806b-26cd4bb4bd02 req-6b33b468-0748-47bd-b760-c17e3ebe2a56 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 210 time: 0.1385117 Nov 02 12:49:25.433389 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2515399b-a813-4135-addf-94a2a67414a6 admin admin] Made reservation on behalf of 35ca0fb82a8a492e99f76804c93d3218 for: {'subnet': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:49:25.459147 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-2515399b-a813-4135-addf-94a2a67414a6 admin admin] Publish callbacks [] for subnet, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:25.459426 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-5d69eaa0-9213-436a-af76-7d1236ae4f12 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Made reservation on behalf of ae50c135750c4418b0b05f5bf2979217 for: {'port': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:49:25.463748 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-5d69eaa0-9213-436a-af76-7d1236ae4f12 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:25.470763 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-232aea69-3320-4556-b0c7-b2adce00561f req-e4969db6-c7de-476c-81b1-c7ca4584fa3a tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/quotas/28a90b1659054909ab64ba5320160f74 HTTP/1.1" status: 200 len: 375 time: 0.1894062 Nov 02 12:49:25.551310 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-292bf870-9bde-4219-b242-762041ce983e None None] Publish callbacks [] for port, precommit_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:25.705500 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c71c50a1-c733-4116-8b2d-00760d5ec3c5 admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108543) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:49:25.724881 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-c71c50a1-c733-4116-8b2d-00760d5ec3c5 admin admin] 10.222.0.98 "PUT /v2.0/routers/308142a4-46ba-42ef-a1f2-5df4b969cc8f/add_router_interface HTTP/1.1" status: 200 len: 503 time: 7.1347198 Nov 02 12:49:25.725270 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] Sync routers for ids ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'] in dv-cinder-816324-1-iscsi {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:49:25.730058 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-292bf870-9bde-4219-b242-762041ce983e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:25.733746 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] Routers {'308142a4-46ba-42ef-a1f2-5df4b969cc8f'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:49:25.734050 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:48:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:49:25.813239 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-232aea69-3320-4556-b0c7-b2adce00561f req-f0dd9be1-760b-46fe-b480-f9eb0211be7f tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?tenant_id=28a90b1659054909ab64ba5320160f74&fields=id HTTP/1.1" status: 200 len: 255 time: 0.3152373 Nov 02 12:49:26.033987 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0f1c1860-c024-4502-8baa-7f4656aaf1f9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:26.034278 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_common [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-5d69eaa0-9213-436a-af76-7d1236ae4f12 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Allocated IP 172.20.0.13 (73093621-5f08-4d97-a54e-da0042e8dde7/4d3908d6-4378-401d-b0c3-b220a11a4a6a/95fa81ee-1b2f-4f18-86a7-90dc0d1aef46) {{(pid=108542) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:49:26.049230 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8baad6b8-fefa-4f67-b12f-011421920446 None None] Pushing event updated for resources: {'Port': ['ID=490fac23-7b22-4b5a-965d-a1dc3250589d,revision_number=3']} {{(pid=108545) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:26.060481 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-292bf870-9bde-4219-b242-762041ce983e None None] Attempting to bind port 490fac23-7b22-4b5a-965d-a1dc3250589d on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:49:26.068467 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-292bf870-9bde-4219-b242-762041ce983e None None] Attempting to bind port 490fac23-7b22-4b5a-965d-a1dc3250589d by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': 'db93b928-f362-4483-9a9d-ce7880e2d162', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': 'c965eaf1-5fb6-4689-8b12-fa3913e4f081'}] {{(pid=108545) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:49:26.068467 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-292bf870-9bde-4219-b242-762041ce983e None None] Attempting to bind port 490fac23-7b22-4b5a-965d-a1dc3250589d on network c965eaf1-5fb6-4689-8b12-fa3913e4f081 {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:49:26.076949 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-292bf870-9bde-4219-b242-762041ce983e None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 49, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:49:26.078535 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-292bf870-9bde-4219-b242-762041ce983e None None] Checking segment: {'id': 'db93b928-f362-4483-9a9d-ce7880e2d162', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': 'c965eaf1-5fb6-4689-8b12-fa3913e4f081'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108545) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:49:26.080597 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-292bf870-9bde-4219-b242-762041ce983e None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:26.081944 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-292bf870-9bde-4219-b242-762041ce983e None None] Bound using segment: {'id': 'db93b928-f362-4483-9a9d-ce7880e2d162', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': 'c965eaf1-5fb6-4689-8b12-fa3913e4f081'} {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:49:26.083467 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-292bf870-9bde-4219-b242-762041ce983e None None] Bound port: 490fac23-7b22-4b5a-965d-a1dc3250589d, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'db93b928-f362-4483-9a9d-ce7880e2d162', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': 'c965eaf1-5fb6-4689-8b12-fa3913e4f081'}}] {{(pid=108545) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:49:26.084272 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-292bf870-9bde-4219-b242-762041ce983e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:26.220017 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.db [None req-292bf870-9bde-4219-b242-762041ce983e None None] For port 490fac23-7b22-4b5a-965d-a1dc3250589d, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108545) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:49:26.223681 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.db [None req-292bf870-9bde-4219-b242-762041ce983e None None] For port 490fac23-7b22-4b5a-965d-a1dc3250589d, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=490fac23-7b22-4b5a-965d-a1dc3250589d,segment=NetworkSegment(db93b928-f362-4483-9a9d-ce7880e2d162),segment_id=db93b928-f362-4483-9a9d-ce7880e2d162)] {{(pid=108545) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:49:26.262165 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] Set router 308142a4-46ba-42ef-a1f2-5df4b969cc8f gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:49:26.336466 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-2515399b-a813-4135-addf-94a2a67414a6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for subnet, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:26.365365 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-292bf870-9bde-4219-b242-762041ce983e None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:26.444813 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-5d69eaa0-9213-436a-af76-7d1236ae4f12 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Publish callbacks [] for port, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:26.699496 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2515399b-a813-4135-addf-94a2a67414a6 admin admin] Checking segment: {'id': '6bc6bc15-9107-4ef4-ad26-bc5190f505e3', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 885, 'network_id': '5f91c4c2-564e-4b79-bf93-9e3787e39e15'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108543) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:49:26.700195 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2515399b-a813-4135-addf-94a2a67414a6 admin admin] Network hostable DHCP agents. Network: 5f91c4c2-564e-4b79-bf93-9e3787e39e15, hostable agents: ['1b947f40-f8bf-4088-a5dc-35ee29d90d78'], hosted agents: [] {{(pid=108543) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 02 12:49:26.730123 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2515399b-a813-4135-addf-94a2a67414a6 admin admin] Pushing event updated for resources: {'Subnet': ['ID=64ec6bb8-3f4b-47e9-bd92-a5f30dd77834,revision_number=0']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:26.743781 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8baad6b8-fefa-4f67-b12f-011421920446 None None] Pushing event updated for resources: {'Port': ['ID=490fac23-7b22-4b5a-965d-a1dc3250589d,revision_number=4']} {{(pid=108545) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:26.759101 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-5d69eaa0-9213-436a-af76-7d1236ae4f12 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669'] for port, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:26.790708 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-292bf870-9bde-4219-b242-762041ce983e None None] Routers {'4b99bdb0-b8b9-4f04-8c39-efb93626ff5b'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:49:26.804271 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-292bf870-9bde-4219-b242-762041ce983e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:49:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['4b99bdb0-b8b9-4f04-8c39-efb93626ff5b'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:49:26.865392 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2515399b-a813-4135-addf-94a2a67414a6 admin admin] Network 5f91c4c2-564e-4b79-bf93-9e3787e39e15 is scheduled to be hosted by DHCP agent 1b947f40-f8bf-4088-a5dc-35ee29d90d78 with binding_index 1 {{(pid=108543) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 02 12:49:26.953652 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [None req-2515399b-a813-4135-addf-94a2a67414a6 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816324-1-iscsi, 5f91c4c2-564e-4b79-bf93-9e3787e39e15) {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:49:26.967842 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2515399b-a813-4135-addf-94a2a67414a6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:26.970026 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-2515399b-a813-4135-addf-94a2a67414a6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for subnet, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:27.000156 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-0b8a15c0-1c45-4b32-a4fe-05b5d21a802a None None] Network 5f91c4c2-564e-4b79-bf93-9e3787e39e15 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:49:27.106995 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-2515399b-a813-4135-addf-94a2a67414a6 admin admin] 10.222.0.98 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 862 time: 2.9015458 Nov 02 12:49:27.171319 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-5d69eaa0-9213-436a-af76-7d1236ae4f12 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Network 73093621-5f08-4d97-a54e-da0042e8dde7 is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:49:27.179257 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-5d69eaa0-9213-436a-af76-7d1236ae4f12 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:49:27.191296 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-5d69eaa0-9213-436a-af76-7d1236ae4f12 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Received port after_create {{(pid=108542) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:49:27.239650 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-5d69eaa0-9213-436a-af76-7d1236ae4f12 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:27.240359 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-5d69eaa0-9213-436a-af76-7d1236ae4f12 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for port, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:27.339534 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-292bf870-9bde-4219-b242-762041ce983e None None] Set router 4b99bdb0-b8b9-4f04-8c39-efb93626ff5b gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:49:27.345730 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5d69eaa0-9213-436a-af76-7d1236ae4f12 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Pushing event updated for resources: {'Port': ['ID=95fa81ee-1b2f-4f18-86a7-90dc0d1aef46,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:27.433948 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-5d69eaa0-9213-436a-af76-7d1236ae4f12 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.3870087 Nov 02 12:49:27.470581 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:27.476861 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-84119605-e3b0-48be-b4a7-7f5d145ee688 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] http://10.222.0.98:9696/v2.0/extensions returned with HTTP 200 {{(pid=108542) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 02 12:49:27.479569 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-84119605-e3b0-48be-b4a7-7f5d145ee688 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.90 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13869 time: 0.0339220 Nov 02 12:49:27.480638 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-216c6341-ef13-4992-a5da-20e4b264e09f None None] Network 5f91c4c2-564e-4b79-bf93-9e3787e39e15 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:49:27.741200 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [req-232aea69-3320-4556-b0c7-b2adce00561f req-707a3282-2146-4514-8b31-e7be2452f1e5 service neutron] http://10.222.0.98:9696/v2.0/extensions returned with HTTP 200 {{(pid=108543) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 02 12:49:27.749281 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-232aea69-3320-4556-b0c7-b2adce00561f req-707a3282-2146-4514-8b31-e7be2452f1e5 service neutron] 10.222.0.98 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13869 time: 0.2803183 Nov 02 12:49:28.125029 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d51c1398-9d0e-4894-a752-634974ccafb3 service neutron] Request body: {'port': {'device_id': 'b5f68f82-f48c-4ddc-9588-64082e35c753', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81632'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:49:28.225405 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-232aea69-3320-4556-b0c7-b2adce00561f req-9b252104-80af-4d36-b7b1-ee49a1b0b732 service neutron] 10.222.0.98 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4679787 Nov 02 12:49:28.365119 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'name': 'tempest-AttachVolumeShelveTestJSON-199949485-router', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207'}], 'enable_snat': True}, 'gw_port_id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:49:22Z', 'revision_number': 4, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'gw_port': {'id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:4a:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:12Z', 'updated_at': '2021-11-02T12:49:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '91fe3ff8-cdf3-4761-8b27-27e55f6f6690', 'name': '', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'mac_address': 'fa:16:3e:51:73:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:20Z', 'updated_at': '2021-11-02T12:49:23Z', 'revision_number': 2, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'subnets': [{'id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:49:28.505321 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-232aea69-3320-4556-b0c7-b2adce00561f req-6ceaf53a-0b1d-4613-8c2b-8fa347ed2a15 service neutron] 10.222.0.98 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2725573 Nov 02 12:49:28.532239 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] Checking router: 308142a4-46ba-42ef-a1f2-5df4b969cc8f for host: dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:49:28.533109 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] Updating router 308142a4-46ba-42ef-a1f2-5df4b969cc8f port 91fe3ff8-cdf3-4761-8b27-27e55f6f6690 binding host dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 02 12:49:28.544307 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:28.551466 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d51c1398-9d0e-4894-a752-634974ccafb3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:28.607769 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-292bf870-9bde-4219-b242-762041ce983e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b99bdb0-b8b9-4f04-8c39-efb93626ff5b', 'name': 'tempest-ServerRescueNegativeTestJSON-2129619320-router', 'tenant_id': '28a90b1659054909ab64ba5320160f74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.115'}], 'enable_snat': True}, 'gw_port_id': 'b4d5a738-c102-44ca-ae66-2d125f202102', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:49:20Z', 'revision_number': 4, 'project_id': '28a90b1659054909ab64ba5320160f74', 'gw_port': {'id': 'b4d5a738-c102-44ca-ae66-2d125f202102', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:07:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b99bdb0-b8b9-4f04-8c39-efb93626ff5b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:11Z', 'updated_at': '2021-11-02T12:49:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '490fac23-7b22-4b5a-965d-a1dc3250589d', 'name': '', 'network_id': 'c965eaf1-5fb6-4689-8b12-fa3913e4f081', 'tenant_id': '28a90b1659054909ab64ba5320160f74', 'mac_address': 'fa:16:3e:9b:09:75', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b99bdb0-b8b9-4f04-8c39-efb93626ff5b', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'b29075d9-9995-4f6f-8ebd-8f7d748977ef', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:18Z', 'updated_at': '2021-11-02T12:49:26Z', 'revision_number': 4, 'project_id': '28a90b1659054909ab64ba5320160f74', 'subnets': [{'id': 'b29075d9-9995-4f6f-8ebd-8f7d748977ef', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:49:28.641912 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54644) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:28.647706 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-c77e9043-8019-424b-890c-3b16a46c0670 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1985842930', 'description': 'tempest-description--2111067751'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:49:28.701740 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:28.843550 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c77e9043-8019-424b-890c-3b16a46c0670 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:28.907179 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-292bf870-9bde-4219-b242-762041ce983e None None] The sync data for ids ['4b99bdb0-b8b9-4f04-8c39-efb93626ff5b'] in dv-cinder-816324-1-iscsi is: [{'id': '4b99bdb0-b8b9-4f04-8c39-efb93626ff5b', 'name': 'tempest-ServerRescueNegativeTestJSON-2129619320-router', 'tenant_id': '28a90b1659054909ab64ba5320160f74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.115'}], 'enable_snat': True}, 'gw_port_id': 'b4d5a738-c102-44ca-ae66-2d125f202102', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:49:20Z', 'revision_number': 4, 'project_id': '28a90b1659054909ab64ba5320160f74', 'gw_port': {'id': 'b4d5a738-c102-44ca-ae66-2d125f202102', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:07:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b99bdb0-b8b9-4f04-8c39-efb93626ff5b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:11Z', 'updated_at': '2021-11-02T12:49:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '490fac23-7b22-4b5a-965d-a1dc3250589d', 'name': '', 'network_id': 'c965eaf1-5fb6-4689-8b12-fa3913e4f081', 'tenant_id': '28a90b1659054909ab64ba5320160f74', 'mac_address': 'fa:16:3e:9b:09:75', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '4b99bdb0-b8b9-4f04-8c39-efb93626ff5b', 'device_owner': 'network:router_interface', 'standard_attr_id': 85, 'fixed_ips': [{'subnet_id': 'b29075d9-9995-4f6f-8ebd-8f7d748977ef', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:18Z', 'updated_at': '2021-11-02T12:49:26Z', 'revision_number': 4, 'project_id': '28a90b1659054909ab64ba5320160f74', 'subnets': [{'id': 'b29075d9-9995-4f6f-8ebd-8f7d748977ef', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:49:29.411594 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c77e9043-8019-424b-890c-3b16a46c0670 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:29.466312 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a995da64-99c1-4178-ab46-2af0fc09a4ff req-6604326f-2c2a-42ec-94a6-2c59b5246b0b tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:29.491259 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a995da64-99c1-4178-ab46-2af0fc09a4ff req-6604326f-2c2a-42ec-94a6-2c59b5246b0b tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 932 time: 0.5912979 Nov 02 12:49:30.068313 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c77e9043-8019-424b-890c-3b16a46c0670 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:30.299682 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c77e9043-8019-424b-890c-3b16a46c0670 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:30.312943 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-c77e9043-8019-424b-890c-3b16a46c0670 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 1.6682615 Nov 02 12:49:30.338598 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54702) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:30.340411 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54704) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:30.351339 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-da26e1bb-750a-4a61-a9d0-5354a2df4209 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Request body: {'security_group_rule': {'security_group_id': '766f224b-2f11-482d-8950-f06d70b54eae', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:49:30.361089 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-43dcd4a8-0e74-4fe0-a5b1-14ec56a854e3 admin admin] Request body: {'network': {'name': 'tempest-EncryptedVolumesExtendAttachedTest-938376153-network', 'tenant_id': '5deb06b2fd9b4bb0a5267b3d7c22fbe0'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:49:30.393870 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a995da64-99c1-4178-ab46-2af0fc09a4ff req-04ecfd10-4de4-498b-9036-3b1fae9a52ae tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/security-groups?id=f69cb03a-7a4d-435f-9600-1ab96756bd18&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.9000936 Nov 02 12:49:30.408498 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c77e9043-8019-424b-890c-3b16a46c0670 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Pushing event updated for resources: {'SecurityGroup': ['ID=766f224b-2f11-482d-8950-f06d70b54eae,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:30.532328 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-977d1ffa-be67-46ab-a7f3-7c41208d61ea req-9267e9c0-ce37-484c-a8f7-18404bd73650 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 210 time: 0.0634532 Nov 02 12:49:30.594357 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-43dcd4a8-0e74-4fe0-a5b1-14ec56a854e3 admin admin] Made reservation on behalf of 5deb06b2fd9b4bb0a5267b3d7c22fbe0 for: {'network': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:49:30.598237 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-43dcd4a8-0e74-4fe0-a5b1-14ec56a854e3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for network, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:30.636769 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] Publish callbacks [] for port, precommit_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:30.654333 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54714) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:30.718725 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-43dcd4a8-0e74-4fe0-a5b1-14ec56a854e3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:30.770152 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:30.871377 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.notifiers.nova [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d51c1398-9d0e-4894-a752-634974ccafb3 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 95fa81ee-1b2f-4f18-86a7-90dc0d1aef46 {{(pid=108542) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:49:30.896798 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d51c1398-9d0e-4894-a752-634974ccafb3 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:30.900025 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-da26e1bb-750a-4a61-a9d0-5354a2df4209 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:30.990611 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:31.047312 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d302b3b2-4843-42aa-83cd-d22d8975ba9c None None] Pushing event updated for resources: {'Port': ['ID=91fe3ff8-cdf3-4761-8b27-27e55f6f6690,revision_number=3']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:31.114079 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.provisioning_blocks [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d51c1398-9d0e-4894-a752-634974ccafb3 service neutron] Transition to ACTIVE for port object 95fa81ee-1b2f-4f18-86a7-90dc0d1aef46 will not be triggered until provisioned by entity L2. {{(pid=108542) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 02 12:49:31.117929 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-43dcd4a8-0e74-4fe0-a5b1-14ec56a854e3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:31.167723 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-da26e1bb-750a-4a61-a9d0-5354a2df4209 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:31.199218 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d51c1398-9d0e-4894-a752-634974ccafb3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:31.243712 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 490fac23-7b22-4b5a-965d-a1dc3250589d up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:49:31.277845 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-43dcd4a8-0e74-4fe0-a5b1-14ec56a854e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:31.344181 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-da26e1bb-750a-4a61-a9d0-5354a2df4209 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:31.416206 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-43dcd4a8-0e74-4fe0-a5b1-14ec56a854e3 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 876} {{(pid=108543) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 02 12:49:31.425798 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] Attempting to bind port 91fe3ff8-cdf3-4761-8b27-27e55f6f6690 on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:49:31.426205 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] Attempting to bind port 91fe3ff8-cdf3-4761-8b27-27e55f6f6690 by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': 'b2bc3e69-86f7-4524-92d5-933aa81f8f2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1'}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:49:31.426923 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] Attempting to bind port 91fe3ff8-cdf3-4761-8b27-27e55f6f6690 on network c468f0e1-3636-49b9-90c6-b90c643ed7d1 {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:49:31.471259 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 49, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:49:31.471696 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] Checking segment: {'id': 'b2bc3e69-86f7-4524-92d5-933aa81f8f2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108544) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:49:31.472285 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:31.475759 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] Bound using segment: {'id': 'b2bc3e69-86f7-4524-92d5-933aa81f8f2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1'} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:49:31.479003 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] Bound port: 91fe3ff8-cdf3-4761-8b27-27e55f6f6690, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b2bc3e69-86f7-4524-92d5-933aa81f8f2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1'}}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:49:31.479722 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:31.495165 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-da26e1bb-750a-4a61-a9d0-5354a2df4209 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0c744f07-cc55-410a-822c-1387729e1c41,revision_number=0']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:31.515543 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43dcd4a8-0e74-4fe0-a5b1-14ec56a854e3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f1245a7d-3d43-432c-9f08-b177373a3697,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:31.593698 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-43dcd4a8-0e74-4fe0-a5b1-14ec56a854e3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:31.595533 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.db.segments_db [None req-43dcd4a8-0e74-4fe0-a5b1-14ec56a854e3 admin admin] Added segment 2dd5cf49-0024-4e69-99c2-7f2d13397fe8 of type vlan for network 458b515a-e4c2-498f-91f6-f9317451665a Nov 02 12:49:31.719197 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-da26e1bb-750a-4a61-a9d0-5354a2df4209 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:31.726745 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 490fac23-7b22-4b5a-965d-a1dc3250589d triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:49:31.727547 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:31.734823 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-da26e1bb-750a-4a61-a9d0-5354a2df4209 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 1.3830500 Nov 02 12:49:31.737450 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54750) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:31.753197 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-43dcd4a8-0e74-4fe0-a5b1-14ec56a854e3 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738449409639'] for network, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:31.765026 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-f2429eb5-6b58-4b99-920f-3ae4f93096a9 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Request body: {'security_group_rule': {'security_group_id': '766f224b-2f11-482d-8950-f06d70b54eae', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:49:31.929502 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d51c1398-9d0e-4894-a752-634974ccafb3 service neutron] Pushing event updated for resources: {'Port': ['ID=95fa81ee-1b2f-4f18-86a7-90dc0d1aef46,revision_number=2']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:31.931619 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] For port 91fe3ff8-cdf3-4761-8b27-27e55f6f6690, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108544) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:49:31.974494 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] For port 91fe3ff8-cdf3-4761-8b27-27e55f6f6690, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=91fe3ff8-cdf3-4761-8b27-27e55f6f6690,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108544) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:49:31.991606 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.managers [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d51c1398-9d0e-4894-a752-634974ccafb3 service neutron] Attempting to bind port 95fa81ee-1b2f-4f18-86a7-90dc0d1aef46 on host hv-cinder-81632 for vnic_type normal with profile {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:49:31.991977 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.managers [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d51c1398-9d0e-4894-a752-634974ccafb3 service neutron] Attempting to bind port 95fa81ee-1b2f-4f18-86a7-90dc0d1aef46 by drivers openvswitch,hyperv on host hv-cinder-81632 at level 0 using segments [{'id': '5e5859da-3633-448b-b117-00d1ace2041b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': '73093621-5f08-4d97-a54e-da0042e8dde7'}] {{(pid=108542) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:49:31.994118 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-559f693d-cf1d-4c24-97b7-592b4ecc13fa None None] Provisioning complete for port 91fe3ff8-cdf3-4761-8b27-27e55f6f6690 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:49:31.996237 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-559f693d-cf1d-4c24-97b7-592b4ecc13fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:32.001121 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d51c1398-9d0e-4894-a752-634974ccafb3 service neutron] Attempting to bind port 95fa81ee-1b2f-4f18-86a7-90dc0d1aef46 on network 73093621-5f08-4d97-a54e-da0042e8dde7 {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:49:32.027639 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d51c1398-9d0e-4894-a752-634974ccafb3 service neutron] Port 95fa81ee-1b2f-4f18-86a7-90dc0d1aef46 on network 73093621-5f08-4d97-a54e-da0042e8dde7 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81632 {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 02 12:49:32.032882 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d51c1398-9d0e-4894-a752-634974ccafb3 service neutron] Attempting to bind port 95fa81ee-1b2f-4f18-86a7-90dc0d1aef46 on network 73093621-5f08-4d97-a54e-da0042e8dde7 {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:49:32.057910 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 54760) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:32.077038 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d51c1398-9d0e-4894-a752-634974ccafb3 service neutron] Checking agent: {'id': '0d57fa42-4660-4f08-b7dc-53a872c3c01c', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81632', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'started_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 49, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:49:32.078517 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d51c1398-9d0e-4894-a752-634974ccafb3 service neutron] Checking segment: {'id': '5e5859da-3633-448b-b117-00d1ace2041b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': '73093621-5f08-4d97-a54e-da0042e8dde7'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108542) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:49:32.079121 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d51c1398-9d0e-4894-a752-634974ccafb3 service neutron] Bound using segment: {'id': '5e5859da-3633-448b-b117-00d1ace2041b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': '73093621-5f08-4d97-a54e-da0042e8dde7'} {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:49:32.079609 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.managers [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d51c1398-9d0e-4894-a752-634974ccafb3 service neutron] Bound port: 95fa81ee-1b2f-4f18-86a7-90dc0d1aef46, host: hv-cinder-81632, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '5e5859da-3633-448b-b117-00d1ace2041b', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': '73093621-5f08-4d97-a54e-da0042e8dde7'}}] {{(pid=108542) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:49:32.079967 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d51c1398-9d0e-4894-a752-634974ccafb3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:32.106251 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.db.resource_extend [None req-43dcd4a8-0e74-4fe0-a5b1-14ec56a854e3 admin admin] It took 0.30 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=108543) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 02 12:49:32.117740 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:32.261479 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-57881bdd-045d-4b23-bb41-bc1ba68f8b7e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:32.271396 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-57881bdd-045d-4b23-bb41-bc1ba68f8b7e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/networks?id=c965eaf1-5fb6-4689-8b12-fa3913e4f081 HTTP/1.1" status: 200 len: 819 time: 0.5325315 Nov 02 12:49:32.318072 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-559f693d-cf1d-4c24-97b7-592b4ecc13fa None None] Port 91fe3ff8-cdf3-4761-8b27-27e55f6f6690 cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:49:32.360150 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-a3c7c85e-e109-440a-b8fb-7c5a0ef15d9e admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:32.410130 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-67aa8886-d47f-43e0-913f-62d0c23aebe2 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/quotas/28a90b1659054909ab64ba5320160f74 HTTP/1.1" status: 200 len: 375 time: 0.1273310 Nov 02 12:49:32.413466 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f2429eb5-6b58-4b99-920f-3ae4f93096a9 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:32.474213 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c393ca7b-c12b-48ce-a488-1cfaf5c9c220 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:32.521473 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d51c1398-9d0e-4894-a752-634974ccafb3 service neutron] For port 95fa81ee-1b2f-4f18-86a7-90dc0d1aef46, host hv-cinder-81632, cleared binding levels {{(pid=108542) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:49:32.528841 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d51c1398-9d0e-4894-a752-634974ccafb3 service neutron] For port 95fa81ee-1b2f-4f18-86a7-90dc0d1aef46, host hv-cinder-81632, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=95fa81ee-1b2f-4f18-86a7-90dc0d1aef46,segment=NetworkSegment(5e5859da-3633-448b-b117-00d1ace2041b),segment_id=5e5859da-3633-448b-b117-00d1ace2041b)] {{(pid=108542) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:49:32.559627 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-43dcd4a8-0e74-4fe0-a5b1-14ec56a854e3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for network, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:32.570747 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-43dcd4a8-0e74-4fe0-a5b1-14ec56a854e3 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:32.575421 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-43dcd4a8-0e74-4fe0-a5b1-14ec56a854e3 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:32.581205 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:32.660710 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] Routers {'308142a4-46ba-42ef-a1f2-5df4b969cc8f'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:49:32.661270 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:49:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:49:32.749236 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43dcd4a8-0e74-4fe0-a5b1-14ec56a854e3 admin admin] Pushing event updated for resources: {'Network': ['ID=458b515a-e4c2-498f-91f6-f9317451665a,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:32.827528 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Network 458b515a-e4c2-498f-91f6-f9317451665a details requested by agent ovs-agent-dv-cinder-816324-1-iscsi with host dv-cinder-816324-1-iscsi {{(pid=108544) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 02 12:49:32.843666 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c393ca7b-c12b-48ce-a488-1cfaf5c9c220 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:32.896547 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-36c667fe-72b8-4680-8d16-0769485d94a3 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?tenant_id=28a90b1659054909ab64ba5320160f74&fields=id HTTP/1.1" status: 200 len: 255 time: 0.3947716 Nov 02 12:49:32.941565 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d302b3b2-4843-42aa-83cd-d22d8975ba9c None None] Pushing event updated for resources: {'Port': ['ID=91fe3ff8-cdf3-4761-8b27-27e55f6f6690,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:32.994131 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f2429eb5-6b58-4b99-920f-3ae4f93096a9 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:33.000363 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d51c1398-9d0e-4894-a752-634974ccafb3 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:33.016239 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-43dcd4a8-0e74-4fe0-a5b1-14ec56a854e3 admin admin] 10.222.0.98 "POST /v2.0/networks HTTP/1.1" status: 201 len: 897 time: 2.6727567 Nov 02 12:49:33.021354 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54780) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:33.039705 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c393ca7b-c12b-48ce-a488-1cfaf5c9c220 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:33.039963 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-0bfc3d53-a664-4fc1-b5d3-bed39a9fd447 admin admin] Request body: {'subnet': {'network_id': '458b515a-e4c2-498f-91f6-f9317451665a', 'cidr': '172.20.0.0/28', 'name': 'tempest-EncryptedVolumesExtendAttachedTest-938376153-subnet', 'tenant_id': '5deb06b2fd9b4bb0a5267b3d7c22fbe0', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:49:33.098591 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f2429eb5-6b58-4b99-920f-3ae4f93096a9 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:33.208622 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] For port 490fac23-7b22-4b5a-965d-a1dc3250589d, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=490fac23-7b22-4b5a-965d-a1dc3250589d,segment=NetworkSegment(db93b928-f362-4483-9a9d-ce7880e2d162),segment_id=db93b928-f362-4483-9a9d-ce7880e2d162)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:49:33.241657 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] Set router 308142a4-46ba-42ef-a1f2-5df4b969cc8f gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:49:33.266198 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d51c1398-9d0e-4894-a752-634974ccafb3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:33.267283 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d51c1398-9d0e-4894-a752-634974ccafb3 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for port, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:33.268718 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2429eb5-6b58-4b99-920f-3ae4f93096a9 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=62348117-ec4e-4151-b847-c538ee43a7b6,revision_number=0']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:33.270130 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d51c1398-9d0e-4894-a752-634974ccafb3 service neutron] 10.222.0.90 "PUT /v2.0/ports/95fa81ee-1b2f-4f18-86a7-90dc0d1aef46 HTTP/1.1" status: 200 len: 1094 time: 5.4207807 Nov 02 12:49:33.273048 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b5f68f82-f48c-4ddc-9588-64082e35c753', 'tag': '95fa81ee-1b2f-4f18-86a7-90dc0d1aef46'}] {{(pid=108542) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:49:33.328594 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-a3c7c85e-e109-440a-b8fb-7c5a0ef15d9e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:33.343341 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-0bfc3d53-a664-4fc1-b5d3-bed39a9fd447 admin admin] Made reservation on behalf of 5deb06b2fd9b4bb0a5267b3d7c22fbe0 for: {'subnet': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:49:33.348378 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0bfc3d53-a664-4fc1-b5d3-bed39a9fd447 admin admin] Publish callbacks [] for subnet, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:33.376866 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:33.379961 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-9848492f-2bdd-4595-ac77-669e1f41b6e2 None None] Provisioning complete for port 91fe3ff8-cdf3-4761-8b27-27e55f6f6690 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:49:33.390333 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-9848492f-2bdd-4595-ac77-669e1f41b6e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:33.390587 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-c393ca7b-c12b-48ce-a488-1cfaf5c9c220 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=1590992406644f1b81ad8a7fccfd405e&name=default HTTP/1.1" status: 200 len: 2996 time: 1.3245745 Nov 02 12:49:33.401184 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54786) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:33.411145 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c393ca7b-c12b-48ce-a488-1cfaf5c9c220 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d28dd96f-e5ed-4e08-b909-17f6e5ee36ed,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:33.428750 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d51c1398-9d0e-4894-a752-634974ccafb3 service neutron] Pushing event updated for resources: {'Port': ['ID=95fa81ee-1b2f-4f18-86a7-90dc0d1aef46,revision_number=3']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:33.485382 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-a3c7c85e-e109-440a-b8fb-7c5a0ef15d9e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:33.510577 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:33.693675 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-e348a346-9762-476c-92af-5536f365567a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:33.695665 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-a3c7c85e-e109-440a-b8fb-7c5a0ef15d9e admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=a870cfc4298449c3a493347413ea3afd&name=default HTTP/1.1" status: 200 len: 2996 time: 2.9991274 Nov 02 12:49:33.699684 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-471c22c3-9ef7-4669-9b8a-7426458fba8b service neutron] 10.222.0.98 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7539334 Nov 02 12:49:33.705444 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f2429eb5-6b58-4b99-920f-3ae4f93096a9 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:33.711356 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-f2429eb5-6b58-4b99-920f-3ae4f93096a9 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 1.9673781 Nov 02 12:49:33.711528 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-e348a346-9762-476c-92af-5536f365567a service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=ae50c135750c4418b0b05f5bf2979217&device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 1097 time: 0.1976814 Nov 02 12:49:33.711528 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 54794) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:33.724927 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 54796) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:33.819732 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-eb06dcd7-5930-4bbd-a267-f7b59f1d3db6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Request body: {'floatingip': {'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:49:33.985104 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Pushing event updated for resources: {'Port': ['ID=490fac23-7b22-4b5a-965d-a1dc3250589d,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:34.031911 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-9848492f-2bdd-4595-ac77-669e1f41b6e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:34.042346 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8fdc2194739644bb754d6b187539f80d2eba7dc5c5d5392f1a2d22d03c0a316c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f1450e07-af7b-4454-8626-b44fcfade131" -d '{"events": [{"name": "network-changed", "server_uuid": "b5f68f82-f48c-4ddc-9588-64082e35c753", "tag": "95fa81ee-1b2f-4f18-86a7-90dc0d1aef46"}]}' {{(pid=108542) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:49:34.102147 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a3c7c85e-e109-440a-b8fb-7c5a0ef15d9e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fdeaa8e6-fcc7-4c60-b28f-42f83151af2f,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:34.184914 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-14dc2c3d-86d7-42d2-bf04-305d78d35fdd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:34.205541 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-9848492f-2bdd-4595-ac77-669e1f41b6e2 None None] For port 91fe3ff8-cdf3-4761-8b27-27e55f6f6690, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=91fe3ff8-cdf3-4761-8b27-27e55f6f6690,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:49:34.230091 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-95d002d7-032f-4b20-95ee-39c3d0b09f23 service neutron] 10.222.0.98 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4310308 Nov 02 12:49:34.233056 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-14dc2c3d-86d7-42d2-bf04-305d78d35fdd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:34.287732 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'name': 'tempest-AttachVolumeShelveTestJSON-199949485-router', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207'}], 'enable_snat': True}, 'gw_port_id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:49:22Z', 'revision_number': 4, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'gw_port': {'id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:4a:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:12Z', 'updated_at': '2021-11-02T12:49:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '91fe3ff8-cdf3-4761-8b27-27e55f6f6690', 'name': '', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'mac_address': 'fa:16:3e:51:73:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:20Z', 'updated_at': '2021-11-02T12:49:31Z', 'revision_number': 4, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'subnets': [{'id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:49:34.344139 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-8fa33c08-a06e-498f-8d11-0ffc4b4aee93 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=95fa81ee-1b2f-4f18-86a7-90dc0d1aef46 HTTP/1.1" status: 200 len: 217 time: 0.5771616 Nov 02 12:49:34.393283 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-14dc2c3d-86d7-42d2-bf04-305d78d35fdd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:34.397932 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-14dc2c3d-86d7-42d2-bf04-305d78d35fdd admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:34.399643 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-14dc2c3d-86d7-42d2-bf04-305d78d35fdd admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/d28dd96f-e5ed-4e08-b909-17f6e5ee36ed HTTP/1.1" status: 204 len: 168 time: 0.9966137 Nov 02 12:49:34.419619 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-9848492f-2bdd-4595-ac77-669e1f41b6e2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:34.422064 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bca541fb-473a-42b2-a1eb-4a903446c93d None None] The sync data for ids ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'] in dv-cinder-816324-1-iscsi is: [{'id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'name': 'tempest-AttachVolumeShelveTestJSON-199949485-router', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207'}], 'enable_snat': True}, 'gw_port_id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:49:22Z', 'revision_number': 4, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'gw_port': {'id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:4a:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:12Z', 'updated_at': '2021-11-02T12:49:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '91fe3ff8-cdf3-4761-8b27-27e55f6f6690', 'name': '', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'mac_address': 'fa:16:3e:51:73:ab', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:20Z', 'updated_at': '2021-11-02T12:49:31Z', 'revision_number': 4, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'subnets': [{'id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:49:34.422812 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2752ce5d-68a0-4a2a-812a-109918a648c2 req-0b8061f1-4be2-469a-a71c-fcb259550110 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:34.425056 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2752ce5d-68a0-4a2a-812a-109918a648c2 req-0b8061f1-4be2-469a-a71c-fcb259550110 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 944 time: 0.1971853 Nov 02 12:49:34.443505 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14dc2c3d-86d7-42d2-bf04-305d78d35fdd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d28dd96f-e5ed-4e08-b909-17f6e5ee36ed,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:34.584602 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2b05c077-e530-4ba3-bd1b-6e13729c4a35 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:34.589228 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d4dc9ff8-35ab-442a-a11f-af9cca823ca0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:34.598190 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-d4dc9ff8-35ab-442a-a11f-af9cca823ca0 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=4d3908d6-4378-401d-b0c3-b220a11a4a6a HTTP/1.1" status: 200 len: 852 time: 0.2032428 Nov 02 12:49:34.622621 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9848492f-2bdd-4595-ac77-669e1f41b6e2 None None] Pushing event updated for resources: {'Port': ['ID=91fe3ff8-cdf3-4761-8b27-27e55f6f6690,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:34.809719 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2b05c077-e530-4ba3-bd1b-6e13729c4a35 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:34.927665 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2752ce5d-68a0-4a2a-812a-109918a648c2 req-bbe02125-b48d-4277-9d3e-f2d8b8a17e84 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/security-groups?id=f69cb03a-7a4d-435f-9600-1ab96756bd18&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4881179 Nov 02 12:49:34.929296 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0bfc3d53-a664-4fc1-b5d3-bed39a9fd447 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for subnet, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:35.048050 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-47aed59c-3ffa-4e73-833a-9fbf74f593b7 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=73093621-5f08-4d97-a54e-da0042e8dde7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.4283378 Nov 02 12:49:35.084778 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2b05c077-e530-4ba3-bd1b-6e13729c4a35 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:35.101259 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2b05c077-e530-4ba3-bd1b-6e13729c4a35 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:35.105498 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-2b05c077-e530-4ba3-bd1b-6e13729c4a35 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/fdeaa8e6-fcc7-4c60-b28f-42f83151af2f HTTP/1.1" status: 204 len: 168 time: 1.3950419 Nov 02 12:49:35.181153 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0bfc3d53-a664-4fc1-b5d3-bed39a9fd447 admin admin] Checking segment: {'id': '2dd5cf49-0024-4e69-99c2-7f2d13397fe8', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '458b515a-e4c2-498f-91f6-f9317451665a'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108543) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:49:35.181984 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0bfc3d53-a664-4fc1-b5d3-bed39a9fd447 admin admin] Network hostable DHCP agents. Network: 458b515a-e4c2-498f-91f6-f9317451665a, hostable agents: ['1b947f40-f8bf-4088-a5dc-35ee29d90d78'], hosted agents: [] {{(pid=108543) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 02 12:49:35.190468 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d692a0d3-d582-42e3-9f51-d4b48a0010b6 req-621acbe5-a49f-438d-8247-003243edbb64 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 210 time: 0.0503352 Nov 02 12:49:35.208304 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0bfc3d53-a664-4fc1-b5d3-bed39a9fd447 admin admin] Pushing event updated for resources: {'Subnet': ['ID=87c31785-ee26-477b-8b57-35002ff04b94,revision_number=0']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:35.257567 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-eb06dcd7-5930-4bbd-a267-f7b59f1d3db6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for floatingip, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:35.280136 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b05c077-e530-4ba3-bd1b-6e13729c4a35 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fdeaa8e6-fcc7-4c60-b28f-42f83151af2f,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:35.357428 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0bfc3d53-a664-4fc1-b5d3-bed39a9fd447 admin admin] Network 458b515a-e4c2-498f-91f6-f9317451665a is scheduled to be hosted by DHCP agent 1b947f40-f8bf-4088-a5dc-35ee29d90d78 with binding_index 1 {{(pid=108543) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 02 12:49:35.462903 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [None req-0bfc3d53-a664-4fc1-b5d3-bed39a9fd447 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816324-1-iscsi, 458b515a-e4c2-498f-91f6-f9317451665a) {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:49:35.466784 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0bfc3d53-a664-4fc1-b5d3-bed39a9fd447 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'network'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:35.467500 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0bfc3d53-a664-4fc1-b5d3-bed39a9fd447 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for subnet, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:35.479532 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-97619d4c-5482-40f6-b845-c2e82d6708c4 None None] Network 458b515a-e4c2-498f-91f6-f9317451665a requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:49:35.600874 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:49:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a39fce62-ffda-45c9-a5ac-d562e1ec5919 x-openstack-request-id: req-a39fce62-ffda-45c9-a5ac-d562e1ec5919 {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:49:35.601427 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b5f68f82-f48c-4ddc-9588-64082e35c753", "tag": "95fa81ee-1b2f-4f18-86a7-90dc0d1aef46", "status": "completed", "code": 200}]} {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:49:35.601948 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-a39fce62-ffda-45c9-a5ac-d562e1ec5919 {{(pid=108542) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:49:35.602797 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b5f68f82-f48c-4ddc-9588-64082e35c753', 'tag': '95fa81ee-1b2f-4f18-86a7-90dc0d1aef46', 'status': 'completed', 'code': 200} Nov 02 12:49:35.617445 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-1f22bd7c-5dc4-49c6-846e-73cbb3d79dbe service neutron] 10.222.0.90 "GET /v2.0/networks/73093621-5f08-4d97-a54e-da0042e8dde7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.5448654 Nov 02 12:49:35.666513 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-0bfc3d53-a664-4fc1-b5d3-bed39a9fd447 admin admin] 10.222.0.98 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 861 time: 2.6275251 Nov 02 12:49:35.921499 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54852) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:35.945834 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-433d4372-e244-4fcb-ade6-e0bf2a2b81fd admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:35.947828 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 91fe3ff8-cdf3-4761-8b27-27e55f6f6690 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:49:36.015041 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.90', 58461) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:36.182299 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-d538d560-b4dc-41b9-bd61-378709e2da2e req-b9938d85-ccc2-4bbd-97f1-baf46eeb5e2d service neutron] 10.222.0.90 "GET /v2.0/networks/73093621-5f08-4d97-a54e-da0042e8dde7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5350380 Nov 02 12:49:36.232037 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-eb06dcd7-5930-4bbd-a267-f7b59f1d3db6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:36.377299 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-433d4372-e244-4fcb-ade6-e0bf2a2b81fd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:36.385301 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-13dd9225-9ed7-4d09-b7f0-04becdd3a8a8 None None] Network 458b515a-e4c2-498f-91f6-f9317451665a requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:49:36.485561 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 54864) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:36.578260 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-433d4372-e244-4fcb-ade6-e0bf2a2b81fd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:36.741259 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_v2 [None req-404b8c61-c61c-4496-b14d-b702184fb129 admin admin] Deleting subnet 64ec6bb8-3f4b-47e9-bd92-a5f30dd77834 {{(pid=108542) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 02 12:49:36.759770 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_common [None req-eb06dcd7-5930-4bbd-a267-f7b59f1d3db6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Allocated IP 172.27.0.123 (43464fa8-eb00-46fb-9ca0-be7342f9ddbf/44a807bc-f2b6-41f0-b765-e5d3393fe305/5a1e49c5-6882-4306-b4f2-69b968b3cce8) {{(pid=108542) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:49:36.762244 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-404b8c61-c61c-4496-b14d-b702184fb129 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:36.789818 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 91fe3ff8-cdf3-4761-8b27-27e55f6f6690 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:49:36.790756 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:36.805054 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-232aea69-3320-4556-b0c7-b2adce00561f req-ed82c00c-a2ae-40a0-ba46-3ac6d6789118 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:36.810819 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-232aea69-3320-4556-b0c7-b2adce00561f req-ed82c00c-a2ae-40a0-ba46-3ac6d6789118 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.90 "GET /v2.0/networks?id=c965eaf1-5fb6-4689-8b12-fa3913e4f081 HTTP/1.1" status: 200 len: 819 time: 0.7846625 Nov 02 12:49:36.875465 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-433d4372-e244-4fcb-ade6-e0bf2a2b81fd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3b44414b-d218-4f94-a929-9d7d19c8226b,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:36.896735 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1450e07-af7b-4454-8626-b44fcfade131 req-6fd391ba-b12d-4480-a9c6-f2ac58eea437 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:36.898885 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-433d4372-e244-4fcb-ade6-e0bf2a2b81fd admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=d60a561926914ff190622273d5793590&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9778583 Nov 02 12:49:36.906180 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54868) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:36.915521 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-f1450e07-af7b-4454-8626-b44fcfade131 req-6fd391ba-b12d-4480-a9c6-f2ac58eea437 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=ae50c135750c4418b0b05f5bf2979217&device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 1097 time: 0.2619326 Nov 02 12:49:37.026454 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-232aea69-3320-4556-b0c7-b2adce00561f req-565506aa-9804-4b3e-abbf-c379b7735c13 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Request body: {'port': {'device_id': '14192166-ce34-4302-a48d-e8543bb6aebd', 'network_id': 'c965eaf1-5fb6-4689-8b12-fa3913e4f081', 'admin_state_up': True, 'tenant_id': '28a90b1659054909ab64ba5320160f74'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:49:37.173794 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-404b8c61-c61c-4496-b14d-b702184fb129 admin admin] Publish callbacks [] for subnet, precommit_delete_associations {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:37.413203 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-404b8c61-c61c-4496-b14d-b702184fb129 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-933154'] for subnet, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:37.424456 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-77cc3583-345e-4abd-99fd-e405eb54e65a req-13fdef58-406f-4614-8750-37ed0cf3a794 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:37.441372 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-77cc3583-345e-4abd-99fd-e405eb54e65a req-13fdef58-406f-4614-8750-37ed0cf3a794 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 944 time: 1.1511946 Nov 02 12:49:37.448608 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 490fac23-7b22-4b5a-965d-a1dc3250589d up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:49:37.539230 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 490fac23-7b22-4b5a-965d-a1dc3250589d triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:49:37.539906 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:37.720190 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-eb06dcd7-5930-4bbd-a267-f7b59f1d3db6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for port, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:37.753589 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1450e07-af7b-4454-8626-b44fcfade131 req-1761f5be-afdb-488c-a9d1-adcaf5b90f21 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:37.754597 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-f1450e07-af7b-4454-8626-b44fcfade131 req-1761f5be-afdb-488c-a9d1-adcaf5b90f21 service neutron] 10.222.0.90 "GET /v2.0/networks?id=73093621-5f08-4d97-a54e-da0042e8dde7 HTTP/1.1" status: 200 len: 913 time: 0.7135801 Nov 02 12:49:37.760787 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 54872) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:37.771602 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-404b8c61-c61c-4496-b14d-b702184fb129 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-933141', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for subnet, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:37.828491 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d1cb20c1-8053-4a04-b010-053a239023a3 req-4f8b57a0-7793-466c-a610-076f30b498ee tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 210 time: 0.1452117 Nov 02 12:49:37.829510 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ce159e6c-62cf-416e-a005-3f2220a95550 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:37.842156 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-404b8c61-c61c-4496-b14d-b702184fb129 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:37.847553 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-404b8c61-c61c-4496-b14d-b702184fb129 admin admin] 10.222.0.98 "DELETE /v2.0/subnets/64ec6bb8-3f4b-47e9-bd92-a5f30dd77834 HTTP/1.1" status: 204 len: 168 time: 1.3685384 Nov 02 12:49:37.880587 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 54874) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:37.881760 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-deab0b02-5046-4f7e-bc98-a9156bb0295c admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:37.896365 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ce159e6c-62cf-416e-a005-3f2220a95550 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:38.106561 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-77cc3583-345e-4abd-99fd-e405eb54e65a req-5f56f223-f25b-4b89-b178-e38c36579b66 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/security-groups?id=f69cb03a-7a4d-435f-9600-1ab96756bd18&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6628406 Nov 02 12:49:38.158181 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ce159e6c-62cf-416e-a005-3f2220a95550 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:38.161626 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ce159e6c-62cf-416e-a005-3f2220a95550 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:38.166879 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-ce159e6c-62cf-416e-a005-3f2220a95550 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/3b44414b-d218-4f94-a929-9d7d19c8226b HTTP/1.1" status: 204 len: 168 time: 1.2544336 Nov 02 12:49:38.186776 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54886) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:38.188699 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce159e6c-62cf-416e-a005-3f2220a95550 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3b44414b-d218-4f94-a929-9d7d19c8226b,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:38.214486 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-232aea69-3320-4556-b0c7-b2adce00561f req-565506aa-9804-4b3e-abbf-c379b7735c13 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Made reservation on behalf of 28a90b1659054909ab64ba5320160f74 for: {'port': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:49:38.221206 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-232aea69-3320-4556-b0c7-b2adce00561f req-565506aa-9804-4b3e-abbf-c379b7735c13 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:38.276610 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-deab0b02-5046-4f7e-bc98-a9156bb0295c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:38.278212 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-404b8c61-c61c-4496-b14d-b702184fb129 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=64ec6bb8-3f4b-47e9-bd92-a5f30dd77834,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:38.348297 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-f1450e07-af7b-4454-8626-b44fcfade131 req-ad9d85f4-12ba-4070-b473-8906a007ce81 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=95fa81ee-1b2f-4f18-86a7-90dc0d1aef46 HTTP/1.1" status: 200 len: 217 time: 0.0652025 Nov 02 12:49:38.443241 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-deab0b02-5046-4f7e-bc98-a9156bb0295c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:38.489786 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-deab0b02-5046-4f7e-bc98-a9156bb0295c admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=7979e65a95014dfa8601a2c9de648f1b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7231958 Nov 02 12:49:38.489786 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-eb06dcd7-5930-4bbd-a267-f7b59f1d3db6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669'] for port, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:38.499828 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 54892) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:38.586471 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-eb06dcd7-5930-4bbd-a267-f7b59f1d3db6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:49:38.602219 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-a8529b9b-f819-4922-a973-c263b43d3872 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:38.660086 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-eb06dcd7-5930-4bbd-a267-f7b59f1d3db6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:49:38.680018 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-972735'] for network, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:38.690213 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [None req-eb06dcd7-5930-4bbd-a267-f7b59f1d3db6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Received port after_create {{(pid=108542) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:49:38.714144 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-deab0b02-5046-4f7e-bc98-a9156bb0295c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0115cbbc-51bf-4bd2-94a9-7c7290a535f1,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:38.744911 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f1450e07-af7b-4454-8626-b44fcfade131 req-9d8f2898-2aff-4604-95d4-711528156744 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:38.746600 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-f1450e07-af7b-4454-8626-b44fcfade131 req-9d8f2898-2aff-4604-95d4-711528156744 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=4d3908d6-4378-401d-b0c3-b220a11a4a6a HTTP/1.1" status: 200 len: 852 time: 0.3058698 Nov 02 12:49:38.747845 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb06dcd7-5930-4bbd-a267-f7b59f1d3db6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Pushing event updated for resources: {'Port': ['ID=5a1e49c5-6882-4306-b4f2-69b968b3cce8,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:38.883977 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e8d9c0d3-47b5-4a5f-a0d3-53f949dc3f16 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:38.932010 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-eb06dcd7-5930-4bbd-a267-f7b59f1d3db6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:38.961322 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [req-232aea69-3320-4556-b0c7-b2adce00561f req-565506aa-9804-4b3e-abbf-c379b7735c13 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Allocated IP 172.20.0.11 (c965eaf1-5fb6-4689-8b12-fa3913e4f081/b29075d9-9995-4f6f-8ebd-8f7d748977ef/d32b527e-e041-40dd-b3b1-a7c080a56c87) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:49:39.014949 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e8d9c0d3-47b5-4a5f-a0d3-53f949dc3f16 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:39.018172 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-930985', 'neutron.services.segments.db._delete_segments_for_network-8738449897966'] for network, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:39.066758 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] Subscribe: > segment before_delete 55550000 {{(pid=108542) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:49:39.071203 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=108542) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:49:39.071203 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=108542) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:49:39.071203 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] Subscribe: > port after_create 55550000 {{(pid=108542) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:49:39.071203 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] Subscribe: > port after_delete 55550000 {{(pid=108542) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:49:39.071203 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] Subscribe: > port after_update 55550000 {{(pid=108542) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:49:39.071203 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] Subscribe: > segment after_delete 55550000 {{(pid=108542) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:49:39.071203 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=108542) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:49:39.071203 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=108542) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:49:39.071203 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] Subscribe: > subnet after_update 55550000 {{(pid=108542) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:49:39.225276 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-a8529b9b-f819-4922-a973-c263b43d3872 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:39.229265 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-14ce9117-48bf-4c77-ac30-437237d9e156 req-a7703506-4318-4562-bf81-0ba9399c9545 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 210 time: 0.1816688 Nov 02 12:49:39.327571 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-a8529b9b-f819-4922-a973-c263b43d3872 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:39.352968 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] Subscribe: > subnet after_create 55550000 {{(pid=108542) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:49:39.353630 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=108542) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:49:39.354116 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] Subscribe: > subnet before_create 55550000 {{(pid=108542) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:49:39.354741 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] Subscribe: > subnet before_update 55550000 {{(pid=108542) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:49:39.355197 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['5f91c4c2-564e-4b79-bf93-9e3787e39e15']}} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:49:39.450775 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-a8529b9b-f819-4922-a973-c263b43d3872 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=9f3c1b03cc9549ea9498212332f2b50b&name=default HTTP/1.1" status: 200 len: 2996 time: 1.2561390 Nov 02 12:49:39.456381 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54906) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:39.468714 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8529b9b-f819-4922-a973-c263b43d3872 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=14d0e996-a5f0-487b-ad9c-4520e15e828d,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:39.503774 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a10ae79-f949-4c78-84a5-ec18f30813aa req-e956aaeb-7fce-44f1-9f92-9787cc7bec8f tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:39.508292 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '6bc6bc15-9107-4ef4-ad26-bc5190f505e3') {'for_net_delete': True} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:49:39.508822 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '6bc6bc15-9107-4ef4-ad26-bc5190f505e3') {} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:49:39.512555 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a10ae79-f949-4c78-84a5-ec18f30813aa req-e956aaeb-7fce-44f1-9f92-9787cc7bec8f tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 944 time: 0.2151814 Nov 02 12:49:39.568949 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-232aea69-3320-4556-b0c7-b2adce00561f req-565506aa-9804-4b3e-abbf-c379b7735c13 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:39.631817 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-f1450e07-af7b-4454-8626-b44fcfade131 req-3d0ee52f-0328-460f-a619-f71a6b902f3b service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=73093621-5f08-4d97-a54e-da0042e8dde7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0678310 Nov 02 12:49:39.635682 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738449902583', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3344697'] for segment, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:39.680767 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a10ae79-f949-4c78-84a5-ec18f30813aa req-37425a5a-923d-4568-898a-42b7f4212ac1 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/security-groups?id=f69cb03a-7a4d-435f-9600-1ab96756bd18&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1527102 Nov 02 12:49:39.680767 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7ec59dbb-c6c1-4e04-b73c-ec460c6987f3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:39.696936 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-eb06dcd7-5930-4bbd-a267-f7b59f1d3db6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:39.699370 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e8d9c0d3-47b5-4a5f-a0d3-53f949dc3f16 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:39.701718 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7ec59dbb-c6c1-4e04-b73c-ec460c6987f3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:39.704143 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e8d9c0d3-47b5-4a5f-a0d3-53f949dc3f16 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:39.705631 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-e8d9c0d3-47b5-4a5f-a0d3-53f949dc3f16 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/0115cbbc-51bf-4bd2-94a9-7c7290a535f1 HTTP/1.1" status: 204 len: 168 time: 1.1980429 Nov 02 12:49:39.708986 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e8d9c0d3-47b5-4a5f-a0d3-53f949dc3f16 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0115cbbc-51bf-4bd2-94a9-7c7290a535f1,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] Releasing vlan 885 on physical network physnet1 to pool {{(pid=108542) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126476581'] for segment, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: from cryptography.utils import int_from_bytes Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: from cryptography.utils import int_from_bytes Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: Traceback (most recent call last): Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: timer() Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: cb(*args, **kw) Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: return func(*args, **kwargs) Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: self._notify() Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: self.callback(batched_events) Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: event.method(event) Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: aggregate_uuid = self.p_client.list_aggregates( Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: return f(self, *a, **k) Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: return self._get(url).json() Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: return self.request(url, 'GET', **kwargs) Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: base_url = self.get_endpoint(auth, allow=allow, Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 02 12:49:39.904900 dv-cinder-816324-1-iscsi neutron-server[108542]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 02 12:49:39.917662 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54914) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:40.051584 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-f1450e07-af7b-4454-8626-b44fcfade131 req-362c1a6f-ea9c-4c1e-aae6-f5cd016998da service neutron] 10.222.0.90 "GET /v2.0/networks/73093621-5f08-4d97-a54e-da0042e8dde7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3378005 Nov 02 12:49:40.068281 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-232aea69-3320-4556-b0c7-b2adce00561f req-565506aa-9804-4b3e-abbf-c379b7735c13 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:40.165181 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-232aea69-3320-4556-b0c7-b2adce00561f req-565506aa-9804-4b3e-abbf-c379b7735c13 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Network c965eaf1-5fb6-4689-8b12-fa3913e4f081 is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:49:40.192351 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-eb06dcd7-5930-4bbd-a267-f7b59f1d3db6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for port, precommit_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:40.201363 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [req-232aea69-3320-4556-b0c7-b2adce00561f req-565506aa-9804-4b3e-abbf-c379b7735c13 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:49:40.212582 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-232aea69-3320-4556-b0c7-b2adce00561f req-565506aa-9804-4b3e-abbf-c379b7735c13 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:49:40.220211 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-232aea69-3320-4556-b0c7-b2adce00561f req-565506aa-9804-4b3e-abbf-c379b7735c13 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:40.221012 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-232aea69-3320-4556-b0c7-b2adce00561f req-565506aa-9804-4b3e-abbf-c379b7735c13 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:40.250617 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7ec59dbb-c6c1-4e04-b73c-ec460c6987f3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:40.253333 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7ec59dbb-c6c1-4e04-b73c-ec460c6987f3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:40.256930 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-7ec59dbb-c6c1-4e04-b73c-ec460c6987f3 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/14d0e996-a5f0-487b-ad9c-4520e15e828d HTTP/1.1" status: 204 len: 168 time: 0.7964768 Nov 02 12:49:40.257095 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-930976', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1594946'] for network, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:40.315396 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7ec59dbb-c6c1-4e04-b73c-ec460c6987f3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=14d0e996-a5f0-487b-ad9c-4520e15e828d,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:40.387115 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:40.409379 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] 10.222.0.98 "DELETE /v2.0/networks/5f91c4c2-564e-4b79-bf93-9e3787e39e15 HTTP/1.1" status: 204 len: 168 time: 2.5154500 Nov 02 12:49:40.410926 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 54926) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:40.420263 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-565506aa-9804-4b3e-abbf-c379b7735c13 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Pushing event updated for resources: {'Port': ['ID=d32b527e-e041-40dd-b3b1-a7c080a56c87,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:40.423771 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1c7a0112-d495-45c1-b62e-aca6db8979e2 admin admin] Pushing event deleted for resources: {'Network': ['ID=5f91c4c2-564e-4b79-bf93-9e3787e39e15,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:40.426312 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-eb06dcd7-5930-4bbd-a267-f7b59f1d3db6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126476609'] for port, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:40.482890 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.90', 58467) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:40.486546 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-95041dcb-b79b-4ccc-8c4f-8614472ae67a req-0abfe002-9c0f-4716-8f81-78df69d66942 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 210 time: 0.0920298 Nov 02 12:49:40.489569 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-232aea69-3320-4556-b0c7-b2adce00561f req-565506aa-9804-4b3e-abbf-c379b7735c13 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.5808971 Nov 02 12:49:40.604046 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb06dcd7-5930-4bbd-a267-f7b59f1d3db6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Pushing event updated for resources: {'Port': ['ID=5a1e49c5-6882-4306-b4f2-69b968b3cce8,revision_number=2']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:40.702470 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-232aea69-3320-4556-b0c7-b2adce00561f req-6743d2bc-a665-460e-9a5a-fd58f05bd31e service neutron] Request body: {'port': {'device_id': '14192166-ce34-4302-a48d-e8543bb6aebd', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81632'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:49:40.796273 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-232aea69-3320-4556-b0c7-b2adce00561f req-6743d2bc-a665-460e-9a5a-fd58f05bd31e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:40.897043 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_v2 [None req-d69cdb88-d654-45e2-acd0-998b8842231e admin admin] Deleting subnet 87c31785-ee26-477b-8b57-35002ff04b94 {{(pid=108542) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 02 12:49:40.910954 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d69cdb88-d654-45e2-acd0-998b8842231e admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:41.019131 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-eb06dcd7-5930-4bbd-a267-f7b59f1d3db6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1594992'] for floatingip, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:41.057556 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d69cdb88-d654-45e2-acd0-998b8842231e admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3344686'] for subnet, precommit_delete_associations {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:41.105317 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-f1450e07-af7b-4454-8626-b44fcfade131 req-0b053d45-19f4-410d-916a-c484e6613581 service neutron] 10.222.0.90 "GET /v2.0/networks/73093621-5f08-4d97-a54e-da0042e8dde7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6006382 Nov 02 12:49:41.144847 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d69cdb88-d654-45e2-acd0-998b8842231e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-933154'] for subnet, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:41.223411 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-d8a75bdf-b96f-4288-a6b2-5d9777f30245 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:41.225726 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-d8a75bdf-b96f-4288-a6b2-5d9777f30245 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.90 "GET /v2.0/networks?id=c965eaf1-5fb6-4689-8b12-fa3913e4f081 HTTP/1.1" status: 200 len: 819 time: 0.7174461 Nov 02 12:49:41.251763 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-eb06dcd7-5930-4bbd-a267-f7b59f1d3db6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for floatingip, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:41.255303 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-eb06dcd7-5930-4bbd-a267-f7b59f1d3db6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 7.4937983 Nov 02 12:49:41.276098 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-27a76139-0e48-431a-abaa-52ee88f6f335 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:41.291048 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-2a0b5ddc-4fbd-46b6-aadc-c1d5ebc5ce9e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Request body: {'port': {'device_id': '96a98d45-ba9a-48b2-a608-9596dc5a2988', 'network_id': 'c965eaf1-5fb6-4689-8b12-fa3913e4f081', 'admin_state_up': True, 'tenant_id': '28a90b1659054909ab64ba5320160f74'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:49:41.342060 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d69cdb88-d654-45e2-acd0-998b8842231e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-933141', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126478215', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126185624'] for subnet, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:41.426961 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d69cdb88-d654-45e2-acd0-998b8842231e admin admin] Publish callbacks [] for subnet, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:41.455962 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-d69cdb88-d654-45e2-acd0-998b8842231e admin admin] 10.222.0.98 "DELETE /v2.0/subnets/87c31785-ee26-477b-8b57-35002ff04b94 HTTP/1.1" status: 204 len: 168 time: 1.0422370 Nov 02 12:49:41.458087 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 54948) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:41.462864 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d69cdb88-d654-45e2-acd0-998b8842231e admin admin] Pushing event deleted for resources: {'Subnet': ['ID=87c31785-ee26-477b-8b57-35002ff04b94,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:41.539557 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-59529dd4-089d-4949-806d-0959c410e98e req-b33f9dce-2c9d-42c2-b627-4b7bed6d0546 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:41.541229 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-59529dd4-089d-4949-806d-0959c410e98e req-b33f9dce-2c9d-42c2-b627-4b7bed6d0546 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 944 time: 0.6973104 Nov 02 12:49:41.670408 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-00bbce45-65a5-4971-a6ee-7d60e5434d93 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-972735'] for network, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:41.878920 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-00bbce45-65a5-4971-a6ee-7d60e5434d93 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-930985', 'neutron.services.segments.db._delete_segments_for_network-8738449897966'] for network, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:41.883805 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-59529dd4-089d-4949-806d-0959c410e98e req-4eee7569-b57c-4ed9-9629-631aaebc930b tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/security-groups?id=f69cb03a-7a4d-435f-9600-1ab96756bd18&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2368386 Nov 02 12:49:41.899285 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-dea79de8-170e-4da4-bfe9-67591161abe2 req-d8dd3e3e-1dbe-43d4-9cdc-5bc66060755d tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 210 time: 0.1171768 Nov 02 12:49:41.935603 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-00bbce45-65a5-4971-a6ee-7d60e5434d93 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['458b515a-e4c2-498f-91f6-f9317451665a']}} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:49:41.960256 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-00bbce45-65a5-4971-a6ee-7d60e5434d93 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '2dd5cf49-0024-4e69-99c2-7f2d13397fe8') {'for_net_delete': True} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:49:41.961771 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-00bbce45-65a5-4971-a6ee-7d60e5434d93 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '2dd5cf49-0024-4e69-99c2-7f2d13397fe8') {} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:49:41.986413 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-00bbce45-65a5-4971-a6ee-7d60e5434d93 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738449902583', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3344697'] for segment, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:41.986942 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [req-232aea69-3320-4556-b0c7-b2adce00561f req-6743d2bc-a665-460e-9a5a-fd58f05bd31e service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id d32b527e-e041-40dd-b3b1-a7c080a56c87 {{(pid=108543) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:49:42.020618 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-27a76139-0e48-431a-abaa-52ee88f6f335 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:42.030560 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-00bbce45-65a5-4971-a6ee-7d60e5434d93 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:42.037330 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-2a0b5ddc-4fbd-46b6-aadc-c1d5ebc5ce9e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Made reservation on behalf of 28a90b1659054909ab64ba5320160f74 for: {'port': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:49:42.049212 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-2a0b5ddc-4fbd-46b6-aadc-c1d5ebc5ce9e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:42.052956 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-00bbce45-65a5-4971-a6ee-7d60e5434d93 admin admin] Releasing vlan 876 on physical network physnet1 to pool {{(pid=108542) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 02 12:49:42.054049 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-00bbce45-65a5-4971-a6ee-7d60e5434d93 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126476581'] for segment, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:42.064111 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-232aea69-3320-4556-b0c7-b2adce00561f req-6743d2bc-a665-460e-9a5a-fd58f05bd31e service neutron] Publish callbacks [] for port, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: Traceback (most recent call last): Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: timer() Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: cb(*args, **kw) Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: return func(*args, **kwargs) Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: self._notify() Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: self.callback(batched_events) Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: event.method(event) Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: aggregate_uuid = self.p_client.list_aggregates( Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: return f(self, *a, **k) Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: return self._get(url).json() Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: return self.request(url, 'GET', **kwargs) Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: base_url = self.get_endpoint(auth, allow=allow, Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 02 12:49:42.219881 dv-cinder-816324-1-iscsi neutron-server[108542]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 02 12:49:42.335326 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-27a76139-0e48-431a-abaa-52ee88f6f335 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:42.377541 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-b277546f-97f5-4240-9b81-3faf4c0e2d9e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?name=tempest-securitygroup--1985842930&fields=id&tenant_id=aaddc046689441b8ab3641f2afd07c0e HTTP/1.1" status: 200 len: 267 time: 0.2823915 Nov 02 12:49:42.417745 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-27a76139-0e48-431a-abaa-52ee88f6f335 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=01b1a86a50ae48aaaec3864e58504714&name=default HTTP/1.1" status: 200 len: 2996 time: 2.4951181 Nov 02 12:49:42.421720 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54966) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:42.447716 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27a76139-0e48-431a-abaa-52ee88f6f335 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e87d6a43-aa87-4410-92ca-b4c4e37fce94,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:42.479168 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-00bbce45-65a5-4971-a6ee-7d60e5434d93 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-930976', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1594946'] for network, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:42.491050 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.provisioning_blocks [req-232aea69-3320-4556-b0c7-b2adce00561f req-6743d2bc-a665-460e-9a5a-fd58f05bd31e service neutron] Transition to ACTIVE for port object d32b527e-e041-40dd-b3b1-a7c080a56c87 will not be triggered until provisioned by entity L2. {{(pid=108543) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 02 12:49:42.520319 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-00bbce45-65a5-4971-a6ee-7d60e5434d93 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:42.520853 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 54968) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:42.556779 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-00bbce45-65a5-4971-a6ee-7d60e5434d93 admin admin] 10.222.0.98 "DELETE /v2.0/networks/458b515a-e4c2-498f-91f6-f9317451665a HTTP/1.1" status: 204 len: 168 time: 1.0956137 Nov 02 12:49:42.599292 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00bbce45-65a5-4971-a6ee-7d60e5434d93 admin admin] Pushing event deleted for resources: {'Network': ['ID=458b515a-e4c2-498f-91f6-f9317451665a,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:42.662069 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-306c397b-d806-47e2-95cb-404edcdabf9c admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:42.708568 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-232aea69-3320-4556-b0c7-b2adce00561f req-6743d2bc-a665-460e-9a5a-fd58f05bd31e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:43.001676 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6743d2bc-a665-460e-9a5a-fd58f05bd31e service neutron] Pushing event updated for resources: {'Port': ['ID=d32b527e-e041-40dd-b3b1-a7c080a56c87,revision_number=2']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:43.160980 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-2a0b5ddc-4fbd-46b6-aadc-c1d5ebc5ce9e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Allocated IP 172.20.0.10 (c965eaf1-5fb6-4689-8b12-fa3913e4f081/b29075d9-9995-4f6f-8ebd-8f7d748977ef/2cf235b6-e4c1-4b00-8971-dbd528d6ad92) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:49:43.182872 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-74347fff-a9f9-40f1-a07c-d5de99afc129 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:43.184536 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-74347fff-a9f9-40f1-a07c-d5de99afc129 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/networks?id=c468f0e1-3636-49b9-90c6-b90c643ed7d1 HTTP/1.1" status: 200 len: 816 time: 0.7856417 Nov 02 12:49:43.225637 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7b4992ee-a18f-4def-b808-6cd56d4abb16 req-082809e0-b902-42b0-b50e-5394de6d1f26 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 210 time: 0.0922134 Nov 02 12:49:43.240866 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-51847525-f82a-48af-a199-58ac9a40be71 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/quotas/aaddc046689441b8ab3641f2afd07c0e HTTP/1.1" status: 200 len: 375 time: 0.0239151 Nov 02 12:49:43.241512 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c15350f3-f6c1-4ca5-83f3-92d59e06859a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:43.245391 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-232aea69-3320-4556-b0c7-b2adce00561f req-6743d2bc-a665-460e-9a5a-fd58f05bd31e service neutron] Attempting to bind port d32b527e-e041-40dd-b3b1-a7c080a56c87 on host hv-cinder-81632 for vnic_type normal with profile {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:49:43.245760 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-232aea69-3320-4556-b0c7-b2adce00561f req-6743d2bc-a665-460e-9a5a-fd58f05bd31e service neutron] Attempting to bind port d32b527e-e041-40dd-b3b1-a7c080a56c87 by drivers openvswitch,hyperv on host hv-cinder-81632 at level 0 using segments [{'id': 'db93b928-f362-4483-9a9d-ce7880e2d162', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': 'c965eaf1-5fb6-4689-8b12-fa3913e4f081'}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:49:43.255696 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-232aea69-3320-4556-b0c7-b2adce00561f req-6743d2bc-a665-460e-9a5a-fd58f05bd31e service neutron] Attempting to bind port d32b527e-e041-40dd-b3b1-a7c080a56c87 on network c965eaf1-5fb6-4689-8b12-fa3913e4f081 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:49:43.301471 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 54988) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:43.329353 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-232aea69-3320-4556-b0c7-b2adce00561f req-6743d2bc-a665-460e-9a5a-fd58f05bd31e service neutron] Port d32b527e-e041-40dd-b3b1-a7c080a56c87 on network c965eaf1-5fb6-4689-8b12-fa3913e4f081 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81632 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 02 12:49:43.329715 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-232aea69-3320-4556-b0c7-b2adce00561f req-6743d2bc-a665-460e-9a5a-fd58f05bd31e service neutron] Attempting to bind port d32b527e-e041-40dd-b3b1-a7c080a56c87 on network c965eaf1-5fb6-4689-8b12-fa3913e4f081 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:49:43.347290 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c15350f3-f6c1-4ca5-83f3-92d59e06859a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:43.381918 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-92318f5f-d7d9-49cd-895f-f04a1bedfb6e admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=35ca0fb82a8a492e99f76804c93d3218&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0788982 Nov 02 12:49:43.382684 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 54990) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:43.393842 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-232aea69-3320-4556-b0c7-b2adce00561f req-6743d2bc-a665-460e-9a5a-fd58f05bd31e service neutron] Checking agent: {'id': '0d57fa42-4660-4f08-b7dc-53a872c3c01c', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81632', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'started_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 49, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:49:43.394300 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-232aea69-3320-4556-b0c7-b2adce00561f req-6743d2bc-a665-460e-9a5a-fd58f05bd31e service neutron] Checking segment: {'id': 'db93b928-f362-4483-9a9d-ce7880e2d162', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': 'c965eaf1-5fb6-4689-8b12-fa3913e4f081'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108543) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:49:43.394861 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-232aea69-3320-4556-b0c7-b2adce00561f req-6743d2bc-a665-460e-9a5a-fd58f05bd31e service neutron] Bound using segment: {'id': 'db93b928-f362-4483-9a9d-ce7880e2d162', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': 'c965eaf1-5fb6-4689-8b12-fa3913e4f081'} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:49:43.395403 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-232aea69-3320-4556-b0c7-b2adce00561f req-6743d2bc-a665-460e-9a5a-fd58f05bd31e service neutron] Bound port: d32b527e-e041-40dd-b3b1-a7c080a56c87, host: hv-cinder-81632, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'db93b928-f362-4483-9a9d-ce7880e2d162', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': 'c965eaf1-5fb6-4689-8b12-fa3913e4f081'}}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:49:43.395758 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-232aea69-3320-4556-b0c7-b2adce00561f req-6743d2bc-a665-460e-9a5a-fd58f05bd31e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:43.526730 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-b39c16ac-afd8-466c-b4fc-0291aa90e852 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?tenant_id=aaddc046689441b8ab3641f2afd07c0e&fields=id HTTP/1.1" status: 200 len: 348 time: 0.2633927 Nov 02 12:49:43.531215 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-306c397b-d806-47e2-95cb-404edcdabf9c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:43.634980 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-6cc3b396-4e2a-4fc4-9dc4-33b44ee5e97f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:43.676493 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-354fb42b-dd7c-48b3-a9f6-035ed1d10b5e req-e2fd4e38-4f02-4294-8d8a-e5b46e7cc9b8 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:43.678202 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-354fb42b-dd7c-48b3-a9f6-035ed1d10b5e req-e2fd4e38-4f02-4294-8d8a-e5b46e7cc9b8 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 944 time: 0.3006384 Nov 02 12:49:43.718666 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-6cc3b396-4e2a-4fc4-9dc4-33b44ee5e97f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:43.759437 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-306c397b-d806-47e2-95cb-404edcdabf9c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:43.806697 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-232aea69-3320-4556-b0c7-b2adce00561f req-6743d2bc-a665-460e-9a5a-fd58f05bd31e service neutron] For port d32b527e-e041-40dd-b3b1-a7c080a56c87, host hv-cinder-81632, cleared binding levels {{(pid=108543) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:49:43.834204 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-2a0b5ddc-4fbd-46b6-aadc-c1d5ebc5ce9e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:43.835658 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c15350f3-f6c1-4ca5-83f3-92d59e06859a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:43.838203 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c15350f3-f6c1-4ca5-83f3-92d59e06859a admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:43.840658 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-c15350f3-f6c1-4ca5-83f3-92d59e06859a admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/e87d6a43-aa87-4410-92ca-b4c4e37fce94 HTTP/1.1" status: 204 len: 168 time: 1.4169850 Nov 02 12:49:43.900891 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-6cc3b396-4e2a-4fc4-9dc4-33b44ee5e97f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:43.904385 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-6cc3b396-4e2a-4fc4-9dc4-33b44ee5e97f admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:43.909907 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-6cc3b396-4e2a-4fc4-9dc4-33b44ee5e97f admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/5d20ac39-c08b-4dde-930f-1a52b0e4c1d0 HTTP/1.1" status: 204 len: 168 time: 0.5244048 Nov 02 12:49:43.920785 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cc3b396-4e2a-4fc4-9dc4-33b44ee5e97f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5d20ac39-c08b-4dde-930f-1a52b0e4c1d0,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:43.959039 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-232aea69-3320-4556-b0c7-b2adce00561f req-6743d2bc-a665-460e-9a5a-fd58f05bd31e service neutron] For port d32b527e-e041-40dd-b3b1-a7c080a56c87, host hv-cinder-81632, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=d32b527e-e041-40dd-b3b1-a7c080a56c87,segment=NetworkSegment(db93b928-f362-4483-9a9d-ce7880e2d162),segment_id=db93b928-f362-4483-9a9d-ce7880e2d162)] {{(pid=108543) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:49:43.986634 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-306c397b-d806-47e2-95cb-404edcdabf9c admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=a1a0bff4c97f44978a192f25dd363b64&name=default HTTP/1.1" status: 200 len: 2996 time: 1.4639380 Nov 02 12:49:43.986907 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 55006) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:44.049906 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-354fb42b-dd7c-48b3-a9f6-035ed1d10b5e req-b5240441-2bb0-48c4-bf97-5fb546deb627 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/security-groups?id=f69cb03a-7a4d-435f-9600-1ab96756bd18&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3478303 Nov 02 12:49:44.051088 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-8b3c8686-b16a-43e6-bbfc-a90f524fe974 service neutron] 10.222.0.98 "GET /v2.0/networks/c468f0e1-3636-49b9-90c6-b90c643ed7d1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4019413 Nov 02 12:49:44.053719 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-306c397b-d806-47e2-95cb-404edcdabf9c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4386507f-fd8f-412e-ae53-aedd6c672135,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:44.059908 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-232aea69-3320-4556-b0c7-b2adce00561f req-6743d2bc-a665-460e-9a5a-fd58f05bd31e service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:44.100422 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-becb017d-1b98-47f7-9b59-211349b2d7cb admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:44.134183 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-becb017d-1b98-47f7-9b59-211349b2d7cb admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:44.148306 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c15350f3-f6c1-4ca5-83f3-92d59e06859a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e87d6a43-aa87-4410-92ca-b4c4e37fce94,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:44.157255 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-232aea69-3320-4556-b0c7-b2adce00561f req-6743d2bc-a665-460e-9a5a-fd58f05bd31e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:44.159053 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-232aea69-3320-4556-b0c7-b2adce00561f req-6743d2bc-a665-460e-9a5a-fd58f05bd31e service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:44.160743 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-232aea69-3320-4556-b0c7-b2adce00561f req-6743d2bc-a665-460e-9a5a-fd58f05bd31e service neutron] 10.222.0.90 "PUT /v2.0/ports/d32b527e-e041-40dd-b3b1-a7c080a56c87 HTTP/1.1" status: 200 len: 1094 time: 3.6538439 Nov 02 12:49:44.167088 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '14192166-ce34-4302-a48d-e8543bb6aebd', 'tag': 'd32b527e-e041-40dd-b3b1-a7c080a56c87'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:49:44.284946 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-2a0b5ddc-4fbd-46b6-aadc-c1d5ebc5ce9e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:44.290589 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-becb017d-1b98-47f7-9b59-211349b2d7cb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:44.299719 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-becb017d-1b98-47f7-9b59-211349b2d7cb admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:44.299719 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-becb017d-1b98-47f7-9b59-211349b2d7cb admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/4386507f-fd8f-412e-ae53-aedd6c672135 HTTP/1.1" status: 204 len: 168 time: 0.3092394 Nov 02 12:49:44.313081 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-becb017d-1b98-47f7-9b59-211349b2d7cb admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4386507f-fd8f-412e-ae53-aedd6c672135,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:44.366000 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6743d2bc-a665-460e-9a5a-fd58f05bd31e service neutron] Pushing event updated for resources: {'Port': ['ID=d32b527e-e041-40dd-b3b1-a7c080a56c87,revision_number=3']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:44.387597 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-2a0b5ddc-4fbd-46b6-aadc-c1d5ebc5ce9e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Network c965eaf1-5fb6-4689-8b12-fa3913e4f081 is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:49:44.429609 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-2a0b5ddc-4fbd-46b6-aadc-c1d5ebc5ce9e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:49:44.439201 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-2a0b5ddc-4fbd-46b6-aadc-c1d5ebc5ce9e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:49:44.446637 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-2a0b5ddc-4fbd-46b6-aadc-c1d5ebc5ce9e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:44.447335 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-2a0b5ddc-4fbd-46b6-aadc-c1d5ebc5ce9e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:44.529433 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a0b5ddc-4fbd-46b6-aadc-c1d5ebc5ce9e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Pushing event updated for resources: {'Port': ['ID=2cf235b6-e4c1-4b00-8971-dbd528d6ad92,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:44.541826 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-75a05606-66d5-4fc7-9c37-cd3214bf5a30 service neutron] 10.222.0.98 "GET /v2.0/networks/c468f0e1-3636-49b9-90c6-b90c643ed7d1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4633911 Nov 02 12:49:44.545606 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84e78f11-ca04-47e1-b64b-317f38f463ec req-321ae4a0-ac87-4743-8891-c32885e1f11c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:44.547222 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-84e78f11-ca04-47e1-b64b-317f38f463ec req-321ae4a0-ac87-4743-8891-c32885e1f11c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 932 time: 0.2326539 Nov 02 12:49:44.592669 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-232aea69-3320-4556-b0c7-b2adce00561f req-d829536d-bfab-4dac-ae00-16d65f471b10 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:44.594159 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-232aea69-3320-4556-b0c7-b2adce00561f req-d829536d-bfab-4dac-ae00-16d65f471b10 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=28a90b1659054909ab64ba5320160f74&device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 1097 time: 0.1347096 Nov 02 12:49:44.679898 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-2a0b5ddc-4fbd-46b6-aadc-c1d5ebc5ce9e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 3.4181418 Nov 02 12:49:44.682489 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-232aea69-3320-4556-b0c7-b2adce00561f req-d895c3e5-6fb0-4b73-b932-709ace6826ae service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d32b527e-e041-40dd-b3b1-a7c080a56c87 HTTP/1.1" status: 200 len: 217 time: 0.0791492 Nov 02 12:49:44.688030 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-84e78f11-ca04-47e1-b64b-317f38f463ec req-59e63712-f181-475c-ae46-6ac08959fa0a tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1323853 Nov 02 12:49:44.701309 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-f50c1143-af2b-4f4d-98bf-aab832c2a8ca service neutron] Request body: {'port': {'device_id': '96a98d45-ba9a-48b2-a608-9596dc5a2988', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81632'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:49:44.896842 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-232aea69-3320-4556-b0c7-b2adce00561f req-3c9b386b-339c-4a6b-8c44-1ef58b93f827 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:44.899526 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-232aea69-3320-4556-b0c7-b2adce00561f req-3c9b386b-339c-4a6b-8c44-1ef58b93f827 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=b29075d9-9995-4f6f-8ebd-8f7d748977ef HTTP/1.1" status: 200 len: 859 time: 0.2046933 Nov 02 12:49:44.917776 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-f50c1143-af2b-4f4d-98bf-aab832c2a8ca service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:45.018225 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-30248d3f-35dd-4399-aaf9-19e1ff1f7767 req-eec69f60-b19d-447c-bb9f-de7e7386d78d tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 210 time: 0.1141391 Nov 02 12:49:45.050272 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-232aea69-3320-4556-b0c7-b2adce00561f req-6a1e05fe-661c-48b6-8a2a-33085f28f26d service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=c965eaf1-5fb6-4689-8b12-fa3913e4f081&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1248636 Nov 02 12:49:45.351146 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-232aea69-3320-4556-b0c7-b2adce00561f req-90d88af6-ea8d-4b7a-a453-e0dd1389861f service neutron] 10.222.0.90 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2917073 Nov 02 12:49:45.568552 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed9ace6b-f7dc-4d9f-a9ea-5ffb8b6fe55a req-a8058822-bf73-4535-a56c-502e90bbc195 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:45.572803 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ed9ace6b-f7dc-4d9f-a9ea-5ffb8b6fe55a req-a8058822-bf73-4535-a56c-502e90bbc195 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 944 time: 0.3774877 Nov 02 12:49:45.751839 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 55044) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:45.836078 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ed9ace6b-f7dc-4d9f-a9ea-5ffb8b6fe55a req-9f21db00-8700-4d15-8010-1be918e3e38f tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/security-groups?id=f69cb03a-7a4d-435f-9600-1ab96756bd18&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2491293 Nov 02 12:49:45.843194 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-232aea69-3320-4556-b0c7-b2adce00561f req-0623151e-3851-4b1b-bf17-0f375768f9d9 service neutron] 10.222.0.90 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4733272 Nov 02 12:49:45.873424 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-6adc6649-9cef-45c9-b00c-ae699ee0175c admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=5deb06b2fd9b4bb0a5267b3d7c22fbe0&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1178560 Nov 02 12:49:45.878686 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 55046) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:45.961959 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-ba151fc8-d134-4044-bec1-025d2e344a6f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:45.988860 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-f50c1143-af2b-4f4d-98bf-aab832c2a8ca service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 2cf235b6-e4c1-4b00-8971-dbd528d6ad92 {{(pid=108543) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:49:45.999051 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-f50c1143-af2b-4f4d-98bf-aab832c2a8ca service neutron] Publish callbacks [] for port, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:46.012738 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-ba151fc8-d134-4044-bec1-025d2e344a6f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:46.015058 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d688a418-93df-4c62-b259-7c2dec5c153b req-e724292d-fbf5-4743-a3e5-ab3b417bd81b tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:46.022794 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d688a418-93df-4c62-b259-7c2dec5c153b req-e724292d-fbf5-4743-a3e5-ab3b417bd81b tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 932 time: 0.1564193 Nov 02 12:49:46.026871 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fdb51f43-8565-4d57-b61d-e1ee80fbc202" -d '{"events": [{"name": "network-changed", "server_uuid": "14192166-ce34-4302-a48d-e8543bb6aebd", "tag": "d32b527e-e041-40dd-b3b1-a7c080a56c87"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:49:46.057374 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.provisioning_blocks [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-f50c1143-af2b-4f4d-98bf-aab832c2a8ca service neutron] Transition to ACTIVE for port object 2cf235b6-e4c1-4b00-8971-dbd528d6ad92 will not be triggered until provisioned by entity L2. {{(pid=108543) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 02 12:49:46.093570 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d688a418-93df-4c62-b259-7c2dec5c153b req-a70a5d4c-626e-4bfe-b15c-4c95cb6c449d tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0696554 Nov 02 12:49:46.123909 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-f50c1143-af2b-4f4d-98bf-aab832c2a8ca service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:46.221306 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-ba151fc8-d134-4044-bec1-025d2e344a6f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:46.226606 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-ba151fc8-d134-4044-bec1-025d2e344a6f admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:46.229648 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-ba151fc8-d134-4044-bec1-025d2e344a6f admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/f1245a7d-3d43-432c-9f08-b177373a3697 HTTP/1.1" status: 204 len: 168 time: 0.3500652 Nov 02 12:49:46.233181 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b2f10975-f03d-4666-ad4e-a6d4950199aa req-29914abd-6c2b-42d7-be63-8d5783b83a19 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 210 time: 0.0496678 Nov 02 12:49:46.249800 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba151fc8-d134-4044-bec1-025d2e344a6f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f1245a7d-3d43-432c-9f08-b177373a3697,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:46.252333 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f50c1143-af2b-4f4d-98bf-aab832c2a8ca service neutron] Pushing event updated for resources: {'Port': ['ID=2cf235b6-e4c1-4b00-8971-dbd528d6ad92,revision_number=2']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:46.288258 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-f50c1143-af2b-4f4d-98bf-aab832c2a8ca service neutron] Attempting to bind port 2cf235b6-e4c1-4b00-8971-dbd528d6ad92 on host hv-cinder-81632 for vnic_type normal with profile {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:49:46.288746 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-f50c1143-af2b-4f4d-98bf-aab832c2a8ca service neutron] Attempting to bind port 2cf235b6-e4c1-4b00-8971-dbd528d6ad92 by drivers openvswitch,hyperv on host hv-cinder-81632 at level 0 using segments [{'id': 'db93b928-f362-4483-9a9d-ce7880e2d162', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': 'c965eaf1-5fb6-4689-8b12-fa3913e4f081'}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:49:46.289240 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-f50c1143-af2b-4f4d-98bf-aab832c2a8ca service neutron] Attempting to bind port 2cf235b6-e4c1-4b00-8971-dbd528d6ad92 on network c965eaf1-5fb6-4689-8b12-fa3913e4f081 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:49:46.295392 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-f50c1143-af2b-4f4d-98bf-aab832c2a8ca service neutron] Port 2cf235b6-e4c1-4b00-8971-dbd528d6ad92 on network c965eaf1-5fb6-4689-8b12-fa3913e4f081 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81632 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 02 12:49:46.295900 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-f50c1143-af2b-4f4d-98bf-aab832c2a8ca service neutron] Attempting to bind port 2cf235b6-e4c1-4b00-8971-dbd528d6ad92 on network c965eaf1-5fb6-4689-8b12-fa3913e4f081 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:49:46.307849 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-f50c1143-af2b-4f4d-98bf-aab832c2a8ca service neutron] Checking agent: {'id': '0d57fa42-4660-4f08-b7dc-53a872c3c01c', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81632', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'started_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 49, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:49:46.308418 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-f50c1143-af2b-4f4d-98bf-aab832c2a8ca service neutron] Checking segment: {'id': 'db93b928-f362-4483-9a9d-ce7880e2d162', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': 'c965eaf1-5fb6-4689-8b12-fa3913e4f081'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108543) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:49:46.309015 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-f50c1143-af2b-4f4d-98bf-aab832c2a8ca service neutron] Bound using segment: {'id': 'db93b928-f362-4483-9a9d-ce7880e2d162', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': 'c965eaf1-5fb6-4689-8b12-fa3913e4f081'} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:49:46.310337 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-f50c1143-af2b-4f4d-98bf-aab832c2a8ca service neutron] Bound port: 2cf235b6-e4c1-4b00-8971-dbd528d6ad92, host: hv-cinder-81632, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'db93b928-f362-4483-9a9d-ce7880e2d162', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 884, 'network_id': 'c965eaf1-5fb6-4689-8b12-fa3913e4f081'}}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:49:46.310955 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-f50c1143-af2b-4f4d-98bf-aab832c2a8ca service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:46.405827 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-f50c1143-af2b-4f4d-98bf-aab832c2a8ca service neutron] For port 2cf235b6-e4c1-4b00-8971-dbd528d6ad92, host hv-cinder-81632, cleared binding levels {{(pid=108543) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:49:46.411420 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-f50c1143-af2b-4f4d-98bf-aab832c2a8ca service neutron] For port 2cf235b6-e4c1-4b00-8971-dbd528d6ad92, host hv-cinder-81632, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=2cf235b6-e4c1-4b00-8971-dbd528d6ad92,segment=NetworkSegment(db93b928-f362-4483-9a9d-ce7880e2d162),segment_id=db93b928-f362-4483-9a9d-ce7880e2d162)] {{(pid=108543) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:49:46.507637 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-f50c1143-af2b-4f4d-98bf-aab832c2a8ca service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:46.554448 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 55066) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:46.588827 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-f50c1143-af2b-4f4d-98bf-aab832c2a8ca service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:46.589647 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-f50c1143-af2b-4f4d-98bf-aab832c2a8ca service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:46.591730 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-26ae66c1-8b24-44bb-bf69-d6f2157d5568 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:46.596412 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-f50c1143-af2b-4f4d-98bf-aab832c2a8ca service neutron] 10.222.0.90 "PUT /v2.0/ports/2cf235b6-e4c1-4b00-8971-dbd528d6ad92 HTTP/1.1" status: 200 len: 1094 time: 1.9031169 Nov 02 12:49:46.637586 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 95fa81ee-1b2f-4f18-86a7-90dc0d1aef46 details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 12:49:46.651635 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f50c1143-af2b-4f4d-98bf-aab832c2a8ca service neutron] Pushing event updated for resources: {'Port': ['ID=2cf235b6-e4c1-4b00-8971-dbd528d6ad92,revision_number=3']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:46.765931 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-26ae66c1-8b24-44bb-bf69-d6f2157d5568 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:46.813098 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-318e9ae2-a65e-428b-ba97-a3687486bb5e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:46.818830 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-318e9ae2-a65e-428b-ba97-a3687486bb5e service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=28a90b1659054909ab64ba5320160f74&device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 1097 time: 0.0728681 Nov 02 12:49:46.832827 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-26ae66c1-8b24-44bb-bf69-d6f2157d5568 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:46.945455 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:49:46 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e69b5c99-fcc2-44a0-b389-27f6ba18b4fe x-openstack-request-id: req-e69b5c99-fcc2-44a0-b389-27f6ba18b4fe {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:49:46.945890 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "14192166-ce34-4302-a48d-e8543bb6aebd", "tag": "d32b527e-e041-40dd-b3b1-a7c080a56c87", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:49:46.958047 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-e69b5c99-fcc2-44a0-b389-27f6ba18b4fe {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:49:46.958047 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '14192166-ce34-4302-a48d-e8543bb6aebd', 'tag': 'd32b527e-e041-40dd-b3b1-a7c080a56c87', 'status': 'completed', 'code': 200} Nov 02 12:49:46.958047 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-6afd72b6-45d1-4f6d-8680-6afb69699054 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=2cf235b6-e4c1-4b00-8971-dbd528d6ad92 HTTP/1.1" status: 200 len: 217 time: 0.1233864 Nov 02 12:49:46.958047 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 55078) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:46.958908 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-26ae66c1-8b24-44bb-bf69-d6f2157d5568 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=3290d028000d42d89b33e9329a5e2d51&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4026327 Nov 02 12:49:46.967011 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-26ae66c1-8b24-44bb-bf69-d6f2157d5568 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1074833e-a9a6-4ec4-92c1-b6a933b3b891,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:47.008093 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 95fa81ee-1b2f-4f18-86a7-90dc0d1aef46, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=95fa81ee-1b2f-4f18-86a7-90dc0d1aef46,segment=NetworkSegment(5e5859da-3633-448b-b117-00d1ace2041b),segment_id=5e5859da-3633-448b-b117-00d1ace2041b)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:49:47.024725 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': '95fa81ee-1b2f-4f18-86a7-90dc0d1aef46', 'network_id': '73093621-5f08-4d97-a54e-da0042e8dde7', 'port_id': '95fa81ee-1b2f-4f18-86a7-90dc0d1aef46', 'mac_address': 'fa:16:3e:38:73:e2', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 894, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '4d3908d6-4378-401d-b0c3-b220a11a4a6a', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 12:49:47.079002 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:47.121622 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 95fa81ee-1b2f-4f18-86a7-90dc0d1aef46 {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:49:47.158654 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 95fa81ee-1b2f-4f18-86a7-90dc0d1aef46, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=95fa81ee-1b2f-4f18-86a7-90dc0d1aef46,segment=NetworkSegment(5e5859da-3633-448b-b117-00d1ace2041b),segment_id=5e5859da-3633-448b-b117-00d1ace2041b)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:49:47.174147 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-25d02f9a-c978-47bb-b688-269799faedfc service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:47.174147 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-25d02f9a-c978-47bb-b688-269799faedfc service neutron] 10.222.0.90 "GET /v2.0/subnets?id=b29075d9-9995-4f6f-8ebd-8f7d748977ef HTTP/1.1" status: 200 len: 859 time: 0.1765521 Nov 02 12:49:47.217604 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdb51f43-8565-4d57-b61d-e1ee80fbc202 req-e00315d9-37e6-4d14-ba9e-6b432d977959 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:47.220438 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fdb51f43-8565-4d57-b61d-e1ee80fbc202 req-e00315d9-37e6-4d14-ba9e-6b432d977959 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=28a90b1659054909ab64ba5320160f74&device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 1097 time: 0.2268605 Nov 02 12:49:47.226015 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-19a09e64-1b3d-4272-8f90-d323ada98e9f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:47.242384 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8879096-7e20-4c42-97f3-518581b57a55 req-66d7b4b7-76a0-4065-87c0-921877086ff7 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:47.244913 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f8879096-7e20-4c42-97f3-518581b57a55 req-66d7b4b7-76a0-4065-87c0-921877086ff7 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 944 time: 0.2503202 Nov 02 12:49:47.249510 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:47.300125 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-6a3aad31-f2d6-4e80-96e9-174bd2a7fc71 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=c965eaf1-5fb6-4689-8b12-fa3913e4f081&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1097374 Nov 02 12:49:47.301620 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=95fa81ee-1b2f-4f18-86a7-90dc0d1aef46,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:47.565828 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-19a09e64-1b3d-4272-8f90-d323ada98e9f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:47.592786 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['95fa81ee-1b2f-4f18-86a7-90dc0d1aef46'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:49:47.859521 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f3bff60-b68d-4ad6-9c9a-cab07edc7925 req-ca49e480-f305-44de-b360-3a5fc5b08bf7 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:47.862796 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2f3bff60-b68d-4ad6-9c9a-cab07edc7925 req-ca49e480-f305-44de-b360-3a5fc5b08bf7 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 944 time: 0.6399145 Nov 02 12:49:47.920907 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f8879096-7e20-4c42-97f3-518581b57a55 req-8f003ac1-ac56-4e65-90aa-d7fdcbe2d48b tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/security-groups?id=f69cb03a-7a4d-435f-9600-1ab96756bd18&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6247804 Nov 02 12:49:48.047386 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdb51f43-8565-4d57-b61d-e1ee80fbc202 req-a914d6b8-eb52-436b-b240-262f0cf9fdbd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:48.051455 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fdb51f43-8565-4d57-b61d-e1ee80fbc202 req-a914d6b8-eb52-436b-b240-262f0cf9fdbd service neutron] 10.222.0.90 "GET /v2.0/networks?id=c965eaf1-5fb6-4689-8b12-fa3913e4f081 HTTP/1.1" status: 200 len: 920 time: 0.8048456 Nov 02 12:49:48.056770 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-29ce3b77-1aa5-4a4b-a93a-6f089e746d7d service neutron] 10.222.0.90 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7035713 Nov 02 12:49:48.103905 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2f3bff60-b68d-4ad6-9c9a-cab07edc7925 req-8ad27a19-cfa2-4e2b-abb0-e45a189db9a0 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2099266 Nov 02 12:49:48.229040 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c4554e39-24da-4853-aed5-dc458a68bf3b req-c2731c67-3a1d-4637-b085-b13a4d048b6e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 210 time: 0.1404791 Nov 02 12:49:48.233343 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fdb51f43-8565-4d57-b61d-e1ee80fbc202 req-72df7f21-defe-4e94-a099-55f08140b3fe service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d32b527e-e041-40dd-b3b1-a7c080a56c87 HTTP/1.1" status: 200 len: 217 time: 0.1359940 Nov 02 12:49:48.240984 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-19a09e64-1b3d-4272-8f90-d323ada98e9f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:48.247676 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-19a09e64-1b3d-4272-8f90-d323ada98e9f admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:48.249690 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-19a09e64-1b3d-4272-8f90-d323ada98e9f admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/1074833e-a9a6-4ec4-92c1-b6a933b3b891 HTTP/1.1" status: 204 len: 168 time: 1.2927573 Nov 02 12:49:48.380730 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-05dea7d2-1760-48ab-b49d-8e9255cd58be tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:48.384623 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-05dea7d2-1760-48ab-b49d-8e9255cd58be tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.90 "GET /v2.0/networks?id=c468f0e1-3636-49b9-90c6-b90c643ed7d1 HTTP/1.1" status: 200 len: 816 time: 0.2418449 Nov 02 12:49:48.428049 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19a09e64-1b3d-4272-8f90-d323ada98e9f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1074833e-a9a6-4ec4-92c1-b6a933b3b891,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:48.519700 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdb51f43-8565-4d57-b61d-e1ee80fbc202 req-7467273f-21fb-495d-a5b5-fde97f100e98 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:48.521489 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fdb51f43-8565-4d57-b61d-e1ee80fbc202 req-7467273f-21fb-495d-a5b5-fde97f100e98 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=b29075d9-9995-4f6f-8ebd-8f7d748977ef HTTP/1.1" status: 200 len: 859 time: 0.1909153 Nov 02 12:49:48.530173 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b6cb60ec-2a4d-4811-915a-2f35d7d68c05 req-c208940a-6b1d-424c-bfa8-13bc2952b0c8 service neutron] 10.222.0.90 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.4314239 Nov 02 12:49:48.555938 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-eef3e8b0-20d4-43dd-a7c0-aa2812348424 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.90 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=aaddc046689441b8ab3641f2afd07c0e HTTP/1.1" status: 200 len: 380 time: 0.1606688 Nov 02 12:49:48.573198 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-d208726e-6f48-4cf8-ba42-9ad1cb813ad6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Request body: {'port': {'device_id': '7cc2c649-db32-4af2-b17b-1b744ef40a5f', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'admin_state_up': True, 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'security_groups': ['766f224b-2f11-482d-8950-f06d70b54eae']}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:49:48.581116 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fdb51f43-8565-4d57-b61d-e1ee80fbc202 req-f261bd3f-34cb-465d-aa2d-582aa326b099 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=c965eaf1-5fb6-4689-8b12-fa3913e4f081&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0394104 Nov 02 12:49:48.616155 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device d32b527e-e041-40dd-b3b1-a7c080a56c87 details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 12:49:48.676631 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 95fa81ee-1b2f-4f18-86a7-90dc0d1aef46 up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:49:48.732955 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fdb51f43-8565-4d57-b61d-e1ee80fbc202 req-4397aff9-054c-4f67-a29f-d11ec53eb764 service neutron] 10.222.0.90 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1106794 Nov 02 12:49:48.843623 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-d208726e-6f48-4cf8-ba42-9ad1cb813ad6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Made reservation on behalf of aaddc046689441b8ab3641f2afd07c0e for: {'port': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:49:48.847668 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-d208726e-6f48-4cf8-ba42-9ad1cb813ad6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:48.878480 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fdb51f43-8565-4d57-b61d-e1ee80fbc202 req-2e806ac8-70f1-4ac3-88ec-cf0df15ed162 service neutron] 10.222.0.90 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1304526 Nov 02 12:49:48.928419 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port d32b527e-e041-40dd-b3b1-a7c080a56c87, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=d32b527e-e041-40dd-b3b1-a7c080a56c87,segment=NetworkSegment(db93b928-f362-4483-9a9d-ce7880e2d162),segment_id=db93b928-f362-4483-9a9d-ce7880e2d162)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:49:48.951613 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '96a98d45-ba9a-48b2-a608-9596dc5a2988', 'tag': '2cf235b6-e4c1-4b00-8971-dbd528d6ad92'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:49:48.954441 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4a3ce481-4c0f-4a56-9743-0f1cc7ebe8ff" -d '{"events": [{"name": "network-changed", "server_uuid": "96a98d45-ba9a-48b2-a608-9596dc5a2988", "tag": "2cf235b6-e4c1-4b00-8971-dbd528d6ad92"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:49:48.962309 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': 'd32b527e-e041-40dd-b3b1-a7c080a56c87', 'network_id': 'c965eaf1-5fb6-4689-8b12-fa3913e4f081', 'port_id': 'd32b527e-e041-40dd-b3b1-a7c080a56c87', 'mac_address': 'fa:16:3e:96:e7:bd', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 884, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b29075d9-9995-4f6f-8ebd-8f7d748977ef', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 12:49:48.969095 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning for port 95fa81ee-1b2f-4f18-86a7-90dc0d1aef46 completed by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 02 12:49:48.980348 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port 95fa81ee-1b2f-4f18-86a7-90dc0d1aef46 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:49:48.980719 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:49.081225 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_common [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-d208726e-6f48-4cf8-ba42-9ad1cb813ad6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Allocated IP 172.20.0.9 (c468f0e1-3636-49b9-90c6-b90c643ed7d1/ec48fe57-a1cd-4e7c-874f-073624f71f4b/bf7c4605-4045-4117-af22-08d75129b835) {{(pid=108542) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:49:49.090278 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:49.175381 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id d32b527e-e041-40dd-b3b1-a7c080a56c87 {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:49:49.210427 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:49.299470 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port d32b527e-e041-40dd-b3b1-a7c080a56c87, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=d32b527e-e041-40dd-b3b1-a7c080a56c87,segment=NetworkSegment(db93b928-f362-4483-9a9d-ce7880e2d162),segment_id=db93b928-f362-4483-9a9d-ce7880e2d162)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:49:49.325919 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b5f68f82-f48c-4ddc-9588-64082e35c753', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '95fa81ee-1b2f-4f18-86a7-90dc0d1aef46'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:49:49.403193 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:49:48 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a0e01046-83f8-49ae-b936-bf7c5f5356db x-openstack-request-id: req-a0e01046-83f8-49ae-b936-bf7c5f5356db {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:49:49.403408 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "96a98d45-ba9a-48b2-a608-9596dc5a2988", "tag": "2cf235b6-e4c1-4b00-8971-dbd528d6ad92", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:49:49.404343 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-a0e01046-83f8-49ae-b936-bf7c5f5356db {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:49:49.404748 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '96a98d45-ba9a-48b2-a608-9596dc5a2988', 'tag': '2cf235b6-e4c1-4b00-8971-dbd528d6ad92', 'status': 'completed', 'code': 200} Nov 02 12:49:49.434668 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-d208726e-6f48-4cf8-ba42-9ad1cb813ad6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for port, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:49.517180 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-471ddc4e-f3d1-4cec-b506-f4e8a3763a86 req-e2c23431-c31c-4e5f-bb07-1856d7e0f74c tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:49.519839 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-471ddc4e-f3d1-4cec-b506-f4e8a3763a86 req-e2c23431-c31c-4e5f-bb07-1856d7e0f74c tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 945 time: 0.4817200 Nov 02 12:49:49.526646 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a3ce481-4c0f-4a56-9743-0f1cc7ebe8ff req-c583d897-b436-4996-b1db-951cdeeb0108 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:49.528585 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4a3ce481-4c0f-4a56-9743-0f1cc7ebe8ff req-c583d897-b436-4996-b1db-951cdeeb0108 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=28a90b1659054909ab64ba5320160f74&device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 1097 time: 0.1616755 Nov 02 12:49:49.559526 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:49.572823 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 95fa81ee-1b2f-4f18-86a7-90dc0d1aef46, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=95fa81ee-1b2f-4f18-86a7-90dc0d1aef46,segment=NetworkSegment(5e5859da-3633-448b-b117-00d1ace2041b),segment_id=5e5859da-3633-448b-b117-00d1ace2041b)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:49:49.604163 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-594cbc82-0128-4606-9128-9264d1e88a2b req-11f576e1-712d-43cc-bb02-e33a3a02cb57 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:49.606065 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-594cbc82-0128-4606-9128-9264d1e88a2b req-11f576e1-712d-43cc-bb02-e33a3a02cb57 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 944 time: 0.2403376 Nov 02 12:49:49.613709 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-d208726e-6f48-4cf8-ba42-9ad1cb813ad6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:49.651757 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:49.693220 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-471ddc4e-f3d1-4cec-b506-f4e8a3763a86 req-f84f3de7-6249-4a67-930c-3f48107bc509 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/security-groups?id=f69cb03a-7a4d-435f-9600-1ab96756bd18&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1630578 Nov 02 12:49:49.696129 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=d32b527e-e041-40dd-b3b1-a7c080a56c87,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:49.797921 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-594cbc82-0128-4606-9128-9264d1e88a2b req-aac68866-1747-45a6-aef5-8525ceea1894 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1377347 Nov 02 12:49:49.835807 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=95fa81ee-1b2f-4f18-86a7-90dc0d1aef46,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:49.884201 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['d32b527e-e041-40dd-b3b1-a7c080a56c87'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:49:49.901580 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a3ce481-4c0f-4a56-9743-0f1cc7ebe8ff req-b8b23fa4-ae60-4de9-8032-df744c95f2df service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:49.903190 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4a3ce481-4c0f-4a56-9743-0f1cc7ebe8ff req-b8b23fa4-ae60-4de9-8032-df744c95f2df service neutron] 10.222.0.90 "GET /v2.0/networks?id=c965eaf1-5fb6-4689-8b12-fa3913e4f081 HTTP/1.1" status: 200 len: 920 time: 0.3311336 Nov 02 12:49:50.012322 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4a3ce481-4c0f-4a56-9743-0f1cc7ebe8ff req-aadbbddd-30a0-4222-9635-c55f8ee73751 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=2cf235b6-e4c1-4b00-8971-dbd528d6ad92 HTTP/1.1" status: 200 len: 217 time: 0.0936232 Nov 02 12:49:50.021438 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d208726e-6f48-4cf8-ba42-9ad1cb813ad6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Pushing event updated for resources: {'Port': ['ID=bf7c4605-4045-4117-af22-08d75129b835,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:50.032462 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-d208726e-6f48-4cf8-ba42-9ad1cb813ad6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Network c468f0e1-3636-49b9-90c6-b90c643ed7d1 is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:49:50.032462 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-d208726e-6f48-4cf8-ba42-9ad1cb813ad6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:49:50.037518 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-d208726e-6f48-4cf8-ba42-9ad1cb813ad6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Received port after_create {{(pid=108542) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:49:50.090837 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e369b16-8f12-40e1-abf7-9de32f725744 req-c300f9b6-d9f8-4467-a4b0-f0ea753d8359 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:50.093028 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4e369b16-8f12-40e1-abf7-9de32f725744 req-c300f9b6-d9f8-4467-a4b0-f0ea753d8359 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 931 time: 0.2572484 Nov 02 12:49:50.180712 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-d208726e-6f48-4cf8-ba42-9ad1cb813ad6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:50.183346 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-d208726e-6f48-4cf8-ba42-9ad1cb813ad6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for port, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:50.197341 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-052ec9ff-5a2b-4869-9bc4-221a4fa418d8" -d '{"events": [{"server_uuid": "b5f68f82-f48c-4ddc-9588-64082e35c753", "name": "network-vif-plugged", "status": "completed", "tag": "95fa81ee-1b2f-4f18-86a7-90dc0d1aef46"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:49:50.218572 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4a3ce481-4c0f-4a56-9743-0f1cc7ebe8ff req-61d15aa3-f39e-4ac9-b5cd-8be3c028f656 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:50.220156 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4a3ce481-4c0f-4a56-9743-0f1cc7ebe8ff req-61d15aa3-f39e-4ac9-b5cd-8be3c028f656 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=b29075d9-9995-4f6f-8ebd-8f7d748977ef HTTP/1.1" status: 200 len: 859 time: 0.1955447 Nov 02 12:49:50.276067 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4e369b16-8f12-40e1-abf7-9de32f725744 req-eb71863f-a89c-4fc7-879c-20b2bf3cfa63 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1753604 Nov 02 12:49:50.291806 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-d208726e-6f48-4cf8-ba42-9ad1cb813ad6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.7226248 Nov 02 12:49:50.305462 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-918d625a-a52c-4feb-8dec-00a1636949fa service neutron] Request body: {'port': {'device_id': '7cc2c649-db32-4af2-b17b-1b744ef40a5f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81632'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:49:50.309006 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4a3ce481-4c0f-4a56-9743-0f1cc7ebe8ff req-9bcdb9ef-8f6c-41b8-b432-9faddc297543 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=c965eaf1-5fb6-4689-8b12-fa3913e4f081&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0763652 Nov 02 12:49:50.374148 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-918d625a-a52c-4feb-8dec-00a1636949fa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:50.417486 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4a3ce481-4c0f-4a56-9743-0f1cc7ebe8ff req-295c22cc-ef0e-4065-8eae-1bd77b44ba25 service neutron] 10.222.0.90 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1010048 Nov 02 12:49:50.444638 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-0db7a05c-d50f-4346-8a84-11a576bcc4e5 None None] Provisioning complete for port bf7c4605-4045-4117-af22-08d75129b835 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:49:50.445820 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0db7a05c-d50f-4346-8a84-11a576bcc4e5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:50.512777 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-0db7a05c-d50f-4346-8a84-11a576bcc4e5 None None] Port bf7c4605-4045-4117-af22-08d75129b835 cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:49:50.581384 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4a3ce481-4c0f-4a56-9743-0f1cc7ebe8ff req-5ffa321e-e0a8-4194-a8cb-92d96076868c service neutron] 10.222.0.90 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1554811 Nov 02 12:49:50.613223 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 2cf235b6-e4c1-4b00-8971-dbd528d6ad92 details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 12:49:50.747052 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:49:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-12adf64a-4fef-4cc0-90d0-23a8c34092f3 x-openstack-request-id: req-12adf64a-4fef-4cc0-90d0-23a8c34092f3 {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:49:50.748450 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b5f68f82-f48c-4ddc-9588-64082e35c753", "name": "network-vif-plugged", "status": "completed", "tag": "95fa81ee-1b2f-4f18-86a7-90dc0d1aef46", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:49:50.748796 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-12adf64a-4fef-4cc0-90d0-23a8c34092f3 {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:49:50.749410 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b5f68f82-f48c-4ddc-9588-64082e35c753', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '95fa81ee-1b2f-4f18-86a7-90dc0d1aef46', 'code': 200} Nov 02 12:49:50.837065 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.notifiers.nova [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-918d625a-a52c-4feb-8dec-00a1636949fa service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id bf7c4605-4045-4117-af22-08d75129b835 {{(pid=108542) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:49:50.850362 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-918d625a-a52c-4feb-8dec-00a1636949fa service neutron] Publish callbacks [] for port, precommit_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:50.868001 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.provisioning_blocks [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-918d625a-a52c-4feb-8dec-00a1636949fa service neutron] Transition to ACTIVE for port object bf7c4605-4045-4117-af22-08d75129b835 will not be triggered until provisioned by entity L2. {{(pid=108542) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 02 12:49:50.876026 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 2cf235b6-e4c1-4b00-8971-dbd528d6ad92, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=2cf235b6-e4c1-4b00-8971-dbd528d6ad92,segment=NetworkSegment(db93b928-f362-4483-9a9d-ce7880e2d162),segment_id=db93b928-f362-4483-9a9d-ce7880e2d162)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:49:50.887222 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54b3da60-af3a-4e73-8c51-dd8c0f79d832 req-67130130-73b9-4bf9-8825-b6b195a40337 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:50.890985 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-54b3da60-af3a-4e73-8c51-dd8c0f79d832 req-67130130-73b9-4bf9-8825-b6b195a40337 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 946 time: 0.0620730 Nov 02 12:49:50.975650 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-918d625a-a52c-4feb-8dec-00a1636949fa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126476609'] for port, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:50.985198 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-54b3da60-af3a-4e73-8c51-dd8c0f79d832 req-591dbfde-0004-4945-bc4b-89f929a78528 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/security-groups?id=f69cb03a-7a4d-435f-9600-1ab96756bd18&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0890975 Nov 02 12:49:51.010601 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': '2cf235b6-e4c1-4b00-8971-dbd528d6ad92', 'network_id': 'c965eaf1-5fb6-4689-8b12-fa3913e4f081', 'port_id': '2cf235b6-e4c1-4b00-8971-dbd528d6ad92', 'mac_address': 'fa:16:3e:6e:9a:8f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 884, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'b29075d9-9995-4f6f-8ebd-8f7d748977ef', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 12:49:51.026675 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b030690-c403-4f85-916d-d61f3e9d64d1 req-aa180f04-cf3e-4d26-94d9-f8a36bb11767 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:51.029193 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3b030690-c403-4f85-916d-d61f3e9d64d1 req-aa180f04-cf3e-4d26-94d9-f8a36bb11767 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 944 time: 0.1178281 Nov 02 12:49:51.086884 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:51.109355 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 2cf235b6-e4c1-4b00-8971-dbd528d6ad92 {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:49:51.110689 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-918d625a-a52c-4feb-8dec-00a1636949fa service neutron] Pushing event updated for resources: {'Port': ['ID=bf7c4605-4045-4117-af22-08d75129b835,revision_number=2']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:51.137837 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 2cf235b6-e4c1-4b00-8971-dbd528d6ad92, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=2cf235b6-e4c1-4b00-8971-dbd528d6ad92,segment=NetworkSegment(db93b928-f362-4483-9a9d-ce7880e2d162),segment_id=db93b928-f362-4483-9a9d-ce7880e2d162)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:49:51.153254 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3b030690-c403-4f85-916d-d61f3e9d64d1 req-0e64e513-aad2-4120-8d50-83a71c4b7fa9 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1157720 Nov 02 12:49:51.220622 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:51.270921 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.managers [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-918d625a-a52c-4feb-8dec-00a1636949fa service neutron] Attempting to bind port bf7c4605-4045-4117-af22-08d75129b835 on host hv-cinder-81632 for vnic_type normal with profile {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:49:51.271260 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.managers [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-918d625a-a52c-4feb-8dec-00a1636949fa service neutron] Attempting to bind port bf7c4605-4045-4117-af22-08d75129b835 by drivers openvswitch,hyperv on host hv-cinder-81632 at level 0 using segments [{'id': 'b2bc3e69-86f7-4524-92d5-933aa81f8f2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1'}] {{(pid=108542) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:49:51.271592 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-918d625a-a52c-4feb-8dec-00a1636949fa service neutron] Attempting to bind port bf7c4605-4045-4117-af22-08d75129b835 on network c468f0e1-3636-49b9-90c6-b90c643ed7d1 {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:49:51.287163 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-918d625a-a52c-4feb-8dec-00a1636949fa service neutron] Port bf7c4605-4045-4117-af22-08d75129b835 on network c468f0e1-3636-49b9-90c6-b90c643ed7d1 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81632 {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 02 12:49:51.287549 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-918d625a-a52c-4feb-8dec-00a1636949fa service neutron] Attempting to bind port bf7c4605-4045-4117-af22-08d75129b835 on network c468f0e1-3636-49b9-90c6-b90c643ed7d1 {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:49:51.300474 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=2cf235b6-e4c1-4b00-8971-dbd528d6ad92,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:51.305119 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-918d625a-a52c-4feb-8dec-00a1636949fa service neutron] Checking agent: {'id': '0d57fa42-4660-4f08-b7dc-53a872c3c01c', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81632', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'started_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 49, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:49:51.305458 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-918d625a-a52c-4feb-8dec-00a1636949fa service neutron] Checking segment: {'id': 'b2bc3e69-86f7-4524-92d5-933aa81f8f2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108542) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:49:51.309509 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-918d625a-a52c-4feb-8dec-00a1636949fa service neutron] Bound using segment: {'id': 'b2bc3e69-86f7-4524-92d5-933aa81f8f2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1'} {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:49:51.313874 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.managers [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-918d625a-a52c-4feb-8dec-00a1636949fa service neutron] Bound port: bf7c4605-4045-4117-af22-08d75129b835, host: hv-cinder-81632, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b2bc3e69-86f7-4524-92d5-933aa81f8f2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1'}}] {{(pid=108542) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:49:51.314470 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-918d625a-a52c-4feb-8dec-00a1636949fa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:51.370149 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d722ddaf-0c9e-4a77-8862-534e79aefeeb req-2fa3f114-6007-4b84-9073-c267ca913680 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:51.373396 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d722ddaf-0c9e-4a77-8862-534e79aefeeb req-2fa3f114-6007-4b84-9073-c267ca913680 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 1099 time: 0.2021298 Nov 02 12:49:51.425485 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-d722ddaf-0c9e-4a77-8862-534e79aefeeb req-236a2674-aac7-4f55-a897-44c495ca2fcb service neutron] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:51.504791 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['2cf235b6-e4c1-4b00-8971-dbd528d6ad92'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:49:51.574645 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-918d625a-a52c-4feb-8dec-00a1636949fa service neutron] For port bf7c4605-4045-4117-af22-08d75129b835, host hv-cinder-81632, cleared binding levels {{(pid=108542) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:49:51.581523 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-918d625a-a52c-4feb-8dec-00a1636949fa service neutron] For port bf7c4605-4045-4117-af22-08d75129b835, host hv-cinder-81632, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=bf7c4605-4045-4117-af22-08d75129b835,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108542) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:49:51.660910 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-918d625a-a52c-4feb-8dec-00a1636949fa service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126476609'] for port, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:51.743622 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-918d625a-a52c-4feb-8dec-00a1636949fa service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:51.744858 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-918d625a-a52c-4feb-8dec-00a1636949fa service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for port, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:51.749770 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-918d625a-a52c-4feb-8dec-00a1636949fa service neutron] 10.222.0.90 "PUT /v2.0/ports/bf7c4605-4045-4117-af22-08d75129b835 HTTP/1.1" status: 200 len: 1093 time: 1.4494574 Nov 02 12:49:51.756656 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7cc2c649-db32-4af2-b17b-1b744ef40a5f', 'tag': 'bf7c4605-4045-4117-af22-08d75129b835'}] {{(pid=108542) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:49:51.759177 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8fdc2194739644bb754d6b187539f80d2eba7dc5c5d5392f1a2d22d03c0a316c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7db4aabb-dacf-41be-9075-460dba149132" -d '{"events": [{"name": "network-changed", "server_uuid": "7cc2c649-db32-4af2-b17b-1b744ef40a5f", "tag": "bf7c4605-4045-4117-af22-08d75129b835"}]}' {{(pid=108542) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:49:51.804841 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ceafa7a1-f4b6-446b-8db6-c54aba1bb000 req-c85c82b9-a9b5-4d71-b459-64bd518b78c1 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:51.806457 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ceafa7a1-f4b6-446b-8db6-c54aba1bb000 req-c85c82b9-a9b5-4d71-b459-64bd518b78c1 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.2530458 Nov 02 12:49:51.811749 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-d722ddaf-0c9e-4a77-8862-534e79aefeeb req-236a2674-aac7-4f55-a897-44c495ca2fcb service neutron] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:51.852742 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-918d625a-a52c-4feb-8dec-00a1636949fa service neutron] Pushing event updated for resources: {'Port': ['ID=bf7c4605-4045-4117-af22-08d75129b835,revision_number=3']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:51.858050 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:49:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c8ae8193-08a6-4eba-b843-3812147be03a x-openstack-request-id: req-c8ae8193-08a6-4eba-b843-3812147be03a {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:49:51.860691 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7cc2c649-db32-4af2-b17b-1b744ef40a5f", "tag": "bf7c4605-4045-4117-af22-08d75129b835", "status": "completed", "code": 200}]} {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:49:51.861590 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-c8ae8193-08a6-4eba-b843-3812147be03a {{(pid=108542) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:49:51.862675 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7cc2c649-db32-4af2-b17b-1b744ef40a5f', 'tag': 'bf7c4605-4045-4117-af22-08d75129b835', 'status': 'completed', 'code': 200} Nov 02 12:49:51.879642 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ceafa7a1-f4b6-446b-8db6-c54aba1bb000 req-72dd5b8c-1f28-4e3a-866a-9acd5bfa4b5e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0607481 Nov 02 12:49:51.881159 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-d722ddaf-0c9e-4a77-8862-534e79aefeeb req-236a2674-aac7-4f55-a897-44c495ca2fcb service neutron] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:51.980762 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d722ddaf-0c9e-4a77-8862-534e79aefeeb req-236a2674-aac7-4f55-a897-44c495ca2fcb service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=f69cb03a-7a4d-435f-9600-1ab96756bd18&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5814567 Nov 02 12:49:51.981652 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-236a2674-aac7-4f55-a897-44c495ca2fcb service neutron] Pushing event updated for resources: {'SecurityGroup': ['ID=e894d481-c072-4e45-94c4-0ed6d2a2fd1e,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:51.986529 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7db4aabb-dacf-41be-9075-460dba149132 req-ddcdd701-683f-4aaf-bb45-da9bc0782d69 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:51.988272 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-7db4aabb-dacf-41be-9075-460dba149132 req-ddcdd701-683f-4aaf-bb45-da9bc0782d69 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=aaddc046689441b8ab3641f2afd07c0e&device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 1096 time: 0.0856221 Nov 02 12:49:52.236548 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-651e4287-88dd-400e-9060-0e7d98769fd7 req-ddd75d03-6238-432c-8396-8bc13ff3f2a9 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:52.239774 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-651e4287-88dd-400e-9060-0e7d98769fd7 req-ddd75d03-6238-432c-8396-8bc13ff3f2a9 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 946 time: 0.1173031 Nov 02 12:49:52.345743 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-651e4287-88dd-400e-9060-0e7d98769fd7 req-4c3f3197-b371-4f34-980f-15660e1fd0f3 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/security-groups?id=f69cb03a-7a4d-435f-9600-1ab96756bd18&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0989406 Nov 02 12:49:52.361366 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1d8a7dd2-954e-4e9f-bf03-6a9fc9809307 req-1b0b14e3-638c-4961-b28e-771fdb8fcf99 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:52.362922 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1d8a7dd2-954e-4e9f-bf03-6a9fc9809307 req-1b0b14e3-638c-4961-b28e-771fdb8fcf99 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 945 time: 0.0954268 Nov 02 12:49:52.424237 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1d8a7dd2-954e-4e9f-bf03-6a9fc9809307 req-a329298e-ce55-40e2-ae8d-18f18776b32a tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0525115 Nov 02 12:49:52.499293 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7db4aabb-dacf-41be-9075-460dba149132 req-ba540048-7fe5-40b3-a5fa-c948131ffc99 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:52.500928 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-7db4aabb-dacf-41be-9075-460dba149132 req-ba540048-7fe5-40b3-a5fa-c948131ffc99 service neutron] 10.222.0.90 "GET /v2.0/networks?tenant_id=aaddc046689441b8ab3641f2afd07c0e&shared=False HTTP/1.1" status: 200 len: 917 time: 0.2821527 Nov 02 12:49:52.630809 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 2cf235b6-e4c1-4b00-8971-dbd528d6ad92 up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:49:52.721997 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7db4aabb-dacf-41be-9075-460dba149132 req-9b7d40b9-a675-4833-ae8a-20a3fa729a27 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:52.723935 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-7db4aabb-dacf-41be-9075-460dba149132 req-9b7d40b9-a675-4833-ae8a-20a3fa729a27 service neutron] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.2116420 Nov 02 12:49:52.803364 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning for port 2cf235b6-e4c1-4b00-8971-dbd528d6ad92 completed by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 02 12:49:52.809043 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port 2cf235b6-e4c1-4b00-8971-dbd528d6ad92 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:49:52.809475 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:52.824940 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-4394c4a7-135b-476d-9edf-99caa1fc0b7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:52.827292 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-4394c4a7-135b-476d-9edf-99caa1fc0b7a service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=aaddc046689441b8ab3641f2afd07c0e&device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 1096 time: 0.0572801 Nov 02 12:49:52.866999 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 55302) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:52.913261 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:52.944242 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '96a98d45-ba9a-48b2-a608-9596dc5a2988', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2cf235b6-e4c1-4b00-8971-dbd528d6ad92'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:49:52.946834 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-49ad36c5-a02c-4375-b3f6-1c02ebd12387" -d '{"events": [{"server_uuid": "96a98d45-ba9a-48b2-a608-9596dc5a2988", "name": "network-vif-plugged", "status": "completed", "tag": "2cf235b6-e4c1-4b00-8971-dbd528d6ad92"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:49:52.954359 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-f769d415-8408-4c81-9eae-89f7d7c9becb service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=bf7c4605-4045-4117-af22-08d75129b835 HTTP/1.1" status: 200 len: 217 time: 0.1130180 Nov 02 12:49:52.962445 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 2cf235b6-e4c1-4b00-8971-dbd528d6ad92, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=2cf235b6-e4c1-4b00-8971-dbd528d6ad92,segment=NetworkSegment(db93b928-f362-4483-9a9d-ce7880e2d162),segment_id=db93b928-f362-4483-9a9d-ce7880e2d162)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:49:53.042549 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:49:52 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4d824599-5ce1-439b-88e8-85588ecf523f x-openstack-request-id: req-4d824599-5ce1-439b-88e8-85588ecf523f {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:49:53.042891 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "96a98d45-ba9a-48b2-a608-9596dc5a2988", "name": "network-vif-plugged", "status": "completed", "tag": "2cf235b6-e4c1-4b00-8971-dbd528d6ad92", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:49:53.043143 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-4d824599-5ce1-439b-88e8-85588ecf523f {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:49:53.043559 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '96a98d45-ba9a-48b2-a608-9596dc5a2988', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '2cf235b6-e4c1-4b00-8971-dbd528d6ad92', 'code': 200} Nov 02 12:49:53.045288 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:53.046072 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device d32b527e-e041-40dd-b3b1-a7c080a56c87 up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:49:53.113002 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-2c06eb26-2bbb-438b-840c-804d19980750 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:53.114576 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-2c06eb26-2bbb-438b-840c-804d19980750 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=ec48fe57-a1cd-4e7c-874f-073624f71f4b HTTP/1.1" status: 200 len: 855 time: 0.1463594 Nov 02 12:49:53.168784 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f53c058c-2865-43b0-aece-24b413475672 req-3f40fbd2-a4c6-403f-8cf7-d1ebce329fcc tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:53.177672 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f53c058c-2865-43b0-aece-24b413475672 req-3f40fbd2-a4c6-403f-8cf7-d1ebce329fcc tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.1434371 Nov 02 12:49:53.208181 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=2cf235b6-e4c1-4b00-8971-dbd528d6ad92,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:53.222006 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-8d103397-aee8-4c20-a807-a8cd4383c348 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:53.224649 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-8d103397-aee8-4c20-a807-a8cd4383c348 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=c468f0e1-3636-49b9-90c6-b90c643ed7d1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0992768 Nov 02 12:49:53.279111 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-39eb9383-1798-4b99-8e82-95a9f5eacbbe admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:53.285098 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning for port d32b527e-e041-40dd-b3b1-a7c080a56c87 completed by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 02 12:49:53.303557 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port d32b527e-e041-40dd-b3b1-a7c080a56c87 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:49:53.303557 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:53.317766 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f53c058c-2865-43b0-aece-24b413475672 req-65966767-45e9-4c0c-bf03-5e1dac8dd5ab tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1317410 Nov 02 12:49:53.382244 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-38d6d00a-49d2-47f4-9680-8433bd550be4 service neutron] 10.222.0.90 "GET /v2.0/networks/c468f0e1-3636-49b9-90c6-b90c643ed7d1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1441612 Nov 02 12:49:53.426306 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-39eb9383-1798-4b99-8e82-95a9f5eacbbe admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:53.510149 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-986a66d8-cc29-4657-96f0-fac097dcf7df None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:53.522899 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:53.565021 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-39eb9383-1798-4b99-8e82-95a9f5eacbbe admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:53.570322 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port d32b527e-e041-40dd-b3b1-a7c080a56c87, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=d32b527e-e041-40dd-b3b1-a7c080a56c87,segment=NetworkSegment(db93b928-f362-4483-9a9d-ce7880e2d162),segment_id=db93b928-f362-4483-9a9d-ce7880e2d162)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:49:53.572056 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-fcdf695c-b1c4-4b61-8793-cff8f68b1861 req-f80bb9ed-7a6b-4d8d-96fe-9b081b98303d service neutron] 10.222.0.90 "GET /v2.0/networks/c468f0e1-3636-49b9-90c6-b90c643ed7d1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1822445 Nov 02 12:49:53.667435 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:53.668866 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-39eb9383-1798-4b99-8e82-95a9f5eacbbe admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=776b588dde74451a9372ebbe5de6c23c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7999611 Nov 02 12:49:53.670859 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39eb9383-1798-4b99-8e82-95a9f5eacbbe admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4d49a43e-f71a-4b27-8379-44c7e34355e9,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:53.671726 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 55360) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:53.680055 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60ddaa77-16aa-4d47-b700-0a5acf103139 req-8a5215b4-bafa-42fb-9ce9-ad380ce58e83 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:53.681499 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-60ddaa77-16aa-4d47-b700-0a5acf103139 req-8a5215b4-bafa-42fb-9ce9-ad380ce58e83 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 1099 time: 0.1812401 Nov 02 12:49:53.691165 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49b1a37c-e070-4717-a0bb-ea33cb808b8a req-d3c7134e-98d6-4e20-b247-6cbcee652b5b tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:53.698846 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-49b1a37c-e070-4717-a0bb-ea33cb808b8a req-d3c7134e-98d6-4e20-b247-6cbcee652b5b tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 946 time: 0.2514501 Nov 02 12:49:53.739367 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3e845c1-baf9-4f36-9707-4d7cb8fee6b6 req-f5d423cf-dcc4-44a8-a5e1-0763eba79f47 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:53.748197 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e3e845c1-baf9-4f36-9707-4d7cb8fee6b6 req-f5d423cf-dcc4-44a8-a5e1-0763eba79f47 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.1875396 Nov 02 12:49:53.767856 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=d32b527e-e041-40dd-b3b1-a7c080a56c87,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:53.781012 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-65713a15-5945-4b3b-bb2f-834d0604ab65 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:53.825934 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-65713a15-5945-4b3b-bb2f-834d0604ab65 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:53.832085 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-60ddaa77-16aa-4d47-b700-0a5acf103139 req-a5289e4e-63e1-4309-bb2d-27a3666746a2 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1293719 Nov 02 12:49:53.850661 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-49b1a37c-e070-4717-a0bb-ea33cb808b8a req-8bac033a-50fd-4a3a-9b8b-135329719b1a tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/security-groups?id=f69cb03a-7a4d-435f-9600-1ab96756bd18&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1507919 Nov 02 12:49:53.866983 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e3e845c1-baf9-4f36-9707-4d7cb8fee6b6 req-abf88324-ad8e-421e-8063-3047821ad7d9 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1138062 Nov 02 12:49:53.991772 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-65713a15-5945-4b3b-bb2f-834d0604ab65 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:53.994503 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-65713a15-5945-4b3b-bb2f-834d0604ab65 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:53.998758 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-65713a15-5945-4b3b-bb2f-834d0604ab65 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/4d49a43e-f71a-4b27-8379-44c7e34355e9 HTTP/1.1" status: 204 len: 168 time: 0.3227463 Nov 02 12:49:54.004201 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-65713a15-5945-4b3b-bb2f-834d0604ab65 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4d49a43e-f71a-4b27-8379-44c7e34355e9,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:54.496528 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ee09fff-83ab-4d6a-b983-65a07ce0b4f9 req-ea99ba23-ebec-47e5-8d3a-176922f44c50 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:54.498945 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6ee09fff-83ab-4d6a-b983-65a07ce0b4f9 req-ea99ba23-ebec-47e5-8d3a-176922f44c50 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.0598402 Nov 02 12:49:54.557969 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6ee09fff-83ab-4d6a-b983-65a07ce0b4f9 req-d1f8d0ea-65c7-4f37-ab3b-c76399a758a9 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0531917 Nov 02 12:49:54.959035 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 55400) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:54.969718 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 55404) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:55.017130 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-9c14e950-10c6-45b7-8106-bc80162db17d admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:55.045452 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '14192166-ce34-4302-a48d-e8543bb6aebd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd32b527e-e041-40dd-b3b1-a7c080a56c87'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:49:55.049632 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e1f41250-43ce-44d5-858e-65e1c30b08d2" -d '{"events": [{"server_uuid": "14192166-ce34-4302-a48d-e8543bb6aebd", "name": "network-vif-plugged", "status": "completed", "tag": "d32b527e-e041-40dd-b3b1-a7c080a56c87"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:49:55.147516 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f66f0224-6246-4cb7-85a3-1aaf5989951d req-2641016a-7a0f-4f29-a493-02eed8923dde tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:55.149017 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f66f0224-6246-4cb7-85a3-1aaf5989951d req-2641016a-7a0f-4f29-a493-02eed8923dde tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 946 time: 0.1331818 Nov 02 12:49:55.163038 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-681faf76-5912-489a-b44b-2361719f383e req-3d784063-e200-450c-8440-b082978d0e16 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:55.164698 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-681faf76-5912-489a-b44b-2361719f383e req-3d784063-e200-450c-8440-b082978d0e16 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.1112456 Nov 02 12:49:55.284332 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f66f0224-6246-4cb7-85a3-1aaf5989951d req-0dbb9942-b43d-495d-b24a-5908648f778c tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/security-groups?id=f69cb03a-7a4d-435f-9600-1ab96756bd18&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1185694 Nov 02 12:49:55.297745 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d7b00778-0278-489f-9c6a-f1c2f06b4a89 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:55.304890 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-681faf76-5912-489a-b44b-2361719f383e req-8a83c6da-b2ca-44e2-bb12-18b92b8858a3 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1242189 Nov 02 12:49:55.310913 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-9c14e950-10c6-45b7-8106-bc80162db17d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:55.391028 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:49:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ad6c6e5d-ba81-4d48-9582-299bdbea6c9a x-openstack-request-id: req-ad6c6e5d-ba81-4d48-9582-299bdbea6c9a {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:49:55.391377 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "14192166-ce34-4302-a48d-e8543bb6aebd", "name": "network-vif-plugged", "status": "completed", "tag": "d32b527e-e041-40dd-b3b1-a7c080a56c87", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:49:55.391817 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-ad6c6e5d-ba81-4d48-9582-299bdbea6c9a {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:49:55.392211 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '14192166-ce34-4302-a48d-e8543bb6aebd', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'd32b527e-e041-40dd-b3b1-a7c080a56c87', 'code': 200} Nov 02 12:49:55.407285 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d7b00778-0278-489f-9c6a-f1c2f06b4a89 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:55.471709 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-9c14e950-10c6-45b7-8106-bc80162db17d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:55.511475 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-9c14e950-10c6-45b7-8106-bc80162db17d admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=ea6e30c20e8440b6b81c88676e85eabb&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5404971 Nov 02 12:49:55.512313 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9c14e950-10c6-45b7-8106-bc80162db17d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=34ac31e2-7a9e-47dd-966c-6183d7fca55b,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:55.514710 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 55420) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:55.528583 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d7b00778-0278-489f-9c6a-f1c2f06b4a89 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:55.573355 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-d7b00778-0278-489f-9c6a-f1c2f06b4a89 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=cbb776990f374e27b7ab8d9582de4516&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6124780 Nov 02 12:49:55.574309 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7b00778-0278-489f-9c6a-f1c2f06b4a89 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=be43184d-3c2c-4e2f-b6b8-ce1e2d19ac96,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:55.576730 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 55424) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:55.582259 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d53fcbb2-a03e-4185-b4c9-c603720f1ed2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:55.614441 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d53fcbb2-a03e-4185-b4c9-c603720f1ed2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:55.632216 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-82f1c72e-bdfb-4a83-a747-9f25c4c2cc52 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:55.660394 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-448b68d4-48a3-4745-b196-6c2da549307c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:55.689415 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-448b68d4-48a3-4745-b196-6c2da549307c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:55.713980 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dcaca73-8f39-4262-990a-ab038e6a8096 req-52381a33-de45-42d1-8e1d-c225b453580d tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:55.715644 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1dcaca73-8f39-4262-990a-ab038e6a8096 req-52381a33-de45-42d1-8e1d-c225b453580d tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.0656164 Nov 02 12:49:55.774943 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1dcaca73-8f39-4262-990a-ab038e6a8096 req-9bfc50f8-8161-4287-993c-63286697ee82 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0452695 Nov 02 12:49:55.814502 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d53fcbb2-a03e-4185-b4c9-c603720f1ed2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:55.819026 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d53fcbb2-a03e-4185-b4c9-c603720f1ed2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:55.819026 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-d53fcbb2-a03e-4185-b4c9-c603720f1ed2 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/34ac31e2-7a9e-47dd-966c-6183d7fca55b HTTP/1.1" status: 204 len: 168 time: 0.3026016 Nov 02 12:49:55.826472 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d53fcbb2-a03e-4185-b4c9-c603720f1ed2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=34ac31e2-7a9e-47dd-966c-6183d7fca55b,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:55.860310 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-448b68d4-48a3-4745-b196-6c2da549307c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:55.863008 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-448b68d4-48a3-4745-b196-6c2da549307c admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:55.864178 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-448b68d4-48a3-4745-b196-6c2da549307c admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/be43184d-3c2c-4e2f-b6b8-ce1e2d19ac96 HTTP/1.1" status: 204 len: 168 time: 0.2862849 Nov 02 12:49:55.875682 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-448b68d4-48a3-4745-b196-6c2da549307c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=be43184d-3c2c-4e2f-b6b8-ce1e2d19ac96,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:56.468161 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-231ef315-604f-4ee5-b9be-ceceaaa9eeee req-2f61e747-ec6b-4b98-83b9-d94dd009fa42 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:56.469654 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-231ef315-604f-4ee5-b9be-ceceaaa9eeee req-2f61e747-ec6b-4b98-83b9-d94dd009fa42 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.0516279 Nov 02 12:49:56.523826 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-231ef315-604f-4ee5-b9be-ceceaaa9eeee req-569ef171-47c8-4578-a9cd-05ac1964900e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0481310 Nov 02 12:49:56.764715 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 55464) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:56.783758 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dc61951f-befb-4ca4-9d3a-99cb69a68bb7 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:56.804665 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:56.869918 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 55470) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:56.905746 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dc61951f-befb-4ca4-9d3a-99cb69a68bb7 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:56.922722 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3043e007-26d5-488e-aba6-c5c30db75749 req-9a2acf5e-5d2d-4d11-a8d2-160c73fd572a tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:56.924469 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3043e007-26d5-488e-aba6-c5c30db75749 req-9a2acf5e-5d2d-4d11-a8d2-160c73fd572a tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.0606863 Nov 02 12:49:56.980497 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3043e007-26d5-488e-aba6-c5c30db75749 req-fcc856f4-619e-491a-bf0a-2a7fc30dc611 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0488412 Nov 02 12:49:57.001296 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dc61951f-befb-4ca4-9d3a-99cb69a68bb7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:57.014083 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-495e4b41-fc55-410f-a910-da252004e2ad admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:57.061295 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-dc61951f-befb-4ca4-9d3a-99cb69a68bb7 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=273ddce73ea44acebba6885d67882533&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2918665 Nov 02 12:49:57.061961 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 55480) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:57.066359 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dc61951f-befb-4ca4-9d3a-99cb69a68bb7 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dfcbad3a-160f-4c99-aaa9-fd06ca41d5ee,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:57.098020 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5305b4f-25f6-42a4-b493-34ba771340b8 req-50b72008-3605-4cc2-9022-547bae7435bb tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:57.099889 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b5305b4f-25f6-42a4-b493-34ba771340b8 req-50b72008-3605-4cc2-9022-547bae7435bb tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.0739210 Nov 02 12:49:57.139045 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-495e4b41-fc55-410f-a910-da252004e2ad admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:57.158241 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-b5999ce5-de54-4d74-af20-47b127300d16 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:57.187844 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b5305b4f-25f6-42a4-b493-34ba771340b8 req-4ec4b08e-40de-4fa6-ad0d-50ea4ab6ead7 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0743024 Nov 02 12:49:57.192691 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-b5999ce5-de54-4d74-af20-47b127300d16 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:57.283442 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-495e4b41-fc55-410f-a910-da252004e2ad admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:57.329105 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-495e4b41-fc55-410f-a910-da252004e2ad admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3be2decc-5efd-4e9b-9fba-0e8e76b4a7de,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:57.333450 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-495e4b41-fc55-410f-a910-da252004e2ad admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=2a954fc728a245d2858577366f3f5f1d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4630697 Nov 02 12:49:57.336887 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 55494) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:57.345312 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-b5999ce5-de54-4d74-af20-47b127300d16 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:57.347894 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-b5999ce5-de54-4d74-af20-47b127300d16 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:57.349141 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-b5999ce5-de54-4d74-af20-47b127300d16 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/dfcbad3a-160f-4c99-aaa9-fd06ca41d5ee HTTP/1.1" status: 204 len: 168 time: 0.2860701 Nov 02 12:49:57.371203 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5999ce5-de54-4d74-af20-47b127300d16 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dfcbad3a-160f-4c99-aaa9-fd06ca41d5ee,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:57.409752 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-70870b27-ec52-47c1-a506-2bd60117372c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:57.436388 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-70870b27-ec52-47c1-a506-2bd60117372c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:57.613391 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-70870b27-ec52-47c1-a506-2bd60117372c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:57.616066 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-70870b27-ec52-47c1-a506-2bd60117372c admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:57.617404 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-70870b27-ec52-47c1-a506-2bd60117372c admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/3be2decc-5efd-4e9b-9fba-0e8e76b4a7de HTTP/1.1" status: 204 len: 168 time: 0.2793965 Nov 02 12:49:57.626844 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70870b27-ec52-47c1-a506-2bd60117372c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3be2decc-5efd-4e9b-9fba-0e8e76b4a7de,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:58.113180 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-46e767b1-a392-4db7-af4a-59b3123ad324 req-eb829fed-b527-4004-bab1-e06045f89219 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:58.114644 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-46e767b1-a392-4db7-af4a-59b3123ad324 req-eb829fed-b527-4004-bab1-e06045f89219 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.0508864 Nov 02 12:49:58.154114 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device bf7c4605-4045-4117-af22-08d75129b835 details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 12:49:58.177773 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-46e767b1-a392-4db7-af4a-59b3123ad324 req-215940ba-efe0-4200-a160-dd48584a7721 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0573506 Nov 02 12:49:58.307388 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port bf7c4605-4045-4117-af22-08d75129b835, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=bf7c4605-4045-4117-af22-08d75129b835,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:49:58.323419 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': 'bf7c4605-4045-4117-af22-08d75129b835', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'port_id': 'bf7c4605-4045-4117-af22-08d75129b835', 'mac_address': 'fa:16:3e:8b:d9:62', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 854, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 12:49:58.365509 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d2334f8f-df1b-4df8-8be7-684a4860b892 req-77422322-e079-4f35-90c0-21ccf8126bcc tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:58.376259 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d2334f8f-df1b-4df8-8be7-684a4860b892 req-77422322-e079-4f35-90c0-21ccf8126bcc tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.1062031 Nov 02 12:49:58.383687 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:58.410126 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:58.414480 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bf7c4605-4045-4117-af22-08d75129b835 {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:49:58.441209 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d2334f8f-df1b-4df8-8be7-684a4860b892 req-27fbdb0a-c85c-4db3-8058-9387fce6f000 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0635452 Nov 02 12:49:58.457748 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port bf7c4605-4045-4117-af22-08d75129b835, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=bf7c4605-4045-4117-af22-08d75129b835,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:49:58.507754 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1a106ef-f258-4950-b7c9-1afcf5f9f026 req-34faf886-06de-4fa0-b135-c717d441a7b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:58.508961 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c1a106ef-f258-4950-b7c9-1afcf5f9f026 req-34faf886-06de-4fa0-b135-c717d441a7b3 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=28a90b1659054909ab64ba5320160f74&device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 1099 time: 0.0517328 Nov 02 12:49:58.633600 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1a106ef-f258-4950-b7c9-1afcf5f9f026 req-f329a1f0-f564-48d9-b601-9e11650a15ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:58.635136 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c1a106ef-f258-4950-b7c9-1afcf5f9f026 req-f329a1f0-f564-48d9-b601-9e11650a15ec service neutron] 10.222.0.90 "GET /v2.0/networks?id=c965eaf1-5fb6-4689-8b12-fa3913e4f081 HTTP/1.1" status: 200 len: 920 time: 0.1155906 Nov 02 12:49:58.649044 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:58.681558 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c1a106ef-f258-4950-b7c9-1afcf5f9f026 req-d1ebcc40-8dfb-464e-b707-c5ddeab546ec service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=2cf235b6-e4c1-4b00-8971-dbd528d6ad92 HTTP/1.1" status: 200 len: 217 time: 0.0392387 Nov 02 12:49:58.711778 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=bf7c4605-4045-4117-af22-08d75129b835,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:58.736153 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 55532) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:58.746052 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1a106ef-f258-4950-b7c9-1afcf5f9f026 req-652a1840-3897-4687-987c-154f2204d09c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:58.747668 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c1a106ef-f258-4950-b7c9-1afcf5f9f026 req-652a1840-3897-4687-987c-154f2204d09c service neutron] 10.222.0.90 "GET /v2.0/subnets?id=b29075d9-9995-4f6f-8ebd-8f7d748977ef HTTP/1.1" status: 200 len: 859 time: 0.0544469 Nov 02 12:49:58.783745 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1d70e720-3f7a-4dbc-9a1a-4b694575af89 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:58.809079 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c1a106ef-f258-4950-b7c9-1afcf5f9f026 req-a644fd59-4ebc-40cd-95ce-9cad76957d2a service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=c965eaf1-5fb6-4689-8b12-fa3913e4f081&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0521469 Nov 02 12:49:58.864151 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8f20b6f4-ce67-4d0d-9b19-2db3047f20be req-79817fe4-b851-49c3-ae8b-fa015e759e37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:58.865642 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-8f20b6f4-ce67-4d0d-9b19-2db3047f20be req-79817fe4-b851-49c3-ae8b-fa015e759e37 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 1099 time: 0.1305857 Nov 02 12:49:58.929982 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c1a106ef-f258-4950-b7c9-1afcf5f9f026 req-c34fced0-2eab-4154-9149-25cd611723e4 service neutron] 10.222.0.90 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1110675 Nov 02 12:49:58.934848 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['bf7c4605-4045-4117-af22-08d75129b835'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:49:58.963791 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-8f20b6f4-ce67-4d0d-9b19-2db3047f20be req-df80ad5a-ff87-4101-9b43-8e856d798900 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0842690 Nov 02 12:49:58.965852 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1d70e720-3f7a-4dbc-9a1a-4b694575af89 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:59.040773 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c1a106ef-f258-4950-b7c9-1afcf5f9f026 req-8cc88455-30df-43b3-8949-18eb3b194ecb service neutron] 10.222.0.90 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1017177 Nov 02 12:49:59.048533 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1d70e720-3f7a-4dbc-9a1a-4b694575af89 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:59.096850 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-1d70e720-3f7a-4dbc-9a1a-4b694575af89 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=6ba200d5853344b886bd4222ca187c0b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3481252 Nov 02 12:49:59.097944 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1d70e720-3f7a-4dbc-9a1a-4b694575af89 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=07eade25-ff5d-4fa3-9d05-46efd8235c7b,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:59.099742 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 55540) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:49:59.184566 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-4d457db3-7c8f-455f-b502-de4f905ebe5e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:59.220885 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-4d457db3-7c8f-455f-b502-de4f905ebe5e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:59.328366 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a824acea-d2a2-4ee6-813f-0e438c3d4952 req-7f2ee4d1-07a9-4b69-a614-e5a2ba2f4c46 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:59.329538 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a824acea-d2a2-4ee6-813f-0e438c3d4952 req-7f2ee4d1-07a9-4b69-a614-e5a2ba2f4c46 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 944 time: 0.0688677 Nov 02 12:49:59.381590 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a824acea-d2a2-4ee6-813f-0e438c3d4952 req-e8b79bcc-3402-4e18-ac81-c0b4cfd78efe tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0456231 Nov 02 12:49:59.408166 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-4d457db3-7c8f-455f-b502-de4f905ebe5e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:59.421012 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-4d457db3-7c8f-455f-b502-de4f905ebe5e admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:49:59.426132 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-4d457db3-7c8f-455f-b502-de4f905ebe5e admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/07eade25-ff5d-4fa3-9d05-46efd8235c7b HTTP/1.1" status: 204 len: 168 time: 0.3252294 Nov 02 12:49:59.447446 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d457db3-7c8f-455f-b502-de4f905ebe5e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=07eade25-ff5d-4fa3-9d05-46efd8235c7b,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:49:59.464407 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:49:59.587289 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20d5227c-d628-4fe2-9c21-003f3551d67d req-c1236f89-9bf6-4174-b0b2-3b13f85c2c92 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:59.588943 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-20d5227c-d628-4fe2-9c21-003f3551d67d req-c1236f89-9bf6-4174-b0b2-3b13f85c2c92 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.0511882 Nov 02 12:49:59.646846 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-20d5227c-d628-4fe2-9c21-003f3551d67d req-6e1cc943-cac1-4ac6-8dc2-847b3415c592 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0510638 Nov 02 12:49:59.851089 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e1bebeb8-1b02-4a0e-b372-001cd8e24ddd req-ab45a274-e49e-4ef7-bafd-aa1fd52e6fc1 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0739899 Nov 02 12:49:59.974133 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1bebeb8-1b02-4a0e-b372-001cd8e24ddd req-189b4a60-db96-4d99-8d34-f3750d9d8680 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:49:59.975796 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e1bebeb8-1b02-4a0e-b372-001cd8e24ddd req-189b4a60-db96-4d99-8d34-f3750d9d8680 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=ae50c135750c4418b0b05f5bf2979217&device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 1099 time: 0.0532138 Nov 02 12:50:00.169861 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1bebeb8-1b02-4a0e-b372-001cd8e24ddd req-1e515e5f-98e1-44ec-8afb-5a16aaf90114 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:00.172981 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e1bebeb8-1b02-4a0e-b372-001cd8e24ddd req-1e515e5f-98e1-44ec-8afb-5a16aaf90114 service neutron] 10.222.0.90 "GET /v2.0/networks?id=73093621-5f08-4d97-a54e-da0042e8dde7 HTTP/1.1" status: 200 len: 913 time: 0.1634710 Nov 02 12:50:00.220908 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e1bebeb8-1b02-4a0e-b372-001cd8e24ddd req-42948b2d-797b-4355-b5cb-659e447a26dd service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=95fa81ee-1b2f-4f18-86a7-90dc0d1aef46 HTTP/1.1" status: 200 len: 217 time: 0.0397096 Nov 02 12:50:00.272328 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1bebeb8-1b02-4a0e-b372-001cd8e24ddd req-50023248-1f38-467f-b001-2dbcaef13a72 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:00.273774 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e1bebeb8-1b02-4a0e-b372-001cd8e24ddd req-50023248-1f38-467f-b001-2dbcaef13a72 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=4d3908d6-4378-401d-b0c3-b220a11a4a6a HTTP/1.1" status: 200 len: 852 time: 0.0455832 Nov 02 12:50:00.306230 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e1bebeb8-1b02-4a0e-b372-001cd8e24ddd req-b1ec2f15-8059-4f5f-9540-5d0692353426 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=73093621-5f08-4d97-a54e-da0042e8dde7&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0252635 Nov 02 12:50:00.658111 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a3a7806-7ef7-4d03-963e-d0f8c5efb07d req-2cb3b1ac-fcfc-49e6-becd-69c4a7f39484 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:00.659678 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1a3a7806-7ef7-4d03-963e-d0f8c5efb07d req-2cb3b1ac-fcfc-49e6-becd-69c4a7f39484 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 944 time: 0.0742044 Nov 02 12:50:00.661755 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e1bebeb8-1b02-4a0e-b372-001cd8e24ddd req-a4cb18ed-5958-4401-8ac1-b360f031799c service neutron] 10.222.0.90 "GET /v2.0/networks/73093621-5f08-4d97-a54e-da0042e8dde7?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3484218 Nov 02 12:50:00.795584 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1a3a7806-7ef7-4d03-963e-d0f8c5efb07d req-838b9d25-6820-465e-95ec-428b1c900960 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1158936 Nov 02 12:50:00.812044 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e1bebeb8-1b02-4a0e-b372-001cd8e24ddd req-f9ac6bb0-426a-49ce-9d58-fdd3100fde5a service neutron] 10.222.0.90 "GET /v2.0/networks/73093621-5f08-4d97-a54e-da0042e8dde7?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1420369 Nov 02 12:50:00.838962 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:00.984752 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ed49dea-98cf-4c06-974c-7c0acc297a2a req-2ab23eea-91ea-4148-bc21-2208c34abf0c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:00.986353 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4ed49dea-98cf-4c06-974c-7c0acc297a2a req-2ab23eea-91ea-4148-bc21-2208c34abf0c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.0736046 Nov 02 12:50:01.044313 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4ed49dea-98cf-4c06-974c-7c0acc297a2a req-76d3548a-2613-4e18-82c7-73ca6c7150f3 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0501354 Nov 02 12:50:01.164110 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device bf7c4605-4045-4117-af22-08d75129b835 up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:50:01.339363 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning for port bf7c4605-4045-4117-af22-08d75129b835 completed by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 02 12:50:01.344074 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port bf7c4605-4045-4117-af22-08d75129b835 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:50:01.344446 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:01.442567 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:01.469958 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7cc2c649-db32-4af2-b17b-1b744ef40a5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bf7c4605-4045-4117-af22-08d75129b835'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:50:01.472388 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2ef011ce-e72a-4095-b8be-772ea7995030" -d '{"events": [{"server_uuid": "7cc2c649-db32-4af2-b17b-1b744ef40a5f", "name": "network-vif-plugged", "status": "completed", "tag": "bf7c4605-4045-4117-af22-08d75129b835"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:50:01.495476 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port bf7c4605-4045-4117-af22-08d75129b835, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=bf7c4605-4045-4117-af22-08d75129b835,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:50:01.516755 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:50:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-36a5bd4e-c66c-415f-b8b9-6adc4840a6f1 x-openstack-request-id: req-36a5bd4e-c66c-415f-b8b9-6adc4840a6f1 {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:50:01.517069 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7cc2c649-db32-4af2-b17b-1b744ef40a5f", "name": "network-vif-plugged", "status": "completed", "tag": "bf7c4605-4045-4117-af22-08d75129b835", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:50:01.517321 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-36a5bd4e-c66c-415f-b8b9-6adc4840a6f1 {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:50:01.517718 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7cc2c649-db32-4af2-b17b-1b744ef40a5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bf7c4605-4045-4117-af22-08d75129b835', 'code': 200} Nov 02 12:50:01.602288 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:01.668092 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=bf7c4605-4045-4117-af22-08d75129b835,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:01.951838 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3a49de9-1a10-41d6-aa71-dcf938082381 req-78427d0a-a00d-43df-badc-38a8f425cc47 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:01.953402 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a3a49de9-1a10-41d6-aa71-dcf938082381 req-78427d0a-a00d-43df-badc-38a8f425cc47 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 1098 time: 0.0858450 Nov 02 12:50:01.964629 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-436291ab-7f94-4bcf-b7dd-4d886dcfe709 req-79173653-48eb-4bf0-8ab4-4dde5663a40c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:01.967803 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-436291ab-7f94-4bcf-b7dd-4d886dcfe709 req-79173653-48eb-4bf0-8ab4-4dde5663a40c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.0673208 Nov 02 12:50:02.014848 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-436291ab-7f94-4bcf-b7dd-4d886dcfe709 req-92f945f4-ae1a-40df-a98b-0e8d8b72eaff tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417264 Nov 02 12:50:02.112898 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 55684) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:02.202536 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2b03de0-347d-40af-9d24-50dba2dd8ad9 req-57ee322b-4790-4e24-bddf-18bae8f70fb6 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:02.210591 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b2b03de0-347d-40af-9d24-50dba2dd8ad9 req-57ee322b-4790-4e24-bddf-18bae8f70fb6 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.0696025 Nov 02 12:50:02.241154 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d4c515cb-739a-4f86-8ac7-612e0550f75f admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:02.263462 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b2b03de0-347d-40af-9d24-50dba2dd8ad9 req-056c7706-f89b-4730-bd11-d27a2afc4650 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0512958 Nov 02 12:50:02.324243 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d4c515cb-739a-4f86-8ac7-612e0550f75f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:02.371186 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 55696) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:02.409218 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d4c515cb-739a-4f86-8ac7-612e0550f75f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:02.449067 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-d4c515cb-739a-4f86-8ac7-612e0550f75f admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=e3dbd1eac70342ea86ecabf8ff8b62b6&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3349528 Nov 02 12:50:02.452449 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 55702) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:02.464151 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4c515cb-739a-4f86-8ac7-612e0550f75f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fec295a4-d5e7-449c-b911-7583f9e16367,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:02.513945 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-62a88b47-55f8-4d2d-a0fb-3031c7940f66 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:02.515080 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-e41f7e4b-dc0b-4c2c-8d60-8284f52342be admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:02.550967 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-e41f7e4b-dc0b-4c2c-8d60-8284f52342be admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:02.596781 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-62a88b47-55f8-4d2d-a0fb-3031c7940f66 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:02.660436 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-e41f7e4b-dc0b-4c2c-8d60-8284f52342be admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:02.663206 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-e41f7e4b-dc0b-4c2c-8d60-8284f52342be admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:02.664386 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-e41f7e4b-dc0b-4c2c-8d60-8284f52342be admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/fec295a4-d5e7-449c-b911-7583f9e16367 HTTP/1.1" status: 204 len: 168 time: 0.2110445 Nov 02 12:50:02.673414 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e41f7e4b-dc0b-4c2c-8d60-8284f52342be admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fec295a4-d5e7-449c-b911-7583f9e16367,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:02.689008 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-62a88b47-55f8-4d2d-a0fb-3031c7940f66 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:02.728599 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-62a88b47-55f8-4d2d-a0fb-3031c7940f66 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=0224b68989bf43109e0e345855bbd9ff&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3562801 Nov 02 12:50:02.731359 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 55710) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:02.738572 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-62a88b47-55f8-4d2d-a0fb-3031c7940f66 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=78966a2e-968e-40b9-855c-83dbf15e8d07,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:02.783933 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dd163336-bf9c-42bb-82b3-309f3a6a332b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:02.808343 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dd163336-bf9c-42bb-82b3-309f3a6a332b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:02.837763 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a3a49de9-1a10-41d6-aa71-dcf938082381 req-bca7d1fc-96d5-4e3c-a496-98f1c80794f6 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0450246 Nov 02 12:50:02.940568 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dd163336-bf9c-42bb-82b3-309f3a6a332b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:02.943985 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dd163336-bf9c-42bb-82b3-309f3a6a332b admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:02.945550 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-dd163336-bf9c-42bb-82b3-309f3a6a332b admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/78966a2e-968e-40b9-855c-83dbf15e8d07 HTTP/1.1" status: 204 len: 168 time: 0.2130990 Nov 02 12:50:02.959937 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd163336-bf9c-42bb-82b3-309f3a6a332b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=78966a2e-968e-40b9-855c-83dbf15e8d07,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:03.160718 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8575c13-e1ba-4492-bad2-674159a019f5 req-13b3a37b-8a0b-4a89-ba7e-4b95cd437fad tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:03.162258 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f8575c13-e1ba-4492-bad2-674159a019f5 req-13b3a37b-8a0b-4a89-ba7e-4b95cd437fad tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.0513473 Nov 02 12:50:03.213913 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:03.217116 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f8575c13-e1ba-4492-bad2-674159a019f5 req-975d0119-8b8b-47b6-9826-da29ece70d2a tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465567 Nov 02 12:50:03.401805 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8fd24a6a-af8b-4052-b43a-5e793f0b0751 req-5990a51a-b4c3-457e-907a-f48cc2be0864 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:03.403314 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8fd24a6a-af8b-4052-b43a-5e793f0b0751 req-5990a51a-b4c3-457e-907a-f48cc2be0864 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.0635936 Nov 02 12:50:03.454229 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8fd24a6a-af8b-4052-b43a-5e793f0b0751 req-d9311c98-af22-4400-9c81-d899992d17ce tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445883 Nov 02 12:50:03.511622 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 55724) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:03.528684 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-6316b8f3-5c81-472d-aecb-7677aeede107 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:03.627390 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-6316b8f3-5c81-472d-aecb-7677aeede107 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:03.683575 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-6316b8f3-5c81-472d-aecb-7677aeede107 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:03.728544 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-6316b8f3-5c81-472d-aecb-7677aeede107 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=d2ce47b110474fb0a15646d02755e3b8&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2156885 Nov 02 12:50:03.729594 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6316b8f3-5c81-472d-aecb-7677aeede107 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=71705224-965c-4a05-ba0f-ea941555840f,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:03.731536 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 55732) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:03.798876 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-bd3da39a-dec3-47ff-92a3-091cfec965d8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:03.813381 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 55734) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:03.829080 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-bd3da39a-dec3-47ff-92a3-091cfec965d8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:03.840076 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-553d9aa3-9e00-4975-a8e6-62997c86ad55 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:03.989713 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-bd3da39a-dec3-47ff-92a3-091cfec965d8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:03.992357 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-bd3da39a-dec3-47ff-92a3-091cfec965d8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:03.993574 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-bd3da39a-dec3-47ff-92a3-091cfec965d8 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/71705224-965c-4a05-ba0f-ea941555840f HTTP/1.1" status: 204 len: 168 time: 0.2610445 Nov 02 12:50:04.015179 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bd3da39a-dec3-47ff-92a3-091cfec965d8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=71705224-965c-4a05-ba0f-ea941555840f,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:04.067073 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-553d9aa3-9e00-4975-a8e6-62997c86ad55 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:04.123768 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-553d9aa3-9e00-4975-a8e6-62997c86ad55 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:04.175142 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-553d9aa3-9e00-4975-a8e6-62997c86ad55 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=b5f9b196274a41d58a8fe6e5a89b2f9c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3606572 Nov 02 12:50:04.177588 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-553d9aa3-9e00-4975-a8e6-62997c86ad55 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=73bf558a-9a45-4536-8842-0d476a549f3b,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:04.178725 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 55738) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:04.246175 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bf3c23db-84f6-4318-ad02-ddc361218eea admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:04.272532 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bf3c23db-84f6-4318-ad02-ddc361218eea admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:04.419892 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c092483-d48f-4c98-aba8-1a6cdc27c748 req-ab433d13-7845-46df-a3f5-e5798df80112 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:04.421481 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3c092483-d48f-4c98-aba8-1a6cdc27c748 req-ab433d13-7845-46df-a3f5-e5798df80112 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.0962582 Nov 02 12:50:04.501964 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3c092483-d48f-4c98-aba8-1a6cdc27c748 req-542295e9-8c6e-459b-8166-830ed2317d20 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0706599 Nov 02 12:50:04.503149 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bf3c23db-84f6-4318-ad02-ddc361218eea admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:04.510895 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bf3c23db-84f6-4318-ad02-ddc361218eea admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:04.510895 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-bf3c23db-84f6-4318-ad02-ddc361218eea admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/73bf558a-9a45-4536-8842-0d476a549f3b HTTP/1.1" status: 204 len: 168 time: 0.3294137 Nov 02 12:50:04.525159 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bf3c23db-84f6-4318-ad02-ddc361218eea admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=73bf558a-9a45-4536-8842-0d476a549f3b,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:04.733070 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44941494-2d48-48a9-9401-cfdde0e60d15 req-8b2c71c9-96b9-4cae-ad34-b88fd79fc88c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:04.734638 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-44941494-2d48-48a9-9401-cfdde0e60d15 req-8b2c71c9-96b9-4cae-ad34-b88fd79fc88c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.1096478 Nov 02 12:50:04.811222 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-44941494-2d48-48a9-9401-cfdde0e60d15 req-0f007dea-5648-4461-b07a-1ac2e60d85a0 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0638318 Nov 02 12:50:05.828932 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9abd0cb9-99ca-4436-8180-d74da2ec3801 req-b0227340-e996-4c22-b72a-6066d4bacd18 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:05.834026 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9abd0cb9-99ca-4436-8180-d74da2ec3801 req-b0227340-e996-4c22-b72a-6066d4bacd18 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.1569874 Nov 02 12:50:06.020571 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9abd0cb9-99ca-4436-8180-d74da2ec3801 req-53b19265-9008-4b59-8fa5-9c4516c65dd0 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1742792 Nov 02 12:50:06.052109 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04c5fcc7-bfd0-4440-8a7c-05d2b5079b95 req-bcc1f724-96dd-449d-beb3-ef3fde7906a5 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:06.054825 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-04c5fcc7-bfd0-4440-8a7c-05d2b5079b95 req-bcc1f724-96dd-449d-beb3-ef3fde7906a5 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.0866194 Nov 02 12:50:06.211385 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-04c5fcc7-bfd0-4440-8a7c-05d2b5079b95 req-9b9b14ab-afa0-4be5-a183-7d0c407336df tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1463025 Nov 02 12:50:07.246718 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d6f5c49-3193-444a-ba76-d86451a2de89 req-78e0de36-121f-416c-9fb5-63ebfc4283a5 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:07.248940 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7d6f5c49-3193-444a-ba76-d86451a2de89 req-78e0de36-121f-416c-9fb5-63ebfc4283a5 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.0865700 Nov 02 12:50:07.336730 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7d6f5c49-3193-444a-ba76-d86451a2de89 req-6ce7ff1e-35f9-4638-8b6b-9278a836be0a tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0754654 Nov 02 12:50:07.437168 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-237cddf2-f3c4-4dc3-9395-3777bdfb8463 req-5bcd7316-6182-4e38-96fa-fc2cd966b9ec tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:07.458333 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-237cddf2-f3c4-4dc3-9395-3777bdfb8463 req-5bcd7316-6182-4e38-96fa-fc2cd966b9ec tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.1044703 Nov 02 12:50:07.559181 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-237cddf2-f3c4-4dc3-9395-3777bdfb8463 req-c7b89272-b319-46f5-afee-6603431f0307 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0985730 Nov 02 12:50:07.701554 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-167eec3a-816d-4517-bd3b-7c1f290e333c req-997a745b-ba55-47bd-9f46-fb432879a64e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:07.717135 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-167eec3a-816d-4517-bd3b-7c1f290e333c req-997a745b-ba55-47bd-9f46-fb432879a64e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.0809295 Nov 02 12:50:07.717603 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 55890) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:07.722670 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-b1c04c37-7e3f-4d65-9d4f-5114a7e75f8c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Request body: {'floatingip': {'port_id': 'bf7c4605-4045-4117-af22-08d75129b835'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:50:07.830871 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-b1c04c37-7e3f-4d65-9d4f-5114a7e75f8c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for floatingip, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:08.145594 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 55908) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:08.408609 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-9003537f-b450-46a9-afcb-8d93e0f7f064 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:08.579977 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-9003537f-b450-46a9-afcb-8d93e0f7f064 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:08.644508 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-9003537f-b450-46a9-afcb-8d93e0f7f064 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:08.730784 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-9003537f-b450-46a9-afcb-8d93e0f7f064 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=9b63a9f5ce9b4e72977a1f716d6f0f89&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5822656 Nov 02 12:50:08.734533 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 55920) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:08.743765 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9003537f-b450-46a9-afcb-8d93e0f7f064 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=86477317-5afd-4111-a600-40ddc3154fc0,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:08.761392 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9003537f-b450-46a9-afcb-8d93e0f7f064 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:08.761847 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9003537f-b450-46a9-afcb-8d93e0f7f064 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:08.762225 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9003537f-b450-46a9-afcb-8d93e0f7f064 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:08.762591 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9003537f-b450-46a9-afcb-8d93e0f7f064 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:08.763506 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9003537f-b450-46a9-afcb-8d93e0f7f064 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:08.763904 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9003537f-b450-46a9-afcb-8d93e0f7f064 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:08.764263 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9003537f-b450-46a9-afcb-8d93e0f7f064 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:08.764691 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9003537f-b450-46a9-afcb-8d93e0f7f064 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:08.765206 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9003537f-b450-46a9-afcb-8d93e0f7f064 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:08.765584 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9003537f-b450-46a9-afcb-8d93e0f7f064 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:08.765916 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9003537f-b450-46a9-afcb-8d93e0f7f064 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:08.766314 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9003537f-b450-46a9-afcb-8d93e0f7f064 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:08.812265 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-0b72376b-c6fd-49a9-91ab-5c9b1f599a35 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:08.843318 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-0b72376b-c6fd-49a9-91ab-5c9b1f599a35 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:09.006364 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-0b72376b-c6fd-49a9-91ab-5c9b1f599a35 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:09.014421 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-0b72376b-c6fd-49a9-91ab-5c9b1f599a35 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:09.018275 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-0b72376b-c6fd-49a9-91ab-5c9b1f599a35 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/86477317-5afd-4111-a600-40ddc3154fc0 HTTP/1.1" status: 204 len: 168 time: 0.2813907 Nov 02 12:50:09.036122 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b72376b-c6fd-49a9-91ab-5c9b1f599a35 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=86477317-5afd-4111-a600-40ddc3154fc0,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:09.101431 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.db.resource_extend [None req-b1c04c37-7e3f-4d65-9d4f-5114a7e75f8c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] It took 0.37 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=108543) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 02 12:50:09.157696 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9d81cad-461f-44f8-af6e-5f685fee990f req-b3940940-44e2-4c82-bc84-33dc974e150f tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:09.165603 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b9d81cad-461f-44f8-af6e-5f685fee990f req-b3940940-44e2-4c82-bc84-33dc974e150f tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.4221337 Nov 02 12:50:09.251922 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-b1c04c37-7e3f-4d65-9d4f-5114a7e75f8c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:09.288154 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b9d81cad-461f-44f8-af6e-5f685fee990f req-2949625f-db50-443e-8480-25280cca810a tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1204486 Nov 02 12:50:09.351626 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-b1c04c37-7e3f-4d65-9d4f-5114a7e75f8c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1594992'] for floatingip, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:09.460787 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.db.l3_db [None req-b1c04c37-7e3f-4d65-9d4f-5114a7e75f8c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Floating IP 6407ff06-03f9-4f81-a9b3-7f350e066ed0 associated. External IP: 172.27.0.123, port: bf7c4605-4045-4117-af22-08d75129b835. Nov 02 12:50:09.731162 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-b1c04c37-7e3f-4d65-9d4f-5114a7e75f8c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Router 308142a4-46ba-42ef-a1f2-5df4b969cc8f has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108543) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 12:50:09.865910 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b1c04c37-7e3f-4d65-9d4f-5114a7e75f8c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108543) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:50:09.871209 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-b1c04c37-7e3f-4d65-9d4f-5114a7e75f8c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for floatingip, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:09.889789 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c05a8e90-3bc1-4bb4-a64e-28836062be97 None None] Sync routers for ids ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'] in dv-cinder-816324-1-iscsi {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:50:09.904858 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c05a8e90-3bc1-4bb4-a64e-28836062be97 None None] Routers {'308142a4-46ba-42ef-a1f2-5df4b969cc8f'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:50:09.905560 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-c05a8e90-3bc1-4bb4-a64e-28836062be97 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:49:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:50:09.911186 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-b1c04c37-7e3f-4d65-9d4f-5114a7e75f8c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "PUT /v2.0/floatingips/6407ff06-03f9-4f81-a9b3-7f350e066ed0 HTTP/1.1" status: 200 len: 991 time: 2.1878598 Nov 02 12:50:09.911186 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '7cc2c649-db32-4af2-b17b-1b744ef40a5f', 'tag': 'bf7c4605-4045-4117-af22-08d75129b835'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:50:09.915412 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2d75a3b3-aaeb-4035-a373-dc6587bc45d4" -d '{"events": [{"name": "network-changed", "server_uuid": "7cc2c649-db32-4af2-b17b-1b744ef40a5f", "tag": "bf7c4605-4045-4117-af22-08d75129b835"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:50:10.028867 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-c05a8e90-3bc1-4bb4-a64e-28836062be97 None None] Set router 308142a4-46ba-42ef-a1f2-5df4b969cc8f gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:50:10.039022 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 55956) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:10.067355 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:50:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-137b37cb-b94d-4eb4-b104-00289d09f45a x-openstack-request-id: req-137b37cb-b94d-4eb4-b104-00289d09f45a {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:50:10.067820 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "7cc2c649-db32-4af2-b17b-1b744ef40a5f", "tag": "bf7c4605-4045-4117-af22-08d75129b835", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:50:10.068211 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-137b37cb-b94d-4eb4-b104-00289d09f45a {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:50:10.068847 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '7cc2c649-db32-4af2-b17b-1b744ef40a5f', 'tag': 'bf7c4605-4045-4117-af22-08d75129b835', 'status': 'completed', 'code': 200} Nov 02 12:50:10.103366 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 55962) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:10.156949 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 55966) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:10.197131 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-305be3d0-2e38-4dcb-8e7d-2d8516879055 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:10.358223 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-305be3d0-2e38-4dcb-8e7d-2d8516879055 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:10.409878 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-ae89d272-42cd-4778-a014-b08a9c08babc admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:10.432424 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-c05a8e90-3bc1-4bb4-a64e-28836062be97 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'name': 'tempest-AttachVolumeShelveTestJSON-199949485-router', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207'}], 'enable_snat': True}, 'gw_port_id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:49:22Z', 'revision_number': 4, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'gw_port': {'id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:4a:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:12Z', 'updated_at': '2021-11-02T12:49:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': '6407ff06-03f9-4f81-a9b3-7f350e066ed0', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'floating_ip_address': '172.27.0.123', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'port_id': 'bf7c4605-4045-4117-af22-08d75129b835', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 137, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'mac_address': 'fa:16:3e:8b:d9:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7cc2c649-db32-4af2-b17b-1b744ef40a5f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:49:38Z', 'updated_at': '2021-11-02T12:50:08Z', 'revision_number': 1, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '91fe3ff8-cdf3-4761-8b27-27e55f6f6690', 'name': '', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'mac_address': 'fa:16:3e:51:73:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:20Z', 'updated_at': '2021-11-02T12:49:34Z', 'revision_number': 5, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'subnets': [{'id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:50:10.438486 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-305be3d0-2e38-4dcb-8e7d-2d8516879055 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:10.469924 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c05a8e90-3bc1-4bb4-a64e-28836062be97 None None] Checking router: 308142a4-46ba-42ef-a1f2-5df4b969cc8f for host: dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:50:10.482433 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c05a8e90-3bc1-4bb4-a64e-28836062be97 None None] Routers {'308142a4-46ba-42ef-a1f2-5df4b969cc8f'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:50:10.483104 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-c05a8e90-3bc1-4bb4-a64e-28836062be97 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:49:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:50:10.504448 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-305be3d0-2e38-4dcb-8e7d-2d8516879055 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=caa50081a69a4e958c8c1a756a860784&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3414531 Nov 02 12:50:10.504746 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 55972) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:10.511007 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cda29ed9-0bb8-4ee1-87c6-c133ab9b77d0 req-23f4daf5-efcb-416f-a7d5-c5e0a74961a8 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:10.513877 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cda29ed9-0bb8-4ee1-87c6-c133ab9b77d0 req-23f4daf5-efcb-416f-a7d5-c5e0a74961a8 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.1219511 Nov 02 12:50:10.515152 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-3139d755-8323-4c1a-b5bb-1a6123cf3639 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:10.516971 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-305be3d0-2e38-4dcb-8e7d-2d8516879055 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=81bada64-50e5-40b1-b1ab-edcb367e9064,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:10.543082 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-305be3d0-2e38-4dcb-8e7d-2d8516879055 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:10.543593 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-305be3d0-2e38-4dcb-8e7d-2d8516879055 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:10.544595 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-305be3d0-2e38-4dcb-8e7d-2d8516879055 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:10.544595 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-305be3d0-2e38-4dcb-8e7d-2d8516879055 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:10.545090 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-305be3d0-2e38-4dcb-8e7d-2d8516879055 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:10.545615 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-305be3d0-2e38-4dcb-8e7d-2d8516879055 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:10.546180 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-305be3d0-2e38-4dcb-8e7d-2d8516879055 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:10.547036 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-305be3d0-2e38-4dcb-8e7d-2d8516879055 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:10.547175 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-305be3d0-2e38-4dcb-8e7d-2d8516879055 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:10.547807 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-305be3d0-2e38-4dcb-8e7d-2d8516879055 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:10.548286 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-305be3d0-2e38-4dcb-8e7d-2d8516879055 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:10.548749 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-305be3d0-2e38-4dcb-8e7d-2d8516879055 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:10.620938 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cda29ed9-0bb8-4ee1-87c6-c133ab9b77d0 req-37a14eaf-d8cc-4ade-a839-e34ed3c9d723 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0974212 Nov 02 12:50:10.623256 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-ae89d272-42cd-4778-a014-b08a9c08babc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:10.659929 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d5f66fc7-e6a1-42ef-89fe-97d9fda93201 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:10.694400 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-ae89d272-42cd-4778-a014-b08a9c08babc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:10.697934 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d5f66fc7-e6a1-42ef-89fe-97d9fda93201 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:10.730859 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-3139d755-8323-4c1a-b5bb-1a6123cf3639 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:10.749149 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-c05a8e90-3bc1-4bb4-a64e-28836062be97 None None] Set router 308142a4-46ba-42ef-a1f2-5df4b969cc8f gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:50:10.770355 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-ae89d272-42cd-4778-a014-b08a9c08babc admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=2053e092f6cf4e86aab374c35850dfe4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7297256 Nov 02 12:50:10.771923 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 55974) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:10.780167 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ae89d272-42cd-4778-a014-b08a9c08babc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c67ca038-574a-4404-b388-e26b31af80fe,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:10.820310 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-3139d755-8323-4c1a-b5bb-1a6123cf3639 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:10.842292 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7c7ab567-f094-48c1-b030-c0460353d149 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:10.860441 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3139d755-8323-4c1a-b5bb-1a6123cf3639 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3ab82351-b376-44e3-8df9-19aada5c130c,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:10.864639 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-3139d755-8323-4c1a-b5bb-1a6123cf3639 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=75b725e4a3274f5785541bf8f9216116&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7598991 Nov 02 12:50:10.866157 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7c7ab567-f094-48c1-b030-c0460353d149 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:10.868828 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 55976) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:10.896168 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d5f66fc7-e6a1-42ef-89fe-97d9fda93201 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:10.899395 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d5f66fc7-e6a1-42ef-89fe-97d9fda93201 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:10.902982 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-d5f66fc7-e6a1-42ef-89fe-97d9fda93201 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/81bada64-50e5-40b1-b1ab-edcb367e9064 HTTP/1.1" status: 204 len: 168 time: 0.3969221 Nov 02 12:50:10.933857 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5f66fc7-e6a1-42ef-89fe-97d9fda93201 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=81bada64-50e5-40b1-b1ab-edcb367e9064,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:10.964470 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4d098469-1748-4cd1-8cdb-c5bc03e9cf43 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:11.003708 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4d098469-1748-4cd1-8cdb-c5bc03e9cf43 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:11.013204 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7c7ab567-f094-48c1-b030-c0460353d149 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:11.017049 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7c7ab567-f094-48c1-b030-c0460353d149 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:11.019224 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-7c7ab567-f094-48c1-b030-c0460353d149 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/c67ca038-574a-4404-b388-e26b31af80fe HTTP/1.1" status: 204 len: 168 time: 0.2449465 Nov 02 12:50:11.030238 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7c7ab567-f094-48c1-b030-c0460353d149 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c67ca038-574a-4404-b388-e26b31af80fe,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:11.111503 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-c05a8e90-3bc1-4bb4-a64e-28836062be97 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'name': 'tempest-AttachVolumeShelveTestJSON-199949485-router', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207'}], 'enable_snat': True}, 'gw_port_id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:49:22Z', 'revision_number': 4, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'gw_port': {'id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:4a:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:12Z', 'updated_at': '2021-11-02T12:49:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': '6407ff06-03f9-4f81-a9b3-7f350e066ed0', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'floating_ip_address': '172.27.0.123', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'port_id': 'bf7c4605-4045-4117-af22-08d75129b835', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 137, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'mac_address': 'fa:16:3e:8b:d9:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7cc2c649-db32-4af2-b17b-1b744ef40a5f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:49:38Z', 'updated_at': '2021-11-02T12:50:08Z', 'revision_number': 1, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '91fe3ff8-cdf3-4761-8b27-27e55f6f6690', 'name': '', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'mac_address': 'fa:16:3e:51:73:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:20Z', 'updated_at': '2021-11-02T12:49:34Z', 'revision_number': 5, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'subnets': [{'id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:50:11.161177 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c05a8e90-3bc1-4bb4-a64e-28836062be97 None None] The sync data for ids ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'] in dv-cinder-816324-1-iscsi is: [{'id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'name': 'tempest-AttachVolumeShelveTestJSON-199949485-router', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207'}], 'enable_snat': True}, 'gw_port_id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:49:22Z', 'revision_number': 4, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'gw_port': {'id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:4a:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:12Z', 'updated_at': '2021-11-02T12:49:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': '6407ff06-03f9-4f81-a9b3-7f350e066ed0', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'floating_ip_address': '172.27.0.123', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'port_id': 'bf7c4605-4045-4117-af22-08d75129b835', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 137, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'mac_address': 'fa:16:3e:8b:d9:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7cc2c649-db32-4af2-b17b-1b744ef40a5f', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:49:38Z', 'updated_at': '2021-11-02T12:50:08Z', 'revision_number': 1, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '91fe3ff8-cdf3-4761-8b27-27e55f6f6690', 'name': '', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'mac_address': 'fa:16:3e:51:73:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:20Z', 'updated_at': '2021-11-02T12:49:34Z', 'revision_number': 5, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'subnets': [{'id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:50:11.203776 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4d098469-1748-4cd1-8cdb-c5bc03e9cf43 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:11.206507 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4d098469-1748-4cd1-8cdb-c5bc03e9cf43 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:11.207722 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-4d098469-1748-4cd1-8cdb-c5bc03e9cf43 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/3ab82351-b376-44e3-8df9-19aada5c130c HTTP/1.1" status: 204 len: 168 time: 0.3379772 Nov 02 12:50:11.215678 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d098469-1748-4cd1-8cdb-c5bc03e9cf43 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3ab82351-b376-44e3-8df9-19aada5c130c,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:11.422286 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-209368bb-3447-49a7-a174-1d8376fcfd35 None None] New status for floating IP 6407ff06-03f9-4f81-a9b3-7f350e066ed0: ACTIVE {{(pid=108544) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 02 12:50:11.777374 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-552e7bf7-1bc9-45c8-bc70-0e3547bfbe79 req-0d0428ef-f05a-4ded-900a-ca5180727a63 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:11.780597 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-552e7bf7-1bc9-45c8-bc70-0e3547bfbe79 req-0d0428ef-f05a-4ded-900a-ca5180727a63 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.0596478 Nov 02 12:50:11.846264 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-552e7bf7-1bc9-45c8-bc70-0e3547bfbe79 req-f5e643a9-dbd4-4ea3-942a-5db9901469fc tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0590353 Nov 02 12:50:11.846565 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 56002) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:11.869470 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-ba9f484a-6d78-4d08-92f9-398de9ca5ce6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:11.973591 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-ba9f484a-6d78-4d08-92f9-398de9ca5ce6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:12.043417 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-ba9f484a-6d78-4d08-92f9-398de9ca5ce6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:12.094744 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba9f484a-6d78-4d08-92f9-398de9ca5ce6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=19d8c9bb-b6f2-42fa-9362-33837049da5b,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:12.098911 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-ba9f484a-6d78-4d08-92f9-398de9ca5ce6 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=3f60b1a68d6c4e4d8b9b2ceefea6fd92&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2509494 Nov 02 12:50:12.102204 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 56016) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:12.190770 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f288c3e9-883b-4eed-bece-247b8ab5afe9 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:12.237281 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f288c3e9-883b-4eed-bece-247b8ab5afe9 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:12.409143 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f288c3e9-883b-4eed-bece-247b8ab5afe9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:12.412120 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f288c3e9-883b-4eed-bece-247b8ab5afe9 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:12.413561 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-f288c3e9-883b-4eed-bece-247b8ab5afe9 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/19d8c9bb-b6f2-42fa-9362-33837049da5b HTTP/1.1" status: 204 len: 168 time: 0.3099120 Nov 02 12:50:12.422766 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f288c3e9-883b-4eed-bece-247b8ab5afe9 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=19d8c9bb-b6f2-42fa-9362-33837049da5b,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:12.661973 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d75a3b3-aaeb-4035-a373-dc6587bc45d4 req-98a43cd3-845f-4988-a649-d48431adac79 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:12.663508 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2d75a3b3-aaeb-4035-a373-dc6587bc45d4 req-98a43cd3-845f-4988-a649-d48431adac79 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=aaddc046689441b8ab3641f2afd07c0e&device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 1098 time: 0.0456166 Nov 02 12:50:12.797071 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d75a3b3-aaeb-4035-a373-dc6587bc45d4 req-507c3d0e-45e6-4030-852e-571ca1d07a23 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:12.798584 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2d75a3b3-aaeb-4035-a373-dc6587bc45d4 req-507c3d0e-45e6-4030-852e-571ca1d07a23 service neutron] 10.222.0.90 "GET /v2.0/networks?id=c468f0e1-3636-49b9-90c6-b90c643ed7d1 HTTP/1.1" status: 200 len: 917 time: 0.1030898 Nov 02 12:50:12.914536 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2d75a3b3-aaeb-4035-a373-dc6587bc45d4 req-b9cbd942-94de-4992-8082-eeb9b42fb547 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=bf7c4605-4045-4117-af22-08d75129b835 HTTP/1.1" status: 200 len: 1001 time: 0.1035197 Nov 02 12:50:13.005453 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d75a3b3-aaeb-4035-a373-dc6587bc45d4 req-de5437ca-0687-45ca-b870-a180f43e88d2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:13.005453 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2d75a3b3-aaeb-4035-a373-dc6587bc45d4 req-de5437ca-0687-45ca-b870-a180f43e88d2 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=ec48fe57-a1cd-4e7c-874f-073624f71f4b HTTP/1.1" status: 200 len: 855 time: 0.0716918 Nov 02 12:50:13.007691 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81bd0659-1e1e-4411-83fa-d258bbb06a6d req-b41fa270-c9c9-4a94-ba1a-b8c9fc8b6ceb tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:13.009325 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-81bd0659-1e1e-4411-83fa-d258bbb06a6d req-b41fa270-c9c9-4a94-ba1a-b8c9fc8b6ceb tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.0920353 Nov 02 12:50:13.105369 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-81bd0659-1e1e-4411-83fa-d258bbb06a6d req-e634104e-1c96-44fc-a731-1e4945553a9c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0853989 Nov 02 12:50:13.108595 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d75a3b3-aaeb-4035-a373-dc6587bc45d4 req-47e108c9-c7d0-46db-a1b3-2ff7f15963a2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:13.110067 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2d75a3b3-aaeb-4035-a373-dc6587bc45d4 req-47e108c9-c7d0-46db-a1b3-2ff7f15963a2 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=c468f0e1-3636-49b9-90c6-b90c643ed7d1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0998142 Nov 02 12:50:13.365959 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2d75a3b3-aaeb-4035-a373-dc6587bc45d4 req-0067f999-2c0c-4705-bd59-b556eeb5b9d7 service neutron] 10.222.0.90 "GET /v2.0/networks/c468f0e1-3636-49b9-90c6-b90c643ed7d1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1050587 Nov 02 12:50:13.365959 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2d75a3b3-aaeb-4035-a373-dc6587bc45d4 req-43fa689e-5754-4ebf-bb29-9b93bb6edf9f service neutron] 10.222.0.90 "GET /v2.0/networks/c468f0e1-3636-49b9-90c6-b90c643ed7d1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0921733 Nov 02 12:50:14.254722 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de00961a-d429-4ee5-9b02-5f8f09c9ad9e req-a9eafd11-085d-4dca-9baf-fd5d6471886e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:14.257270 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-de00961a-d429-4ee5-9b02-5f8f09c9ad9e req-a9eafd11-085d-4dca-9baf-fd5d6471886e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.0759699 Nov 02 12:50:14.325292 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-de00961a-d429-4ee5-9b02-5f8f09c9ad9e req-bd64f445-f9e8-4fe7-b481-527370920668 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0571392 Nov 02 12:50:14.443288 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 56100) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:14.848951 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-60e1ae58-29c1-41e7-8dd4-1471544eec25 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:14.949222 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-60e1ae58-29c1-41e7-8dd4-1471544eec25 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:15.025877 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-60e1ae58-29c1-41e7-8dd4-1471544eec25 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:15.068343 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-60e1ae58-29c1-41e7-8dd4-1471544eec25 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=f4d97aed41dc4e43b568bad24fb5916a&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6238186 Nov 02 12:50:15.069064 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-60e1ae58-29c1-41e7-8dd4-1471544eec25 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5afd8503-8b45-4807-8bbf-e6d973bf30a6,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:15.071210 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 56122) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:15.133738 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-5b5ad9d5-1d30-4bcc-a235-8110eeb21a01 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:15.160266 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-5b5ad9d5-1d30-4bcc-a235-8110eeb21a01 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:15.357600 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-5b5ad9d5-1d30-4bcc-a235-8110eeb21a01 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:15.362513 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-5b5ad9d5-1d30-4bcc-a235-8110eeb21a01 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:15.364049 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-5b5ad9d5-1d30-4bcc-a235-8110eeb21a01 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/5afd8503-8b45-4807-8bbf-e6d973bf30a6 HTTP/1.1" status: 204 len: 168 time: 0.2914634 Nov 02 12:50:15.377329 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b5ad9d5-1d30-4bcc-a235-8110eeb21a01 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5afd8503-8b45-4807-8bbf-e6d973bf30a6,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:15.459401 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c0e8464-fb2c-428d-92bc-f85c26097b16 req-6cf6e35a-ac82-4f82-869c-2428a39b547b tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:15.460860 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5c0e8464-fb2c-428d-92bc-f85c26097b16 req-6cf6e35a-ac82-4f82-869c-2428a39b547b tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.0573504 Nov 02 12:50:15.536343 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5c0e8464-fb2c-428d-92bc-f85c26097b16 req-0fb742c0-6b90-4175-8299-49bd2baba1c9 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0611117 Nov 02 12:50:15.761330 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 56154) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:16.008528 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-fcf8a54f-7118-44cb-9201-b417f66a7648 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:16.102236 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-fcf8a54f-7118-44cb-9201-b417f66a7648 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:16.219174 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-fcf8a54f-7118-44cb-9201-b417f66a7648 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:16.258938 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c97b978-0225-4e77-acde-d16f23ac0d0b req-b86e8620-31db-4e84-bc12-3cd086c41497 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:16.261749 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1c97b978-0225-4e77-acde-d16f23ac0d0b req-b86e8620-31db-4e84-bc12-3cd086c41497 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 946 time: 0.0935860 Nov 02 12:50:16.276767 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fcf8a54f-7118-44cb-9201-b417f66a7648 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5923028f-39a5-4f12-bef8-ab0ec56e47aa,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:16.290742 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-fcf8a54f-7118-44cb-9201-b417f66a7648 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=08f48dc9ad2a4bc2ae9a6a8ed8bcf932&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5275605 Nov 02 12:50:16.291966 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 56182) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:16.358683 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1c97b978-0225-4e77-acde-d16f23ac0d0b req-49c14e48-a772-498c-b9c7-17beba215f06 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/security-groups?id=f69cb03a-7a4d-435f-9600-1ab96756bd18&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0903451 Nov 02 12:50:16.372434 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-abef3d2a-7613-4378-8e5c-621df67a4074 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:16.407294 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-abef3d2a-7613-4378-8e5c-621df67a4074 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:16.551838 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-abef3d2a-7613-4378-8e5c-621df67a4074 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:16.561615 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-abef3d2a-7613-4378-8e5c-621df67a4074 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:16.561615 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-abef3d2a-7613-4378-8e5c-621df67a4074 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/5923028f-39a5-4f12-bef8-ab0ec56e47aa HTTP/1.1" status: 204 len: 168 time: 0.2656710 Nov 02 12:50:16.575098 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-abef3d2a-7613-4378-8e5c-621df67a4074 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5923028f-39a5-4f12-bef8-ab0ec56e47aa,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:16.800362 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-757b5b33-6e6d-4298-9a16-19c9ec94b6ab req-7d3f57bc-9703-4513-a07c-cd4ad6f55f57 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:16.802826 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-757b5b33-6e6d-4298-9a16-19c9ec94b6ab req-7d3f57bc-9703-4513-a07c-cd4ad6f55f57 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.1019287 Nov 02 12:50:16.887512 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-757b5b33-6e6d-4298-9a16-19c9ec94b6ab req-541add8f-077e-43aa-8cc2-10cb4b1dfcab tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0714750 Nov 02 12:50:17.539208 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-333e3cb3-ca88-4635-9c22-e4eb670649c3 req-f83d1944-96d1-42ac-af54-6f0309f7bae2 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:17.543649 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-333e3cb3-ca88-4635-9c22-e4eb670649c3 req-f83d1944-96d1-42ac-af54-6f0309f7bae2 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 946 time: 0.0962245 Nov 02 12:50:17.612495 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-333e3cb3-ca88-4635-9c22-e4eb670649c3 req-e2fa5807-c851-46f9-8dd1-0c5ebf4ecce7 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/security-groups?id=f69cb03a-7a4d-435f-9600-1ab96756bd18&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0609560 Nov 02 12:50:18.050721 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-82fdf55d-4eca-4c5e-add6-5671436ea6e5 req-d1697207-a3f6-4727-89b3-d879f7e8571c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:18.067296 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-82fdf55d-4eca-4c5e-add6-5671436ea6e5 req-d1697207-a3f6-4727-89b3-d879f7e8571c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.0837314 Nov 02 12:50:18.129652 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-82fdf55d-4eca-4c5e-add6-5671436ea6e5 req-76c68de1-81e1-4f77-ab68-3768c55e7f7e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0641568 Nov 02 12:50:18.786107 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 56268) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:18.821416 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c74c5be1-777f-446a-bee9-94d3fa740df2 req-fbe1e583-cb1e-4cf7-98b7-4128bb128967 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:18.825945 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c74c5be1-777f-446a-bee9-94d3fa740df2 req-fbe1e583-cb1e-4cf7-98b7-4128bb128967 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 946 time: 0.0978079 Nov 02 12:50:18.942748 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c74c5be1-777f-446a-bee9-94d3fa740df2 req-1cab8bd8-0a9d-4166-a7f2-f3923d811127 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/security-groups?id=f69cb03a-7a4d-435f-9600-1ab96756bd18&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1007366 Nov 02 12:50:19.165976 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c3f02640-54ab-4b19-bc65-94c44fa5c017 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:19.282708 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c3f02640-54ab-4b19-bc65-94c44fa5c017 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:19.340405 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7285f1f-c0f5-494b-bb7f-c6057f13b84c req-22204958-c134-4f16-838c-c6421eb95e87 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:19.343266 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c7285f1f-c0f5-494b-bb7f-c6057f13b84c req-22204958-c134-4f16-838c-c6421eb95e87 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.0920043 Nov 02 12:50:19.385207 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c3f02640-54ab-4b19-bc65-94c44fa5c017 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:19.433949 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c7285f1f-c0f5-494b-bb7f-c6057f13b84c req-cef28669-f54a-4113-ab3b-b673540cffca tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0825233 Nov 02 12:50:19.454893 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-c3f02640-54ab-4b19-bc65-94c44fa5c017 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=2e838880482948f6b7e9fbc900e3dd58&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6672575 Nov 02 12:50:19.459486 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 56294) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:19.459737 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3f02640-54ab-4b19-bc65-94c44fa5c017 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=22c86973-79ff-4eb4-bdda-58db26c48d83,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:19.554843 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f0eb9af6-d76d-427b-848d-10638316e258 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:19.581153 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f0eb9af6-d76d-427b-848d-10638316e258 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:19.764418 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f0eb9af6-d76d-427b-848d-10638316e258 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:19.769148 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f0eb9af6-d76d-427b-848d-10638316e258 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:19.778005 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-f0eb9af6-d76d-427b-848d-10638316e258 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/22c86973-79ff-4eb4-bdda-58db26c48d83 HTTP/1.1" status: 204 len: 168 time: 0.3100672 Nov 02 12:50:19.784547 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0eb9af6-d76d-427b-848d-10638316e258 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=22c86973-79ff-4eb4-bdda-58db26c48d83,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:20.120696 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa284db9-6ab7-407c-b81c-cb6765e3c04b req-7311c22f-785e-4877-8230-29d11a9de5b3 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:20.131433 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-aa284db9-6ab7-407c-b81c-cb6765e3c04b req-7311c22f-785e-4877-8230-29d11a9de5b3 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 946 time: 0.0950372 Nov 02 12:50:20.218191 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-aa284db9-6ab7-407c-b81c-cb6765e3c04b req-02e92434-6904-4ef5-9f60-5988fd786d8f tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/security-groups?id=f69cb03a-7a4d-435f-9600-1ab96756bd18&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0814629 Nov 02 12:50:20.604365 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-530281bb-0cca-44fc-bc4b-e53a42b09c22 req-4ddeb671-ceb6-42d5-98f8-376f72e33e65 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:20.605946 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-530281bb-0cca-44fc-bc4b-e53a42b09c22 req-4ddeb671-ceb6-42d5-98f8-376f72e33e65 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.0588505 Nov 02 12:50:20.695590 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-530281bb-0cca-44fc-bc4b-e53a42b09c22 req-06cf67d4-2392-48dc-b7c3-6108f9b230dc tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0790396 Nov 02 12:50:21.374357 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9df1d35a-0895-4a60-b6b1-edf8603eaa56 req-a134ba17-4017-44d9-b124-70609010127f tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:21.376587 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9df1d35a-0895-4a60-b6b1-edf8603eaa56 req-a134ba17-4017-44d9-b124-70609010127f tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 946 time: 0.0653017 Nov 02 12:50:21.457986 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9df1d35a-0895-4a60-b6b1-edf8603eaa56 req-fce09732-a2f6-4783-8cee-c3b6584fbe30 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/security-groups?id=f69cb03a-7a4d-435f-9600-1ab96756bd18&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0709176 Nov 02 12:50:21.855327 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2163cf13-19ba-485f-9078-a655a04799ff req-5a830c24-7d97-4cac-a7df-b4f3868014f1 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:21.857471 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2163cf13-19ba-485f-9078-a655a04799ff req-5a830c24-7d97-4cac-a7df-b4f3868014f1 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.0656309 Nov 02 12:50:21.925013 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2163cf13-19ba-485f-9078-a655a04799ff req-acbc7221-b445-49da-972b-cc98fd3fbf8d tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0598412 Nov 02 12:50:22.627105 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eebc6f70-b399-4924-8a7e-678461156dc7 req-5475481f-40d4-40cb-a344-b151fc9dbd0e tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:22.629885 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-eebc6f70-b399-4924-8a7e-678461156dc7 req-5475481f-40d4-40cb-a344-b151fc9dbd0e tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 946 time: 0.0678527 Nov 02 12:50:22.700193 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-eebc6f70-b399-4924-8a7e-678461156dc7 req-5705f702-032a-437d-82e0-c8c29dc711ee tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/security-groups?id=f69cb03a-7a4d-435f-9600-1ab96756bd18&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0627296 Nov 02 12:50:23.124300 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1c59a0ed-ebb8-4426-b067-6b6db691ec20 req-c96c2d10-873d-4a14-8532-4a9052f4fe3a tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:23.125755 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1c59a0ed-ebb8-4426-b067-6b6db691ec20 req-c96c2d10-873d-4a14-8532-4a9052f4fe3a tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.0757918 Nov 02 12:50:23.206732 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1c59a0ed-ebb8-4426-b067-6b6db691ec20 req-ef42ac61-5462-4970-a2d2-50e070b87cda tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0659654 Nov 02 12:50:23.341978 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6369ff3e-2043-4417-85ca-175e41394041 req-282e9999-72eb-40f5-9aa0-b96b6328a24b tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:23.344389 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6369ff3e-2043-4417-85ca-175e41394041 req-282e9999-72eb-40f5-9aa0-b96b6328a24b tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.90 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 946 time: 0.1094146 Nov 02 12:50:23.512086 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-f6b20369-aa0e-4881-80a8-322522fa0f54 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:23.570886 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-6369ff3e-2043-4417-85ca-175e41394041 req-baf144d0-cac0-4284-aa7b-6d5d9bcd2eb9 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Deleting port 95fa81ee-1b2f-4f18-86a7-90dc0d1aef46 {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:50:23.572063 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-6369ff3e-2043-4417-85ca-175e41394041 req-baf144d0-cac0-4284-aa7b-6d5d9bcd2eb9 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:23.757539 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-6369ff3e-2043-4417-85ca-175e41394041 req-baf144d0-cac0-4284-aa7b-6d5d9bcd2eb9 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] For port 95fa81ee-1b2f-4f18-86a7-90dc0d1aef46, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=95fa81ee-1b2f-4f18-86a7-90dc0d1aef46,segment=NetworkSegment(5e5859da-3633-448b-b117-00d1ace2041b),segment_id=5e5859da-3633-448b-b117-00d1ace2041b)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:50:23.758794 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-6369ff3e-2043-4417-85ca-175e41394041 req-baf144d0-cac0-4284-aa7b-6d5d9bcd2eb9 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:23.797318 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-6369ff3e-2043-4417-85ca-175e41394041 req-baf144d0-cac0-4284-aa7b-6d5d9bcd2eb9 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Calling delete_port for 95fa81ee-1b2f-4f18-86a7-90dc0d1aef46 owned by compute:nova {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:50:23.995949 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80e01d6f-f808-4922-a933-473a9b6a62ae req-449ef204-0ae9-442b-a240-2206a6436a2a tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:23.997895 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-80e01d6f-f808-4922-a933-473a9b6a62ae req-449ef204-0ae9-442b-a240-2206a6436a2a tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 946 time: 0.1822891 Nov 02 12:50:24.113967 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-80e01d6f-f808-4922-a933-473a9b6a62ae req-01c80e46-7ecc-44c3-8f6d-92665b12641d tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/security-groups?id=f69cb03a-7a4d-435f-9600-1ab96756bd18&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0940528 Nov 02 12:50:24.221054 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-6369ff3e-2043-4417-85ca-175e41394041 req-baf144d0-cac0-4284-aa7b-6d5d9bcd2eb9 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:24.237382 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['95fa81ee-1b2f-4f18-86a7-90dc0d1aef46'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:50:24.276527 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-baf144d0-cac0-4284-aa7b-6d5d9bcd2eb9 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Pushing event deleted for resources: {'Port': ['ID=95fa81ee-1b2f-4f18-86a7-90dc0d1aef46,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:24.375034 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-6369ff3e-2043-4417-85ca-175e41394041 req-baf144d0-cac0-4284-aa7b-6d5d9bcd2eb9 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] No DVR routers for this DVR port 95fa81ee-1b2f-4f18-86a7-90dc0d1aef46 on host hv-cinder-81632 {{(pid=108543) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 12:50:24.391074 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-6369ff3e-2043-4417-85ca-175e41394041 req-baf144d0-cac0-4284-aa7b-6d5d9bcd2eb9 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:24.395098 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6369ff3e-2043-4417-85ca-175e41394041 req-baf144d0-cac0-4284-aa7b-6d5d9bcd2eb9 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.90 "DELETE /v2.0/ports/95fa81ee-1b2f-4f18-86a7-90dc0d1aef46 HTTP/1.1" status: 204 len: 173 time: 1.0436246 Nov 02 12:50:24.395653 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b5f68f82-f48c-4ddc-9588-64082e35c753', 'name': 'network-vif-deleted', 'tag': '95fa81ee-1b2f-4f18-86a7-90dc0d1aef46'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:50:24.398519 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-896910ef-243b-44a7-b107-a481b88f0430" -d '{"events": [{"server_uuid": "b5f68f82-f48c-4ddc-9588-64082e35c753", "name": "network-vif-deleted", "tag": "95fa81ee-1b2f-4f18-86a7-90dc0d1aef46"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:50:24.463096 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4390d8d-4100-461a-bd15-a45d44707c2c req-7de4cb2e-535a-494c-b278-5e10448bda2c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:24.465881 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a4390d8d-4100-461a-bd15-a45d44707c2c req-7de4cb2e-535a-494c-b278-5e10448bda2c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.0922322 Nov 02 12:50:24.486939 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:50:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-67e4e5e2-bfbc-43cb-a200-2f7e19728db6 x-openstack-request-id: req-67e4e5e2-bfbc-43cb-a200-2f7e19728db6 {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:50:24.487540 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b5f68f82-f48c-4ddc-9588-64082e35c753", "name": "network-vif-deleted", "tag": "95fa81ee-1b2f-4f18-86a7-90dc0d1aef46", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:50:24.488606 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-67e4e5e2-bfbc-43cb-a200-2f7e19728db6 {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:50:24.488606 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b5f68f82-f48c-4ddc-9588-64082e35c753', 'name': 'network-vif-deleted', 'tag': '95fa81ee-1b2f-4f18-86a7-90dc0d1aef46', 'status': 'completed', 'code': 200} Nov 02 12:50:24.551543 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a4390d8d-4100-461a-bd15-a45d44707c2c req-80f9f821-13df-4246-9507-a8aa25e8ecbb tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0770667 Nov 02 12:50:25.332827 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-dd5d3a28-d0fc-41ba-a430-2b2070c18ef5 req-3cce9d72-73ad-4eca-a032-1939778f4fb5 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 210 time: 0.0525346 Nov 02 12:50:25.706032 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-14733103-f383-4c3b-bbbd-a846880052ff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:25.742202 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55470aa6-2b2a-4495-8d2d-dee5167ee4a6 req-a8cc6910-8ffb-4c62-87b9-584f821e837c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:25.745053 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-55470aa6-2b2a-4495-8d2d-dee5167ee4a6 req-a8cc6910-8ffb-4c62-87b9-584f821e837c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.0930061 Nov 02 12:50:25.815640 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-55470aa6-2b2a-4495-8d2d-dee5167ee4a6 req-4b732b12-97a3-4f78-bd8f-ad192ed725d4 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0540671 Nov 02 12:50:26.523967 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f98e5462-5b94-44c3-a4a3-ee8d51bb3a4e req-cc8ed3f4-69db-42c5-a340-333b6fd176ec tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 210 time: 0.0426505 Nov 02 12:50:26.838048 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:27.019597 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3a73534-c066-436d-8a8c-db2af6f6681a req-ac70c56a-4600-4bc8-aa76-043479683ff4 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:27.022930 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b3a73534-c066-436d-8a8c-db2af6f6681a req-ac70c56a-4600-4bc8-aa76-043479683ff4 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.0920804 Nov 02 12:50:27.108493 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b3a73534-c066-436d-8a8c-db2af6f6681a req-38eb592b-e0b9-4e69-8ad4-5ca63018bdfa tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0720220 Nov 02 12:50:27.280463 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 95fa81ee-1b2f-4f18-86a7-90dc0d1aef46 no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:50:27.323755 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] No Port match for: 95fa81ee-1b2f-4f18-86a7-90dc0d1aef46 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:50:27.325316 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 95fa81ee-1b2f-4f18-86a7-90dc0d1aef46 not bound to the agent host hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:50:27.642933 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 56542) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:28.038588 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-606067e8-382c-4943-9780-24a4beeac835 req-c0978896-f2df-4da0-b04c-6020bde67661 tempest-DeleteServersTestJSON-2137126400 tempest-DeleteServersTestJSON-2137126400-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5f68f82-f48c-4ddc-9588-64082e35c753 HTTP/1.1" status: 200 len: 210 time: 0.3086288 Nov 02 12:50:28.056833 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-10852290-0922-4c22-a629-6c0f4f1fb711 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:28.188736 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-10852290-0922-4c22-a629-6c0f4f1fb711 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:28.272804 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-10852290-0922-4c22-a629-6c0f4f1fb711 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:28.329328 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:28.363880 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-10852290-0922-4c22-a629-6c0f4f1fb711 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=dc7e525fccc0432098e37dd58d5ba6ae&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7185826 Nov 02 12:50:28.366926 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 56548) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:28.367851 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-10852290-0922-4c22-a629-6c0f4f1fb711 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d5a917cd-ad4d-4b70-a3c3-80444a240fdd,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:28.386334 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac34564b-2cf8-4fc5-8009-3f8b47bf15b6 req-6ff21774-7dce-4f2f-b4e1-7f93e859c574 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:28.389588 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ac34564b-2cf8-4fc5-8009-3f8b47bf15b6 req-6ff21774-7dce-4f2f-b4e1-7f93e859c574 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.1700630 Nov 02 12:50:28.441532 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-db1346e6-7d2e-40f6-b3c2-905baea9d853 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:28.478051 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-db1346e6-7d2e-40f6-b3c2-905baea9d853 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:28.511401 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ac34564b-2cf8-4fc5-8009-3f8b47bf15b6 req-b0b58c99-ed57-4d73-9bf4-d693da1a75ca tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1095502 Nov 02 12:50:28.917203 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-db1346e6-7d2e-40f6-b3c2-905baea9d853 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:28.921198 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-db1346e6-7d2e-40f6-b3c2-905baea9d853 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:28.922774 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-db1346e6-7d2e-40f6-b3c2-905baea9d853 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/d5a917cd-ad4d-4b70-a3c3-80444a240fdd HTTP/1.1" status: 204 len: 168 time: 0.5538905 Nov 02 12:50:28.935839 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-db1346e6-7d2e-40f6-b3c2-905baea9d853 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d5a917cd-ad4d-4b70-a3c3-80444a240fdd,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:29.702977 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 56582) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:29.724086 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e82f07c-243b-4b07-9989-00f852fce170 req-d87173ef-0002-4b90-8789-f2ca9ab5d6e9 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:29.728222 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5e82f07c-243b-4b07-9989-00f852fce170 req-d87173ef-0002-4b90-8789-f2ca9ab5d6e9 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.1038418 Nov 02 12:50:29.738772 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-50e8be40-65a2-46f0-a17c-ad59fd4888a0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:29.848823 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5e82f07c-243b-4b07-9989-00f852fce170 req-d69d2a8a-e445-4b61-8214-82e7b1c3bcc8 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0984242 Nov 02 12:50:29.893794 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-50e8be40-65a2-46f0-a17c-ad59fd4888a0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:29.952046 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-50e8be40-65a2-46f0-a17c-ad59fd4888a0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:30.002249 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-50e8be40-65a2-46f0-a17c-ad59fd4888a0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cb049ede-4776-42f0-a799-45dea09866c7,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:30.009383 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-50e8be40-65a2-46f0-a17c-ad59fd4888a0 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=aa8636d4721941b0aab85e28ee8e27e7&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3040590 Nov 02 12:50:30.012470 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 56588) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:30.079873 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-227cedf5-957e-46c8-8e45-dbae0acd77b2 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:30.111029 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-227cedf5-957e-46c8-8e45-dbae0acd77b2 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:30.328749 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-227cedf5-957e-46c8-8e45-dbae0acd77b2 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:30.332593 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-227cedf5-957e-46c8-8e45-dbae0acd77b2 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:30.337073 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-227cedf5-957e-46c8-8e45-dbae0acd77b2 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/cb049ede-4776-42f0-a799-45dea09866c7 HTTP/1.1" status: 204 len: 168 time: 0.3203757 Nov 02 12:50:30.350074 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-227cedf5-957e-46c8-8e45-dbae0acd77b2 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cb049ede-4776-42f0-a799-45dea09866c7,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:30.826812 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:31.085359 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4280d982-7934-435d-8ea7-66a7ac6d8c3a req-b8668e85-8edb-489a-8456-7f71cef5eb3b tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:31.088107 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4280d982-7934-435d-8ea7-66a7ac6d8c3a req-b8668e85-8edb-489a-8456-7f71cef5eb3b tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.0909109 Nov 02 12:50:31.167257 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4280d982-7934-435d-8ea7-66a7ac6d8c3a req-ff740004-7e1b-424b-b986-e469bdf934db tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0712719 Nov 02 12:50:32.349009 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5c16f976-ef7e-4086-b3b5-0c169ced13d3 req-78e8ce49-38b1-4d26-87dc-15a83a41ca40 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:32.355272 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5c16f976-ef7e-4086-b3b5-0c169ced13d3 req-78e8ce49-38b1-4d26-87dc-15a83a41ca40 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.0782571 Nov 02 12:50:32.440311 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5c16f976-ef7e-4086-b3b5-0c169ced13d3 req-93890ccd-583d-42e3-8881-4c18445f64e7 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0773470 Nov 02 12:50:33.204242 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:33.221917 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 56680) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:33.293812 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_v2 [None req-0908aaa8-d715-4c13-bede-771abd531fed admin admin] Deleting subnet 4d3908d6-4378-401d-b0c3-b220a11a4a6a {{(pid=108542) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 02 12:50:33.298632 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-0908aaa8-d715-4c13-bede-771abd531fed admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:33.346160 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-0908aaa8-d715-4c13-bede-771abd531fed admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3344686'] for subnet, precommit_delete_associations {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:33.410351 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-0908aaa8-d715-4c13-bede-771abd531fed admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-933154'] for subnet, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:33.602869 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-0908aaa8-d715-4c13-bede-771abd531fed admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-933141', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126478215', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126185624'] for subnet, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:33.670692 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0908aaa8-d715-4c13-bede-771abd531fed admin admin] Pushing event deleted for resources: {'Subnet': ['ID=4d3908d6-4378-401d-b0c3-b220a11a4a6a,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:33.672015 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-81165d15-9fbf-4929-8e59-4f9c57ca147c req-a3685c03-ff5c-4ef6-92d1-d85854b9c2e3 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:33.673623 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-81165d15-9fbf-4929-8e59-4f9c57ca147c req-a3685c03-ff5c-4ef6-92d1-d85854b9c2e3 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.0912774 Nov 02 12:50:33.683567 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-0908aaa8-d715-4c13-bede-771abd531fed admin admin] Publish callbacks [] for subnet, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:33.690598 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-0908aaa8-d715-4c13-bede-771abd531fed admin admin] 10.222.0.98 "DELETE /v2.0/subnets/4d3908d6-4378-401d-b0c3-b220a11a4a6a HTTP/1.1" status: 204 len: 168 time: 0.4667053 Nov 02 12:50:33.696831 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 56692) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:33.865683 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-81165d15-9fbf-4929-8e59-4f9c57ca147c req-04446e73-178e-4476-9946-c1b6bc1bccc8 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1809411 Nov 02 12:50:33.889412 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-972735'] for network, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:34.074985 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-930985', 'neutron.services.segments.db._delete_segments_for_network-8738449897966'] for network, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:34.117654 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] Subscribe: > segment before_delete 55550000 {{(pid=108543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:50:34.118035 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] Subscribe: > subnet precommit_delete_associations 55550000 {{(pid=108543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:50:34.119240 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] Subscribe: > segment_host_mapping after_create 55550000 {{(pid=108543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:50:34.119829 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] Subscribe: > port after_create 55550000 {{(pid=108543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:50:34.120466 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] Subscribe: > port after_delete 55550000 {{(pid=108543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:50:34.120976 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] Subscribe: > port after_update 55550000 {{(pid=108543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:50:34.121539 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] Subscribe: > segment after_delete 55550000 {{(pid=108543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:50:34.122655 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] Subscribe: > subnet after_create 55550000 {{(pid=108543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:50:34.123206 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=108543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:50:34.123784 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] Subscribe: > subnet after_update 55550000 {{(pid=108543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:50:34.246238 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] Subscribe: > subnet after_create 55550000 {{(pid=108543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:50:34.246726 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] Subscribe: > subnet after_delete 55550000 {{(pid=108543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:50:34.247763 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] Subscribe: > subnet before_create 55550000 {{(pid=108543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:50:34.248462 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] Subscribe: > subnet before_update 55550000 {{(pid=108543) subscribe /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:45}} Nov 02 12:50:34.248992 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.services.segments.db [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['73093621-5f08-4d97-a54e-da0042e8dde7']}} {{(pid=108543) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:50:34.275724 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.services.segments.db [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '5e5859da-3633-448b-b117-00d1ace2041b') {'for_net_delete': True} {{(pid=108543) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:50:34.276156 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.services.segments.db [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '5e5859da-3633-448b-b117-00d1ace2041b') {} {{(pid=108543) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:50:34.301535 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738449902583', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3308610'] for segment, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:34.329086 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:34.342670 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] Releasing vlan 894 on physical network physnet1 to pool {{(pid=108543) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 02 12:50:34.343299 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126393740'] for segment, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: from cryptography.utils import int_from_bytes Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: from cryptography.utils import int_from_bytes Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: Traceback (most recent call last): Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: timer() Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: cb(*args, **kw) Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: return func(*args, **kwargs) Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: self._notify() Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: self.callback(batched_events) Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: event.method(event) Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: aggregate_uuid = self.p_client.list_aggregates( Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: return f(self, *a, **k) Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: return self._get(url).json() Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: return self.request(url, 'GET', **kwargs) Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: base_url = self.get_endpoint(auth, allow=allow, Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 02 12:50:34.353596 dv-cinder-816324-1-iscsi neutron-server[108543]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 02 12:50:34.550194 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-930976', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1594946'] for network, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:34.558929 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:34.564088 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] 10.222.0.98 "DELETE /v2.0/networks/73093621-5f08-4d97-a54e-da0042e8dde7 HTTP/1.1" status: 204 len: 168 time: 0.8660800 Nov 02 12:50:34.582404 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-959a817e-7ab9-421f-b008-46e960ac74bd admin admin] Pushing event deleted for resources: {'Network': ['ID=73093621-5f08-4d97-a54e-da0042e8dde7,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:35.071014 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1093d90c-3d1c-412d-8243-caff9b87a29f req-a49de044-2a1e-4d50-980b-6b21f8c436d5 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:35.074105 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1093d90c-3d1c-412d-8243-caff9b87a29f req-a49de044-2a1e-4d50-980b-6b21f8c436d5 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.0759788 Nov 02 12:50:35.146463 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 56732) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:35.159496 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1093d90c-3d1c-412d-8243-caff9b87a29f req-2a142665-e9af-4bcf-9c15-062cf1047956 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0754850 Nov 02 12:50:35.207959 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-fd8ca23a-efe4-432b-b5d5-0fc20a20e187 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=ae50c135750c4418b0b05f5bf2979217&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0599828 Nov 02 12:50:35.210907 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 56734) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:35.290722 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d62e5f46-4d92-4502-b54b-4e348598129e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:35.330839 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d62e5f46-4d92-4502-b54b-4e348598129e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:35.482178 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d62e5f46-4d92-4502-b54b-4e348598129e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:35.496513 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d62e5f46-4d92-4502-b54b-4e348598129e admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:35.496513 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-d62e5f46-4d92-4502-b54b-4e348598129e admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/f69cb03a-7a4d-435f-9600-1ab96756bd18 HTTP/1.1" status: 204 len: 168 time: 0.2820132 Nov 02 12:50:35.515941 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d62e5f46-4d92-4502-b54b-4e348598129e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f69cb03a-7a4d-435f-9600-1ab96756bd18,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:36.325155 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ab99693-580d-49ee-b1b1-d88ea73c2718 req-a1ee049f-ad0a-4dd3-92c1-f188afc70370 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:36.327866 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1ab99693-580d-49ee-b1b1-d88ea73c2718 req-a1ee049f-ad0a-4dd3-92c1-f188afc70370 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.0702376 Nov 02 12:50:36.432296 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1ab99693-580d-49ee-b1b1-d88ea73c2718 req-be19d873-e4c3-4487-95cb-8fe9626250bc tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0929041 Nov 02 12:50:36.469931 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:50:37.091809 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 56830) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:37.250933 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-818f9c94-cbe6-4471-88f3-5431914c4001 admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeNegativeTest-1642991561-network', 'tenant_id': 'dfe80527be524672a94a38908e154182'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:50:37.341594 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-818f9c94-cbe6-4471-88f3-5431914c4001 admin admin] Made reservation on behalf of dfe80527be524672a94a38908e154182 for: {'network': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:50:37.345581 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-818f9c94-cbe6-4471-88f3-5431914c4001 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for network, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:37.361540 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-818f9c94-cbe6-4471-88f3-5431914c4001 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:37.514966 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-818f9c94-cbe6-4471-88f3-5431914c4001 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:37.598151 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-818f9c94-cbe6-4471-88f3-5431914c4001 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:37.641719 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fa7dc547-db8a-4728-9c41-41fd72707ce0 req-a6effed4-78e8-45ee-88a2-85eda228e497 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:37.646359 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fa7dc547-db8a-4728-9c41-41fd72707ce0 req-a6effed4-78e8-45ee-88a2-85eda228e497 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.1011026 Nov 02 12:50:37.648116 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-818f9c94-cbe6-4471-88f3-5431914c4001 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=97f5e46c-1e9a-4380-8d78-d2449eba5bf1,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:37.656154 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-818f9c94-cbe6-4471-88f3-5431914c4001 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 862} {{(pid=108543) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 02 12:50:37.683511 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-818f9c94-cbe6-4471-88f3-5431914c4001 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:37.684137 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.db.segments_db [None req-818f9c94-cbe6-4471-88f3-5431914c4001 admin admin] Added segment e912b2b1-808c-4d37-a99d-fcfdb9d2a5db of type vlan for network bfe7dfe3-4b23-4454-b60a-4955be8d2d31 Nov 02 12:50:37.765168 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-818f9c94-cbe6-4471-88f3-5431914c4001 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738449409639'] for network, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:37.785018 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fa7dc547-db8a-4728-9c41-41fd72707ce0 req-167c0d43-3811-4da1-b7fd-9663b060358d tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1304855 Nov 02 12:50:37.892606 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-818f9c94-cbe6-4471-88f3-5431914c4001 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for network, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:37.896135 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-818f9c94-cbe6-4471-88f3-5431914c4001 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:37.896135 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-818f9c94-cbe6-4471-88f3-5431914c4001 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:38.034095 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-818f9c94-cbe6-4471-88f3-5431914c4001 admin admin] Pushing event updated for resources: {'Network': ['ID=bfe7dfe3-4b23-4454-b60a-4955be8d2d31,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:38.045382 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-818f9c94-cbe6-4471-88f3-5431914c4001 admin admin] 10.222.0.98 "POST /v2.0/networks HTTP/1.1" status: 201 len: 888 time: 0.9520915 Nov 02 12:50:38.050947 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 56858) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:38.053309 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Network bfe7dfe3-4b23-4454-b60a-4955be8d2d31 details requested by agent ovs-agent-dv-cinder-816324-1-iscsi with host dv-cinder-816324-1-iscsi {{(pid=108544) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 02 12:50:38.062739 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-9301e4df-3fda-4a68-b7ea-f5dd4ab3ebce admin admin] Request body: {'subnet': {'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeNegativeTest-1642991561-subnet', 'tenant_id': 'dfe80527be524672a94a38908e154182', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:50:38.196865 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9301e4df-3fda-4a68-b7ea-f5dd4ab3ebce admin admin] Made reservation on behalf of dfe80527be524672a94a38908e154182 for: {'subnet': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:50:38.202049 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-9301e4df-3fda-4a68-b7ea-f5dd4ab3ebce admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126244823'] for subnet, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:38.635384 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0dafc5e6-e3d5-46ac-906c-e4a977b64bb3 req-cf1e4cee-012d-4821-816f-0791d2fb0786 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:38.639406 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0dafc5e6-e3d5-46ac-906c-e4a977b64bb3 req-cf1e4cee-012d-4821-816f-0791d2fb0786 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 1099 time: 0.1841207 Nov 02 12:50:38.728206 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0dafc5e6-e3d5-46ac-906c-e4a977b64bb3 req-7e003072-fe5a-42a0-b42c-7771ae33fbb1 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0787635 Nov 02 12:50:38.733312 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-9301e4df-3fda-4a68-b7ea-f5dd4ab3ebce admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126393185', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126244837'] for subnet, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:38.800422 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9301e4df-3fda-4a68-b7ea-f5dd4ab3ebce admin admin] Pushing event updated for resources: {'Subnet': ['ID=8f42833a-0a0e-4198-a7cf-e79133593615,revision_number=0']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:38.811501 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9301e4df-3fda-4a68-b7ea-f5dd4ab3ebce admin admin] Checking segment: {'id': 'e912b2b1-808c-4d37-a99d-fcfdb9d2a5db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108543) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:50:38.812387 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9301e4df-3fda-4a68-b7ea-f5dd4ab3ebce admin admin] Network hostable DHCP agents. Network: bfe7dfe3-4b23-4454-b60a-4955be8d2d31, hostable agents: ['1b947f40-f8bf-4088-a5dc-35ee29d90d78'], hosted agents: [] {{(pid=108543) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 02 12:50:38.909161 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9301e4df-3fda-4a68-b7ea-f5dd4ab3ebce admin admin] Network bfe7dfe3-4b23-4454-b60a-4955be8d2d31 is scheduled to be hosted by DHCP agent 1b947f40-f8bf-4088-a5dc-35ee29d90d78 with binding_index 1 {{(pid=108543) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 02 12:50:39.003578 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-171205f3-9b10-4ffa-b1cf-8ee5625d0950 req-2bd5bd76-87e4-441f-aabd-e92f7e5b47cb tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:39.007168 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-171205f3-9b10-4ffa-b1cf-8ee5625d0950 req-2bd5bd76-87e4-441f-aabd-e92f7e5b47cb tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.1003046 Nov 02 12:50:39.008507 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [None req-9301e4df-3fda-4a68-b7ea-f5dd4ab3ebce admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816324-1-iscsi, bfe7dfe3-4b23-4454-b60a-4955be8d2d31) {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:50:39.018562 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9301e4df-3fda-4a68-b7ea-f5dd4ab3ebce admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:39.019574 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-9301e4df-3fda-4a68-b7ea-f5dd4ab3ebce admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for subnet, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:39.025980 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-74c369ec-4bd3-45e2-befa-e2f0138e8a29 None None] Network bfe7dfe3-4b23-4454-b60a-4955be8d2d31 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:50:39.104146 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-171205f3-9b10-4ffa-b1cf-8ee5625d0950 req-52ad69fc-0a88-4dc6-aa07-afe0ae8d36af tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0803952 Nov 02 12:50:39.151598 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-9301e4df-3fda-4a68-b7ea-f5dd4ab3ebce admin admin] 10.222.0.98 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 852 time: 1.0971425 Nov 02 12:50:39.333523 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ec0e74b2-6e45-481f-8f3a-a6fed7507fe2 None None] Network bfe7dfe3-4b23-4454-b60a-4955be8d2d31 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:50:39.336512 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 56922) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:39.388012 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 56926) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:39.812606 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-e251700b-c5b3-4a2f-8a65-a29390cbdb39 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:39.840229 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 56940) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:39.883418 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b5ab101f-0fad-4727-b677-1ae20053d679 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:39.995903 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-0d052366-590f-4ef2-b218-9a6c0f16023e admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:40.055041 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-e251700b-c5b3-4a2f-8a65-a29390cbdb39 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:40.118459 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-e251700b-c5b3-4a2f-8a65-a29390cbdb39 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:40.236068 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-0d052366-590f-4ef2-b218-9a6c0f16023e admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:40.267761 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-e251700b-c5b3-4a2f-8a65-a29390cbdb39 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=23f1e23e2b374be1a2c41d35004fd134&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9296732 Nov 02 12:50:40.271755 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 56960) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:40.283987 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b5ab101f-0fad-4727-b677-1ae20053d679 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:40.329187 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-0d052366-590f-4ef2-b218-9a6c0f16023e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:40.339728 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e251700b-c5b3-4a2f-8a65-a29390cbdb39 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7890b131-1b1a-4a0a-bbfd-0266ec5ef284,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:40.372771 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b5ab101f-0fad-4727-b677-1ae20053d679 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:40.431880 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-0d052366-590f-4ef2-b218-9a6c0f16023e admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=9477d3565bd1402e8cb5ab2cb7ef774e&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5851119 Nov 02 12:50:40.434544 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 56964) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:40.435296 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0d052366-590f-4ef2-b218-9a6c0f16023e admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d4170241-fae3-436b-94dc-998227d726a8,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:40.476998 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c6506ab-0145-4ac6-9f8b-b4e90edce26f req-e2d8c0c7-7d41-494b-aea3-4cbdfcdf960c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:40.482448 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2c6506ab-0145-4ac6-9f8b-b4e90edce26f req-e2d8c0c7-7d41-494b-aea3-4cbdfcdf960c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.1868188 Nov 02 12:50:40.491379 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c63d805e-ee2b-4fe7-be66-9294587c5fcd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:40.515589 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-b5ab101f-0fad-4727-b677-1ae20053d679 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=5aab22d7be974a6bafee15f7c23afb67&name=default HTTP/1.1" status: 200 len: 2996 time: 1.1267207 Nov 02 12:50:40.529128 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 56974) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:40.576393 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b5ab101f-0fad-4727-b677-1ae20053d679 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=b02ce6de-6362-43d7-95b3-f7a80557b0f7,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:40.582886 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c63d805e-ee2b-4fe7-be66-9294587c5fcd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:40.642153 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a8355c10-fda7-4a65-a1a3-bee23ef23fa6 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:40.683600 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a8355c10-fda7-4a65-a1a3-bee23ef23fa6 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:40.709044 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2c6506ab-0145-4ac6-9f8b-b4e90edce26f req-05f9ec14-1b73-4989-9c6f-12c42065a9eb tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2135305 Nov 02 12:50:40.713007 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dd6ba947-8a21-404e-8075-fe9767991152 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:40.775788 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dd6ba947-8a21-404e-8075-fe9767991152 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:40.874904 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-b6e40dcb-9b54-474b-8b01-58e209cfee83 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:40.876498 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-b6e40dcb-9b54-474b-8b01-58e209cfee83 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/networks?id=bfe7dfe3-4b23-4454-b60a-4955be8d2d31 HTTP/1.1" status: 200 len: 815 time: 0.2450318 Nov 02 12:50:40.882268 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a8355c10-fda7-4a65-a1a3-bee23ef23fa6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:40.885497 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a8355c10-fda7-4a65-a1a3-bee23ef23fa6 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:40.887026 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-a8355c10-fda7-4a65-a1a3-bee23ef23fa6 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/d4170241-fae3-436b-94dc-998227d726a8 HTTP/1.1" status: 204 len: 168 time: 0.4476845 Nov 02 12:50:40.899419 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8355c10-fda7-4a65-a1a3-bee23ef23fa6 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d4170241-fae3-436b-94dc-998227d726a8,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:40.919665 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c63d805e-ee2b-4fe7-be66-9294587c5fcd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:40.922400 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c63d805e-ee2b-4fe7-be66-9294587c5fcd admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:40.924306 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-c63d805e-ee2b-4fe7-be66-9294587c5fcd admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/7890b131-1b1a-4a0a-bbfd-0266ec5ef284 HTTP/1.1" status: 204 len: 168 time: 0.6383684 Nov 02 12:50:40.939277 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-df62d627-ded5-4378-8091-5faa7aa1c5e2 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/quotas/dfe80527be524672a94a38908e154182 HTTP/1.1" status: 200 len: 375 time: 0.0503466 Nov 02 12:50:40.940683 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c63d805e-ee2b-4fe7-be66-9294587c5fcd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7890b131-1b1a-4a0a-bbfd-0266ec5ef284,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:40.981489 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dd6ba947-8a21-404e-8075-fe9767991152 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:40.987206 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dd6ba947-8a21-404e-8075-fe9767991152 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:40.989808 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-dd6ba947-8a21-404e-8075-fe9767991152 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/b02ce6de-6362-43d7-95b3-f7a80557b0f7 HTTP/1.1" status: 204 len: 168 time: 0.4586747 Nov 02 12:50:41.003547 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-54f1c1d5-0ca1-41e1-bb0e-99e0af0c697c tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?tenant_id=dfe80527be524672a94a38908e154182&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0399971 Nov 02 12:50:41.015707 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dd6ba947-8a21-404e-8075-fe9767991152 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=b02ce6de-6362-43d7-95b3-f7a80557b0f7,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:41.124445 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-f11e19d7-5d06-4dc4-992c-d59cd04bf0f4 service neutron] 10.222.0.98 "GET /v2.0/networks/bfe7dfe3-4b23-4454-b60a-4955be8d2d31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1046381 Nov 02 12:50:41.280276 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-b559060a-0fec-4546-a7ff-00aeb8d71add service neutron] 10.222.0.98 "GET /v2.0/networks/bfe7dfe3-4b23-4454-b60a-4955be8d2d31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1481822 Nov 02 12:50:41.688336 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1cf7542a-e1c1-4432-bce6-044571f40169 req-7f27b3b3-1e6a-4db8-a448-e8fc6f300111 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 210 time: 0.0513542 Nov 02 12:50:41.920281 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-14aa6efa-6f1b-43cb-b23c-3269c9b1dea0 req-e875b0f3-e4b8-45af-8ecf-724eab147d6a tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:41.934080 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-14aa6efa-6f1b-43cb-b23c-3269c9b1dea0 req-e875b0f3-e4b8-45af-8ecf-724eab147d6a tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.1027789 Nov 02 12:50:42.006311 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57012) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:42.055352 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-85b748f5-9cad-42ab-b0b5-df3807e77623 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:42.070037 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-14aa6efa-6f1b-43cb-b23c-3269c9b1dea0 req-5b355310-3f3a-4087-b9d6-ec5662f8c66c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1333878 Nov 02 12:50:42.216543 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-85b748f5-9cad-42ab-b0b5-df3807e77623 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:42.289609 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-85b748f5-9cad-42ab-b0b5-df3807e77623 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:42.345036 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-64419cf9-f770-4418-abe8-8759ba245491 req-9f4af752-9a71-498c-8351-543e54ea79cf tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:42.363767 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-64419cf9-f770-4418-abe8-8759ba245491 req-9f4af752-9a71-498c-8351-543e54ea79cf tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.1279578 Nov 02 12:50:42.390123 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-85b748f5-9cad-42ab-b0b5-df3807e77623 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=1b6f888aecf54cb5a7e503d5f05f3ed3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3799794 Nov 02 12:50:42.390419 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 57024) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:42.396287 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85b748f5-9cad-42ab-b0b5-df3807e77623 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2f59fa42-616b-4050-8e56-249b88c547ae,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:42.509458 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-957705da-47d4-43ef-8c01-e8b5b1731ae1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:42.518605 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-64419cf9-f770-4418-abe8-8759ba245491 req-e6a7e50b-8f9c-4ef8-b468-900b3007dda3 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1531746 Nov 02 12:50:42.571353 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-957705da-47d4-43ef-8c01-e8b5b1731ae1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:42.625573 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57030) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:42.649465 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-7801b7bf-a9b9-45e4-8772-5d60613bd1a8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:42.728854 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-957705da-47d4-43ef-8c01-e8b5b1731ae1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:42.741144 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57036) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:42.741858 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-957705da-47d4-43ef-8c01-e8b5b1731ae1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:42.748108 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-957705da-47d4-43ef-8c01-e8b5b1731ae1 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/2f59fa42-616b-4050-8e56-249b88c547ae HTTP/1.1" status: 204 len: 168 time: 0.3550832 Nov 02 12:50:42.786249 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-957705da-47d4-43ef-8c01-e8b5b1731ae1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2f59fa42-616b-4050-8e56-249b88c547ae,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:42.812182 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2e7cb5a5-75b6-4df2-b065-492c032aff3b admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:42.952953 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3e770dcc-9cdb-4e05-afcf-2f13f5f0faf2 req-d0195433-4ac9-42f5-97e2-903093dade4f tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 210 time: 0.0962479 Nov 02 12:50:43.039598 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-7801b7bf-a9b9-45e4-8772-5d60613bd1a8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:43.083745 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2e7cb5a5-75b6-4df2-b065-492c032aff3b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:43.160624 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-7801b7bf-a9b9-45e4-8772-5d60613bd1a8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:43.177476 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2e7cb5a5-75b6-4df2-b065-492c032aff3b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:43.256251 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-7801b7bf-a9b9-45e4-8772-5d60613bd1a8 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=4a4ad84d0b2d45cca3d1bb8135b503a1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6292126 Nov 02 12:50:43.261049 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 57042) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:43.263739 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-2e7cb5a5-75b6-4df2-b065-492c032aff3b admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=c59b5b9550be4ec9ac2b4c198c140ad9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5195000 Nov 02 12:50:43.267145 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57044) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:43.275995 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7801b7bf-a9b9-45e4-8772-5d60613bd1a8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6e4265f7-b3e5-4c88-b39f-cab7443a2d53,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:43.371782 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-9cc87eb6-a606-4f74-8c8a-cee9c04e04e5 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:43.374288 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e7cb5a5-75b6-4df2-b065-492c032aff3b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0b735f91-9d85-4d94-ab2c-43e0b08a4d6b,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:43.410406 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-bafd4a84-36cf-427a-bb85-fc345ac8b326 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:43.426756 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-9cc87eb6-a606-4f74-8c8a-cee9c04e04e5 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:43.487784 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-bafd4a84-36cf-427a-bb85-fc345ac8b326 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:43.533189 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 57052) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:43.668909 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-9cc87eb6-a606-4f74-8c8a-cee9c04e04e5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:43.679398 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-9cc87eb6-a606-4f74-8c8a-cee9c04e04e5 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:43.689409 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-9cc87eb6-a606-4f74-8c8a-cee9c04e04e5 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/6e4265f7-b3e5-4c88-b39f-cab7443a2d53 HTTP/1.1" status: 204 len: 168 time: 0.4260826 Nov 02 12:50:43.695687 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-bafd4a84-36cf-427a-bb85-fc345ac8b326 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:43.707152 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-bafd4a84-36cf-427a-bb85-fc345ac8b326 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:43.713878 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-bafd4a84-36cf-427a-bb85-fc345ac8b326 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/0b735f91-9d85-4d94-ab2c-43e0b08a4d6b HTTP/1.1" status: 204 len: 168 time: 0.4451380 Nov 02 12:50:43.723520 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9cc87eb6-a606-4f74-8c8a-cee9c04e04e5 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6e4265f7-b3e5-4c88-b39f-cab7443a2d53,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:43.793418 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bafd4a84-36cf-427a-bb85-fc345ac8b326 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0b735f91-9d85-4d94-ab2c-43e0b08a4d6b,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:43.904779 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-496080ee-34f8-46d7-a2b2-9867d97a833f admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:44.089489 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-496080ee-34f8-46d7-a2b2-9867d97a833f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:44.151097 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2e142b91-6566-45c2-b2f8-71232db258bf req-9e89c9fd-c896-4acb-b622-ec818eaec84a tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 210 time: 0.0586028 Nov 02 12:50:44.207411 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-496080ee-34f8-46d7-a2b2-9867d97a833f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:44.260000 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-496080ee-34f8-46d7-a2b2-9867d97a833f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fb668b8f-6f49-4382-983b-af2f723d0468,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:44.268196 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-496080ee-34f8-46d7-a2b2-9867d97a833f admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=7dc9ba6af00a4cbbac8df70c9f5aa12f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7292638 Nov 02 12:50:44.271287 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 57076) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:44.384062 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-12365272-1700-45fb-8102-6924f1348e90 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:44.430459 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-12365272-1700-45fb-8102-6924f1348e90 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:44.628884 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-12365272-1700-45fb-8102-6924f1348e90 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:44.633025 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-12365272-1700-45fb-8102-6924f1348e90 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:44.639315 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-12365272-1700-45fb-8102-6924f1348e90 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/fb668b8f-6f49-4382-983b-af2f723d0468 HTTP/1.1" status: 204 len: 168 time: 0.3614447 Nov 02 12:50:44.660842 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12365272-1700-45fb-8102-6924f1348e90 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fb668b8f-6f49-4382-983b-af2f723d0468,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:45.028085 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 57094) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:45.073820 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0ce6af25-1db6-4643-a30e-d00afadca7c0 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:45.298879 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57098) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:45.327855 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-19859837-8d62-4c67-8768-7d03d636c2e6 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:45.374005 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-19859837-8d62-4c67-8768-7d03d636c2e6 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.90 "GET /v2.0/networks?id=bfe7dfe3-4b23-4454-b60a-4955be8d2d31 HTTP/1.1" status: 200 len: 815 time: 0.2723782 Nov 02 12:50:45.374233 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f8561e93-c531-4e27-9321-4cbda8d4cc39 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:45.374428 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-48420695-9e14-44b7-8ac2-689243568b89 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Request body: {'port': {'device_id': 'b5d96599-f79e-47ef-bc01-a14589555ab4', 'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31', 'admin_state_up': True, 'tenant_id': 'dfe80527be524672a94a38908e154182'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:50:45.511889 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f8561e93-c531-4e27-9321-4cbda8d4cc39 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:45.535343 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-29a708d5-61da-4679-92b8-9021a10463b1 req-ecf56fa6-3ab1-4387-9803-c8802aa64be9 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 210 time: 0.1483152 Nov 02 12:50:45.568692 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0ce6af25-1db6-4643-a30e-d00afadca7c0 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:45.589741 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f8561e93-c531-4e27-9321-4cbda8d4cc39 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:45.721184 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0ce6af25-1db6-4643-a30e-d00afadca7c0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:45.729097 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-f8561e93-c531-4e27-9321-4cbda8d4cc39 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=3b7b5986403a4860abca3576fffc3777&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4293640 Nov 02 12:50:45.730869 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8561e93-c531-4e27-9321-4cbda8d4cc39 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c962ec7b-f776-4bdf-97fe-8538615c353c,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:45.736143 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57108) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:45.798309 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0ce6af25-1db6-4643-a30e-d00afadca7c0 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5b5dba9d-79a0-43bc-b1b0-f4d61cc48074,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:45.904175 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-48420695-9e14-44b7-8ac2-689243568b89 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Made reservation on behalf of dfe80527be524672a94a38908e154182 for: {'port': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:50:45.904814 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-70ca24aa-9317-4815-a5d7-9fe140898ad8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:45.921208 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-48420695-9e14-44b7-8ac2-689243568b89 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:45.944732 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-70ca24aa-9317-4815-a5d7-9fe140898ad8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:45.956041 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-0ce6af25-1db6-4643-a30e-d00afadca7c0 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=cda6c2be0e2a4fd6a11fe5e2afca0434&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9256620 Nov 02 12:50:45.960952 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 57112) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:46.029921 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd1f3f47-95f7-45d6-a100-5a5345c03048 req-4dfb9738-6569-4ac4-84b2-b733a6fcf039 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:46.032412 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bd1f3f47-95f7-45d6-a100-5a5345c03048 req-4dfb9738-6569-4ac4-84b2-b733a6fcf039 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.2212231 Nov 02 12:50:46.156076 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-a8423e52-eb54-4f1e-b9a0-1843e4ae0651 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:46.190520 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bd1f3f47-95f7-45d6-a100-5a5345c03048 req-0f8078ea-aa9e-406f-bf00-1f71855f8026 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1405022 Nov 02 12:50:46.218594 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-a8423e52-eb54-4f1e-b9a0-1843e4ae0651 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:46.300780 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-70ca24aa-9317-4815-a5d7-9fe140898ad8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:46.305187 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-70ca24aa-9317-4815-a5d7-9fe140898ad8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:46.306814 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-70ca24aa-9317-4815-a5d7-9fe140898ad8 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/c962ec7b-f776-4bdf-97fe-8538615c353c HTTP/1.1" status: 204 len: 168 time: 0.5688322 Nov 02 12:50:46.321922 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-70ca24aa-9317-4815-a5d7-9fe140898ad8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c962ec7b-f776-4bdf-97fe-8538615c353c,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:46.378758 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-a8423e52-eb54-4f1e-b9a0-1843e4ae0651 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:46.383433 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-a8423e52-eb54-4f1e-b9a0-1843e4ae0651 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:46.385245 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-a8423e52-eb54-4f1e-b9a0-1843e4ae0651 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/5b5dba9d-79a0-43bc-b1b0-f4d61cc48074 HTTP/1.1" status: 204 len: 168 time: 0.4213037 Nov 02 12:50:46.429705 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a8423e52-eb54-4f1e-b9a0-1843e4ae0651 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5b5dba9d-79a0-43bc-b1b0-f4d61cc48074,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:46.502710 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57124) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:46.519575 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e6df1e59-b1e3-44ba-bd80-823aa434c2f6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:46.559515 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-48420695-9e14-44b7-8ac2-689243568b89 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Allocated IP 172.20.0.12 (bfe7dfe3-4b23-4454-b60a-4955be8d2d31/8f42833a-0a0e-4198-a7cf-e79133593615/4c597805-3835-4f59-b320-5614de6b4ec6) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:50:46.670446 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e6df1e59-b1e3-44ba-bd80-823aa434c2f6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:46.768385 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-eb8787dd-92d7-4c28-851b-32c560f786ae req-f3571e19-7332-44a0-8b39-b0fdce69089d tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 210 time: 0.0666568 Nov 02 12:50:46.786348 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e6df1e59-b1e3-44ba-bd80-823aa434c2f6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:46.879539 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-e6df1e59-b1e3-44ba-bd80-823aa434c2f6 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=9cbc817c7dfe4ffa9acc1c2499e55299&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3751709 Nov 02 12:50:46.889401 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57132) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:46.925421 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-48420695-9e14-44b7-8ac2-689243568b89 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:46.947048 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e6df1e59-b1e3-44ba-bd80-823aa434c2f6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1efb6eef-c537-4ee3-8376-32ea59c8a970,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:47.002991 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4858a30b-ec61-429b-a035-fccb7a43b75f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:47.038886 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-48420695-9e14-44b7-8ac2-689243568b89 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:47.041415 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4858a30b-ec61-429b-a035-fccb7a43b75f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:47.093785 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-48420695-9e14-44b7-8ac2-689243568b89 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Network bfe7dfe3-4b23-4454-b60a-4955be8d2d31 is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:50:47.099722 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-48420695-9e14-44b7-8ac2-689243568b89 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:50:47.103868 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-48420695-9e14-44b7-8ac2-689243568b89 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:50:47.112341 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-48420695-9e14-44b7-8ac2-689243568b89 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Pushing event updated for resources: {'Port': ['ID=4c597805-3835-4f59-b320-5614de6b4ec6,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:47.162137 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-48420695-9e14-44b7-8ac2-689243568b89 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:47.163023 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-48420695-9e14-44b7-8ac2-689243568b89 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:47.208640 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4858a30b-ec61-429b-a035-fccb7a43b75f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:47.211473 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4858a30b-ec61-429b-a035-fccb7a43b75f admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:47.212569 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-4858a30b-ec61-429b-a035-fccb7a43b75f admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/1efb6eef-c537-4ee3-8376-32ea59c8a970 HTTP/1.1" status: 204 len: 168 time: 0.3218086 Nov 02 12:50:47.220945 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4858a30b-ec61-429b-a035-fccb7a43b75f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1efb6eef-c537-4ee3-8376-32ea59c8a970,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:47.276293 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-48420695-9e14-44b7-8ac2-689243568b89 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.9333498 Nov 02 12:50:47.350464 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5bbdb537-f681-4d97-871e-2ba53bc5ad78 req-43f5a4aa-5154-43fc-9f6f-e06a4657a602 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:47.353135 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5bbdb537-f681-4d97-871e-2ba53bc5ad78 req-43f5a4aa-5154-43fc-9f6f-e06a4657a602 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.0677876 Nov 02 12:50:47.446172 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5bbdb537-f681-4d97-871e-2ba53bc5ad78 req-4c928645-4cdc-4c27-aa63-259cbf44b18d tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0851142 Nov 02 12:50:47.943475 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0aaffb72-5c1e-44be-95b7-ffe13d828ee8 req-26fd6e70-e8b5-4b95-be32-cb8d1efb7cb8 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:47.951315 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0aaffb72-5c1e-44be-95b7-ffe13d828ee8 req-26fd6e70-e8b5-4b95-be32-cb8d1efb7cb8 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 932 time: 0.0656345 Nov 02 12:50:48.012406 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0aaffb72-5c1e-44be-95b7-ffe13d828ee8 req-8807b047-3a6a-4f26-a62b-926662bd8951 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0602033 Nov 02 12:50:48.162853 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-0fd34c93-77ca-48a8-b220-f87b0fd53131 service neutron] Request body: {'port': {'device_id': 'b5d96599-f79e-47ef-bc01-a14589555ab4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81632'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:50:48.261349 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dfbfc90-9b84-4d93-b3af-44fef3fc6c1c req-ba0e5607-baff-4f97-8935-d0a964939ddb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:48.265095 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-6dfbfc90-9b84-4d93-b3af-44fef3fc6c1c req-ba0e5607-baff-4f97-8935-d0a964939ddb service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=28a90b1659054909ab64ba5320160f74&device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 1099 time: 0.1048179 Nov 02 12:50:48.271665 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-0fd34c93-77ca-48a8-b220-f87b0fd53131 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:48.504299 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dfbfc90-9b84-4d93-b3af-44fef3fc6c1c req-89909f16-9502-4ac5-8a9c-3d2d2cc1fbe6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:48.508357 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-6dfbfc90-9b84-4d93-b3af-44fef3fc6c1c req-89909f16-9502-4ac5-8a9c-3d2d2cc1fbe6 service neutron] 10.222.0.90 "GET /v2.0/networks?id=c965eaf1-5fb6-4689-8b12-fa3913e4f081 HTTP/1.1" status: 200 len: 920 time: 0.2331717 Nov 02 12:50:48.603095 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-6dfbfc90-9b84-4d93-b3af-44fef3fc6c1c req-509efcb6-9b7b-4040-a003-bcc3c1f6bb66 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d32b527e-e041-40dd-b3b1-a7c080a56c87 HTTP/1.1" status: 200 len: 217 time: 0.0823929 Nov 02 12:50:48.724174 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6dfbfc90-9b84-4d93-b3af-44fef3fc6c1c req-708fcb68-a2d2-4831-a5fa-b738582ac3ec service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:48.726479 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f734d317-16bc-4a03-8e66-9d3f28e3a5a6 req-7653447e-35e8-4157-aee6-ebc3034ebdd5 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:48.728986 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f734d317-16bc-4a03-8e66-9d3f28e3a5a6 req-7653447e-35e8-4157-aee6-ebc3034ebdd5 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.1079838 Nov 02 12:50:48.742007 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-6dfbfc90-9b84-4d93-b3af-44fef3fc6c1c req-708fcb68-a2d2-4831-a5fa-b738582ac3ec service neutron] 10.222.0.90 "GET /v2.0/subnets?id=b29075d9-9995-4f6f-8ebd-8f7d748977ef HTTP/1.1" status: 200 len: 859 time: 0.1282237 Nov 02 12:50:48.807573 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-6dfbfc90-9b84-4d93-b3af-44fef3fc6c1c req-aabc07fc-5b73-4ab1-905e-396ba0c487a8 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=c965eaf1-5fb6-4689-8b12-fa3913e4f081&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0555501 Nov 02 12:50:48.894754 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f734d317-16bc-4a03-8e66-9d3f28e3a5a6 req-1ef23f6e-c812-4730-ae26-e3055c40a278 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1513536 Nov 02 12:50:48.930408 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-0fd34c93-77ca-48a8-b220-f87b0fd53131 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4c597805-3835-4f59-b320-5614de6b4ec6 {{(pid=108543) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:50:48.937787 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-0fd34c93-77ca-48a8-b220-f87b0fd53131 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:48.964091 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.provisioning_blocks [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-0fd34c93-77ca-48a8-b220-f87b0fd53131 service neutron] Transition to ACTIVE for port object 4c597805-3835-4f59-b320-5614de6b4ec6 will not be triggered until provisioned by entity L2. {{(pid=108543) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 02 12:50:49.004020 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-6dfbfc90-9b84-4d93-b3af-44fef3fc6c1c req-94a24696-f777-4d0f-81d1-421d4cd0296c service neutron] 10.222.0.90 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1876018 Nov 02 12:50:49.042876 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-0fd34c93-77ca-48a8-b220-f87b0fd53131 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:49.133697 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fd34c93-77ca-48a8-b220-f87b0fd53131 service neutron] Pushing event updated for resources: {'Port': ['ID=4c597805-3835-4f59-b320-5614de6b4ec6,revision_number=2']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:49.243344 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-6dfbfc90-9b84-4d93-b3af-44fef3fc6c1c req-8b533fbe-0c38-4507-9ed9-5a6a7ec02e57 service neutron] 10.222.0.90 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2297676 Nov 02 12:50:49.357595 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7579b3b9-cad2-4a19-8aa7-e800f1846797 req-67437ac8-bd31-4fc6-8f0f-82eae4600109 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:49.360099 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7579b3b9-cad2-4a19-8aa7-e800f1846797 req-67437ac8-bd31-4fc6-8f0f-82eae4600109 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 944 time: 0.1746988 Nov 02 12:50:49.371663 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-0fd34c93-77ca-48a8-b220-f87b0fd53131 service neutron] Attempting to bind port 4c597805-3835-4f59-b320-5614de6b4ec6 on host hv-cinder-81632 for vnic_type normal with profile {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:50:49.373087 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-0fd34c93-77ca-48a8-b220-f87b0fd53131 service neutron] Attempting to bind port 4c597805-3835-4f59-b320-5614de6b4ec6 by drivers openvswitch,hyperv on host hv-cinder-81632 at level 0 using segments [{'id': 'e912b2b1-808c-4d37-a99d-fcfdb9d2a5db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31'}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:50:49.373662 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-0fd34c93-77ca-48a8-b220-f87b0fd53131 service neutron] Attempting to bind port 4c597805-3835-4f59-b320-5614de6b4ec6 on network bfe7dfe3-4b23-4454-b60a-4955be8d2d31 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:50:49.384905 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-0fd34c93-77ca-48a8-b220-f87b0fd53131 service neutron] Port 4c597805-3835-4f59-b320-5614de6b4ec6 on network bfe7dfe3-4b23-4454-b60a-4955be8d2d31 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81632 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 02 12:50:49.385431 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-0fd34c93-77ca-48a8-b220-f87b0fd53131 service neutron] Attempting to bind port 4c597805-3835-4f59-b320-5614de6b4ec6 on network bfe7dfe3-4b23-4454-b60a-4955be8d2d31 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:50:49.427421 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-0fd34c93-77ca-48a8-b220-f87b0fd53131 service neutron] Checking agent: {'id': '0d57fa42-4660-4f08-b7dc-53a872c3c01c', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81632', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'started_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 50, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:50:49.427819 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-0fd34c93-77ca-48a8-b220-f87b0fd53131 service neutron] Checking segment: {'id': 'e912b2b1-808c-4d37-a99d-fcfdb9d2a5db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108543) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:50:49.428343 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-0fd34c93-77ca-48a8-b220-f87b0fd53131 service neutron] Bound using segment: {'id': 'e912b2b1-808c-4d37-a99d-fcfdb9d2a5db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31'} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:50:49.428889 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-0fd34c93-77ca-48a8-b220-f87b0fd53131 service neutron] Bound port: 4c597805-3835-4f59-b320-5614de6b4ec6, host: hv-cinder-81632, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e912b2b1-808c-4d37-a99d-fcfdb9d2a5db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31'}}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:50:49.429295 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-0fd34c93-77ca-48a8-b220-f87b0fd53131 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:49.467143 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57222) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:49.538354 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7579b3b9-cad2-4a19-8aa7-e800f1846797 req-2112f26c-6f7d-4c1c-a41b-74b5fa508e66 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1611204 Nov 02 12:50:49.600736 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-0fd34c93-77ca-48a8-b220-f87b0fd53131 service neutron] For port 4c597805-3835-4f59-b320-5614de6b4ec6, host hv-cinder-81632, cleared binding levels {{(pid=108543) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:50:49.605020 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-0fd34c93-77ca-48a8-b220-f87b0fd53131 service neutron] For port 4c597805-3835-4f59-b320-5614de6b4ec6, host hv-cinder-81632, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=4c597805-3835-4f59-b320-5614de6b4ec6,segment=NetworkSegment(e912b2b1-808c-4d37-a99d-fcfdb9d2a5db),segment_id=e912b2b1-808c-4d37-a99d-fcfdb9d2a5db)] {{(pid=108543) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:50:49.678853 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-0fd34c93-77ca-48a8-b220-f87b0fd53131 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:49.745477 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-0fd34c93-77ca-48a8-b220-f87b0fd53131 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:49.746658 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-0fd34c93-77ca-48a8-b220-f87b0fd53131 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:49.749503 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-0fd34c93-77ca-48a8-b220-f87b0fd53131 service neutron] 10.222.0.90 "PUT /v2.0/ports/4c597805-3835-4f59-b320-5614de6b4ec6 HTTP/1.1" status: 200 len: 1094 time: 1.5950773 Nov 02 12:50:49.750407 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'b5d96599-f79e-47ef-bc01-a14589555ab4', 'tag': '4c597805-3835-4f59-b320-5614de6b4ec6'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:50:49.754648 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-afddf31b-2576-4c75-93f5-7fbdefef6cf8" -d '{"events": [{"name": "network-changed", "server_uuid": "b5d96599-f79e-47ef-bc01-a14589555ab4", "tag": "4c597805-3835-4f59-b320-5614de6b4ec6"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:50:49.799115 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0fd34c93-77ca-48a8-b220-f87b0fd53131 service neutron] Pushing event updated for resources: {'Port': ['ID=4c597805-3835-4f59-b320-5614de6b4ec6,revision_number=3']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:49.852126 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:50:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c07f02a4-0504-4711-9d29-54cc9d8664e6 x-openstack-request-id: req-c07f02a4-0504-4711-9d29-54cc9d8664e6 {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:50:49.852635 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "b5d96599-f79e-47ef-bc01-a14589555ab4", "tag": "4c597805-3835-4f59-b320-5614de6b4ec6", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:50:49.853000 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-c07f02a4-0504-4711-9d29-54cc9d8664e6 {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:50:49.853675 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'b5d96599-f79e-47ef-bc01-a14589555ab4', 'tag': '4c597805-3835-4f59-b320-5614de6b4ec6', 'status': 'completed', 'code': 200} Nov 02 12:50:49.954048 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afddf31b-2576-4c75-93f5-7fbdefef6cf8 req-54ff8815-8a28-4e05-a5d5-4515268efd13 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:49.957091 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-afddf31b-2576-4c75-93f5-7fbdefef6cf8 req-54ff8815-8a28-4e05-a5d5-4515268efd13 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=dfe80527be524672a94a38908e154182&device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 1097 time: 0.0736122 Nov 02 12:50:50.098316 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-5bc21d01-eba1-49cc-9094-ebc6f2f484f9 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1074998355-network', 'tenant_id': 'eeb1cb4c2b3844da903a64e77a350dab'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:50:50.291435 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5bc21d01-eba1-49cc-9094-ebc6f2f484f9 admin admin] Made reservation on behalf of eeb1cb4c2b3844da903a64e77a350dab for: {'network': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:50:50.295172 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5bc21d01-eba1-49cc-9094-ebc6f2f484f9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for network, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:50.310573 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5bc21d01-eba1-49cc-9094-ebc6f2f484f9 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:50.521306 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5bc21d01-eba1-49cc-9094-ebc6f2f484f9 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:50.624772 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5bc21d01-eba1-49cc-9094-ebc6f2f484f9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:50.661992 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5bc21d01-eba1-49cc-9094-ebc6f2f484f9 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 889} {{(pid=108542) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 02 12:50:50.674113 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5bc21d01-eba1-49cc-9094-ebc6f2f484f9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:50.675349 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.db.segments_db [None req-5bc21d01-eba1-49cc-9094-ebc6f2f484f9 admin admin] Added segment 9918b664-73ec-4ba3-8b79-1b2dd2746c03 of type vlan for network cf53051c-17aa-4d08-a264-6c6ed50a7a96 Nov 02 12:50:50.698199 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2b0dd094-5a3e-4365-afde-e79a27a9cb77 req-166822d0-44c1-49a1-9f33-7a808ad7d4b3 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:50.704272 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2b0dd094-5a3e-4365-afde-e79a27a9cb77 req-166822d0-44c1-49a1-9f33-7a808ad7d4b3 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.6658669 Nov 02 12:50:50.741655 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bc21d01-eba1-49cc-9094-ebc6f2f484f9 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=eadb1119-2269-4956-923b-c60da15e2d12,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:50.749195 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5bc21d01-eba1-49cc-9094-ebc6f2f484f9 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738449409639'] for network, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:50.764405 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afddf31b-2576-4c75-93f5-7fbdefef6cf8 req-b60a5148-9263-470b-b1b5-fc3590f75316 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:50.767203 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-afddf31b-2576-4c75-93f5-7fbdefef6cf8 req-b60a5148-9263-470b-b1b5-fc3590f75316 service neutron] 10.222.0.90 "GET /v2.0/networks?tenant_id=dfe80527be524672a94a38908e154182&shared=False HTTP/1.1" status: 200 len: 916 time: 0.7992468 Nov 02 12:50:50.854663 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5bc21d01-eba1-49cc-9094-ebc6f2f484f9 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for network, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:50.855881 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5bc21d01-eba1-49cc-9094-ebc6f2f484f9 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:50.857111 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5bc21d01-eba1-49cc-9094-ebc6f2f484f9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:50.930891 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c87106d-54a5-4547-8258-5e5f01d0a936 req-0e482d4b-36c8-479c-b151-f6898cb7ff7b tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:50.939542 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3c87106d-54a5-4547-8258-5e5f01d0a936 req-0e482d4b-36c8-479c-b151-f6898cb7ff7b tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 944 time: 0.2870228 Nov 02 12:50:50.945088 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2b0dd094-5a3e-4365-afde-e79a27a9cb77 req-35a47120-3edd-4aa0-a933-31664342cc1c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2124069 Nov 02 12:50:50.949143 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bc21d01-eba1-49cc-9094-ebc6f2f484f9 admin admin] Pushing event updated for resources: {'Network': ['ID=cf53051c-17aa-4d08-a264-6c6ed50a7a96,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:50.962931 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Network cf53051c-17aa-4d08-a264-6c6ed50a7a96 details requested by agent ovs-agent-dv-cinder-816324-1-iscsi with host dv-cinder-816324-1-iscsi {{(pid=108544) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 02 12:50:50.968913 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-5bc21d01-eba1-49cc-9094-ebc6f2f484f9 admin admin] 10.222.0.98 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 1.4954531 Nov 02 12:50:50.969674 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57270) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:50:50.986181 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-5965865e-1015-4050-8378-6b3468e16db8 admin admin] Request body: {'subnet': {'network_id': 'cf53051c-17aa-4d08-a264-6c6ed50a7a96', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1074998355-subnet', 'tenant_id': 'eeb1cb4c2b3844da903a64e77a350dab', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:50:51.080086 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3c87106d-54a5-4547-8258-5e5f01d0a936 req-55ff6ac6-1d35-4f0f-93e4-223a6788688e tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1391797 Nov 02 12:50:51.087311 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-afddf31b-2576-4c75-93f5-7fbdefef6cf8 req-adbed50c-5f2e-4d87-9d9f-482d1527b510 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:51.087771 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-afddf31b-2576-4c75-93f5-7fbdefef6cf8 req-adbed50c-5f2e-4d87-9d9f-482d1527b510 service neutron] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3089495 Nov 02 12:50:51.122827 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5965865e-1015-4050-8378-6b3468e16db8 admin admin] Made reservation on behalf of eeb1cb4c2b3844da903a64e77a350dab for: {'subnet': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:50:51.126971 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5965865e-1015-4050-8378-6b3468e16db8 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126185635'] for subnet, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:51.187155 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-1927853d-2d72-42d8-850d-d647e9f1335c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:51.202845 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-1927853d-2d72-42d8-850d-d647e9f1335c service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=dfe80527be524672a94a38908e154182&device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 1097 time: 0.0599763 Nov 02 12:50:51.260039 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-9637d65b-e407-4083-ba08-641edc57ea9e service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=4c597805-3835-4f59-b320-5614de6b4ec6 HTTP/1.1" status: 200 len: 217 time: 0.0497785 Nov 02 12:50:51.352222 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-321b07ce-000e-4373-9f1f-ec24d7cea639 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:51.355381 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-321b07ce-000e-4373-9f1f-ec24d7cea639 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=8f42833a-0a0e-4198-a7cf-e79133593615 HTTP/1.1" status: 200 len: 855 time: 0.0885310 Nov 02 12:50:51.402538 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-46d0c90b-1622-4b69-bb51-9dfdf53d2be5 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=bfe7dfe3-4b23-4454-b60a-4955be8d2d31&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0372908 Nov 02 12:50:51.562520 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-9238b509-f386-4fe5-be31-7deb70ef667c service neutron] 10.222.0.90 "GET /v2.0/networks/bfe7dfe3-4b23-4454-b60a-4955be8d2d31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1479881 Nov 02 12:50:51.570935 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5965865e-1015-4050-8378-6b3468e16db8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126478280', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126185617'] for subnet, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:51.643472 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5965865e-1015-4050-8378-6b3468e16db8 admin admin] Pushing event updated for resources: {'Subnet': ['ID=2d4c8b31-ca6f-4edf-b0a6-e43793692679,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:51.666625 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-5965865e-1015-4050-8378-6b3468e16db8 admin admin] Checking segment: {'id': '9918b664-73ec-4ba3-8b79-1b2dd2746c03', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 889, 'network_id': 'cf53051c-17aa-4d08-a264-6c6ed50a7a96'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108542) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:50:51.667308 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5965865e-1015-4050-8378-6b3468e16db8 admin admin] Network hostable DHCP agents. Network: cf53051c-17aa-4d08-a264-6c6ed50a7a96, hostable agents: ['1b947f40-f8bf-4088-a5dc-35ee29d90d78'], hosted agents: [] {{(pid=108542) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 02 12:50:51.694800 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bb586a67-d9dd-49cf-92f6-24a482f02ee9 req-445d33ac-86bc-42b4-9939-0b72b754721e service neutron] 10.222.0.90 "GET /v2.0/networks/bfe7dfe3-4b23-4454-b60a-4955be8d2d31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1221285 Nov 02 12:50:51.832737 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-5965865e-1015-4050-8378-6b3468e16db8 admin admin] Network cf53051c-17aa-4d08-a264-6c6ed50a7a96 is scheduled to be hosted by DHCP agent 1b947f40-f8bf-4088-a5dc-35ee29d90d78 with binding_index 1 {{(pid=108542) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 02 12:50:51.921749 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-5965865e-1015-4050-8378-6b3468e16db8 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816324-1-iscsi, cf53051c-17aa-4d08-a264-6c6ed50a7a96) {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:50:51.927138 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5965865e-1015-4050-8378-6b3468e16db8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:51.928008 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5965865e-1015-4050-8378-6b3468e16db8 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:51.935880 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-605eaa71-c047-48e7-b9f9-ed6d6da4421d None None] Network cf53051c-17aa-4d08-a264-6c6ed50a7a96 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:50:52.021524 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-5965865e-1015-4050-8378-6b3468e16db8 admin admin] 10.222.0.98 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 1.0463531 Nov 02 12:50:52.259694 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-84b377f0-252e-432f-9aec-8e50a5a8ce84 None None] Network cf53051c-17aa-4d08-a264-6c6ed50a7a96 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:50:52.262486 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-522b6cb6-8b91-406f-938c-0fdb66d68f3e req-e506be31-39a0-4a5c-9cc6-ca123be4b195 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:52.279050 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-522b6cb6-8b91-406f-938c-0fdb66d68f3e req-e506be31-39a0-4a5c-9cc6-ca123be4b195 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.1812341 Nov 02 12:50:52.416294 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-522b6cb6-8b91-406f-938c-0fdb66d68f3e req-a1e71f62-631c-48f5-8538-8bd5e5336e10 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1357834 Nov 02 12:50:52.442854 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-edbd3479-b77a-418d-8994-fa6abdd77ab0 req-71db8504-33bf-4316-a37e-3e71e2bd0dec tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:52.445840 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-edbd3479-b77a-418d-8994-fa6abdd77ab0 req-71db8504-33bf-4316-a37e-3e71e2bd0dec tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 944 time: 0.1622050 Nov 02 12:50:52.563353 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-edbd3479-b77a-418d-8994-fa6abdd77ab0 req-c1ca19dc-3f6b-43f1-81db-d776a71de8f9 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1086605 Nov 02 12:50:53.511855 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-aa56ee3a-3c80-46a1-9ae4-b0bb71eed2b7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:53.612747 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9eaf690b-d8cf-4450-abca-6c9dd2321c51 req-7a8116e2-ffe2-490f-b824-ec3c588640d5 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:53.615134 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9eaf690b-d8cf-4450-abca-6c9dd2321c51 req-7a8116e2-ffe2-490f-b824-ec3c588640d5 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.0599294 Nov 02 12:50:53.709195 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9eaf690b-d8cf-4450-abca-6c9dd2321c51 req-4c32d51f-3458-43bf-bc14-0220d569855c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0852854 Nov 02 12:50:53.756476 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-576cac7b-cf8c-40c2-8325-082267ea553f req-daed641e-cc1a-427a-8b34-19d496787480 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:53.758189 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-576cac7b-cf8c-40c2-8325-082267ea553f req-daed641e-cc1a-427a-8b34-19d496787480 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 944 time: 0.0652037 Nov 02 12:50:53.832100 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-576cac7b-cf8c-40c2-8325-082267ea553f req-c01541d6-8357-4742-b96e-cb1157c85e1f tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0656641 Nov 02 12:50:54.163467 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 4c597805-3835-4f59-b320-5614de6b4ec6 details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 12:50:54.293076 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 4c597805-3835-4f59-b320-5614de6b4ec6, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=4c597805-3835-4f59-b320-5614de6b4ec6,segment=NetworkSegment(e912b2b1-808c-4d37-a99d-fcfdb9d2a5db),segment_id=e912b2b1-808c-4d37-a99d-fcfdb9d2a5db)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:50:54.310756 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': '4c597805-3835-4f59-b320-5614de6b4ec6', 'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31', 'port_id': '4c597805-3835-4f59-b320-5614de6b4ec6', 'mac_address': 'fa:16:3e:cc:5c:c3', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 862, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8f42833a-0a0e-4198-a7cf-e79133593615', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 12:50:54.351811 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:54.366606 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4c597805-3835-4f59-b320-5614de6b4ec6 {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:50:54.389344 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 4c597805-3835-4f59-b320-5614de6b4ec6, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=4c597805-3835-4f59-b320-5614de6b4ec6,segment=NetworkSegment(e912b2b1-808c-4d37-a99d-fcfdb9d2a5db),segment_id=e912b2b1-808c-4d37-a99d-fcfdb9d2a5db)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:50:54.580550 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:54.634700 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=4c597805-3835-4f59-b320-5614de6b4ec6,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:50:54.643340 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:54.643712 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:54.644105 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:54.644461 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:54.644776 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:54.645141 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:54.645469 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:54.645800 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:54.646171 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:54.646531 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:54.646858 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:54.647194 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:50:54.845737 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4ead9cd2-4e18-4e5b-b3de-8523d6c902c5 req-fef32458-776d-48e5-9569-99ebea915899 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:54.847630 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4ead9cd2-4e18-4e5b-b3de-8523d6c902c5 req-fef32458-776d-48e5-9569-99ebea915899 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.0549889 Nov 02 12:50:54.856329 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['4c597805-3835-4f59-b320-5614de6b4ec6'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:50:54.938950 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4ead9cd2-4e18-4e5b-b3de-8523d6c902c5 req-bd46078b-9f50-41fd-ba61-b0ce5998a60a tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0837533 Nov 02 12:50:55.083092 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f095045-0020-4768-b28e-7acff4eb99b5 req-7a7d09d6-a449-49f5-ab53-24b40fba674a tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:55.085661 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9f095045-0020-4768-b28e-7acff4eb99b5 req-7a7d09d6-a449-49f5-ab53-24b40fba674a tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 945 time: 0.0970116 Nov 02 12:50:55.203111 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9f095045-0020-4768-b28e-7acff4eb99b5 req-3d277804-3788-4ca2-a244-e9ca67fe53b1 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1041751 Nov 02 12:50:55.655596 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a45d2256-3599-4c65-8f82-68538c367334 req-6805d6f2-e139-4e1f-9c5b-415bd51c25e0 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:55.657727 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a45d2256-3599-4c65-8f82-68538c367334 req-6805d6f2-e139-4e1f-9c5b-415bd51c25e0 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/networks?id=cf53051c-17aa-4d08-a264-6c6ed50a7a96 HTTP/1.1" status: 200 len: 809 time: 0.1862016 Nov 02 12:50:55.677913 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a45d2256-3599-4c65-8f82-68538c367334 req-b38f2df3-8480-4e3a-b5c6-07eafdf50fce tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/quotas/eeb1cb4c2b3844da903a64e77a350dab HTTP/1.1" status: 200 len: 375 time: 0.0125222 Nov 02 12:50:55.689689 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-6e781e58-9af5-41ae-b4ff-f3ddd2489c9b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:55.739775 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a45d2256-3599-4c65-8f82-68538c367334 req-565a1996-b800-495d-84f8-735244cf80c0 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?tenant_id=eeb1cb4c2b3844da903a64e77a350dab&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0466239 Nov 02 12:50:55.883405 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a45d2256-3599-4c65-8f82-68538c367334 req-08ea9f0c-2a9d-4fd0-b656-0298e9964893 service neutron] 10.222.0.98 "GET /v2.0/networks/cf53051c-17aa-4d08-a264-6c6ed50a7a96?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1339047 Nov 02 12:50:56.058682 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a45d2256-3599-4c65-8f82-68538c367334 req-93af294c-962c-4e18-94f2-2028777c0222 service neutron] 10.222.0.98 "GET /v2.0/networks/cf53051c-17aa-4d08-a264-6c6ed50a7a96?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1642492 Nov 02 12:50:56.416386 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e681021-56a5-4292-8cf7-cdaaf5d6e25f req-0869dabd-8cf3-4f3a-bcf9-65ae109438e5 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:56.417991 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5e681021-56a5-4292-8cf7-cdaaf5d6e25f req-0869dabd-8cf3-4f3a-bcf9-65ae109438e5 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.0630727 Nov 02 12:50:56.501659 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5e681021-56a5-4292-8cf7-cdaaf5d6e25f req-41313239-8fee-4e29-bc99-d7dc6ba830e4 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0725086 Nov 02 12:50:56.667459 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3c028c2c-da0a-4e05-ab67-daf0258acb77 req-5c343db6-2468-4a48-9ba5-7938ff6e0d39 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:56.669424 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3c028c2c-da0a-4e05-ab67-daf0258acb77 req-5c343db6-2468-4a48-9ba5-7938ff6e0d39 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 945 time: 0.0641172 Nov 02 12:50:56.737630 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3c028c2c-da0a-4e05-ab67-daf0258acb77 req-f9a6539b-0ddb-4b84-ad4d-f5c7cee8ad57 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0569937 Nov 02 12:50:56.823422 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3e32b044-08a2-4689-aa2b-01fcca6d03ea req-6e175d6a-f89e-47a6-8ed3-339f3b0d6ff0 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 210 time: 0.0332339 Nov 02 12:50:56.843381 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:57.655257 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9bd30d78-2f30-4e00-83c8-2d40ad573134 req-000a0431-525d-48cc-b9cd-baaf76723c1e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:57.656974 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9bd30d78-2f30-4e00-83c8-2d40ad573134 req-000a0431-525d-48cc-b9cd-baaf76723c1e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.0588360 Nov 02 12:50:57.754550 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9bd30d78-2f30-4e00-83c8-2d40ad573134 req-9dd32273-60b6-4887-bd26-dfbfeef1ce29 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0854163 Nov 02 12:50:57.925953 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ad6b211-be3e-4961-ac5f-e983e0c9783e req-5a77c767-d5f5-407f-ab26-63bf7cda08dc tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:57.928687 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6ad6b211-be3e-4961-ac5f-e983e0c9783e req-5a77c767-d5f5-407f-ab26-63bf7cda08dc tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 945 time: 0.0863199 Nov 02 12:50:57.986522 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d6d2d68d-cf66-481b-9279-57fb27ed6d37 req-16ad9351-ade6-43fa-9096-b877073759fc tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 210 time: 0.0561814 Nov 02 12:50:58.061547 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6ad6b211-be3e-4961-ac5f-e983e0c9783e req-514944bd-e55e-4e26-a18d-fcd47c11441a tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1144147 Nov 02 12:50:58.361926 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:50:58.940787 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c2598b26-3c8e-4e45-8398-0cf458853e9b req-b9eb8dca-5a85-4f2e-8b65-8cdcaabe6b1e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:58.942743 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c2598b26-3c8e-4e45-8398-0cf458853e9b req-b9eb8dca-5a85-4f2e-8b65-8cdcaabe6b1e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.0629585 Nov 02 12:50:59.031104 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c2598b26-3c8e-4e45-8398-0cf458853e9b req-a6a043dd-d5bb-48fd-8aae-d25d0d7bdc87 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0766621 Nov 02 12:50:59.161757 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e66985b0-b77c-4808-97d5-cf1f8229cce2 req-d551e79d-fc7c-4951-a3b6-d07f5194c4aa tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 210 time: 0.0501170 Nov 02 12:50:59.312669 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e4e50cec-11a3-415f-adcf-813f7c0f4e87 req-74d22ae1-1bf0-48af-9192-96299142590c tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:50:59.315212 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e4e50cec-11a3-415f-adcf-813f7c0f4e87 req-74d22ae1-1bf0-48af-9192-96299142590c tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 945 time: 0.0852582 Nov 02 12:50:59.399814 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e4e50cec-11a3-415f-adcf-813f7c0f4e87 req-37a82b27-90fc-4182-be88-3396516f7fb5 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0768042 Nov 02 12:51:00.205395 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0defa8f8-2079-4358-bd39-297168224637 req-5d2928d9-a09f-4010-ad62-0bfb2a2f57cf tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:00.208376 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0defa8f8-2079-4358-bd39-297168224637 req-5d2928d9-a09f-4010-ad62-0bfb2a2f57cf tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.0939453 Nov 02 12:51:00.294918 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0defa8f8-2079-4358-bd39-297168224637 req-4d9cba97-4971-4fd1-b6fd-e319e844c8ba tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0741169 Nov 02 12:51:00.418443 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6e33679e-c8a7-46e0-9c7a-7075bfb60cfa req-7851da3a-c87b-49c4-aeb2-fcc78ec45786 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 210 time: 0.0371096 Nov 02 12:51:00.595723 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-24f9a58d-4302-4919-8ce6-c9a1c543596c req-07cb4bad-1896-459b-ac94-fe3eb49b7dcb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:00.598409 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-24f9a58d-4302-4919-8ce6-c9a1c543596c req-07cb4bad-1896-459b-ac94-fe3eb49b7dcb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 945 time: 0.0732753 Nov 02 12:51:00.673206 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-24f9a58d-4302-4919-8ce6-c9a1c543596c req-58ae2a49-3a3b-4602-ba0d-23bead84dad3 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0646093 Nov 02 12:51:00.809216 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:01.250410 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3990a0c4-d443-4f3a-98a6-ed6d199e58ea req-9f515314-20af-45c6-8bd0-b6bb914937a5 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0562799 Nov 02 12:51:01.351014 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3990a0c4-d443-4f3a-98a6-ed6d199e58ea req-d38c98ce-3254-4384-ad65-60faa37a0226 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:01.353568 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3990a0c4-d443-4f3a-98a6-ed6d199e58ea req-d38c98ce-3254-4384-ad65-60faa37a0226 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=28a90b1659054909ab64ba5320160f74&device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 1099 time: 0.0673389 Nov 02 12:51:01.611401 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e75f75d7-b06d-427f-96e3-5f56c14e59b6 req-a5e46d07-46ea-409a-824a-46cdb4d3725d tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:01.613112 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e75f75d7-b06d-427f-96e3-5f56c14e59b6 req-a5e46d07-46ea-409a-824a-46cdb4d3725d tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.1874559 Nov 02 12:51:01.638696 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2a1d4e2a-7298-4e0d-8e06-647fbe92157d req-4270286c-34d5-4fc0-929f-00d44c980992 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 210 time: 0.0575941 Nov 02 12:51:01.665064 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3990a0c4-d443-4f3a-98a6-ed6d199e58ea req-802d6f72-2d45-433f-a272-6b47000cc2ee service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:01.667552 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3990a0c4-d443-4f3a-98a6-ed6d199e58ea req-802d6f72-2d45-433f-a272-6b47000cc2ee service neutron] 10.222.0.90 "GET /v2.0/networks?id=c965eaf1-5fb6-4689-8b12-fa3913e4f081 HTTP/1.1" status: 200 len: 920 time: 0.2807853 Nov 02 12:51:01.714816 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e75f75d7-b06d-427f-96e3-5f56c14e59b6 req-36a51beb-a67c-4dd0-a945-9521c3195d14 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0783284 Nov 02 12:51:01.852523 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dcf8a265-7701-41de-9d3a-14ef3fa0c37c req-a5c97160-1378-46e0-bb50-1e9ea0194fc9 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:01.854810 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-dcf8a265-7701-41de-9d3a-14ef3fa0c37c req-a5c97160-1378-46e0-bb50-1e9ea0194fc9 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 945 time: 0.0678194 Nov 02 12:51:01.913210 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-dcf8a265-7701-41de-9d3a-14ef3fa0c37c req-606f84f7-d443-43cb-824e-31bc66be6973 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0508847 Nov 02 12:51:02.330555 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 4c597805-3835-4f59-b320-5614de6b4ec6 up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:51:02.471701 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning for port 4c597805-3835-4f59-b320-5614de6b4ec6 completed by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 02 12:51:02.476701 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port 4c597805-3835-4f59-b320-5614de6b4ec6 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:02.477159 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:02.616939 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:02.657666 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b5d96599-f79e-47ef-bc01-a14589555ab4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4c597805-3835-4f59-b320-5614de6b4ec6'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:51:02.661917 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3cac0964-5d78-45dc-bff8-7e1759e4c911" -d '{"events": [{"server_uuid": "b5d96599-f79e-47ef-bc01-a14589555ab4", "name": "network-vif-plugged", "status": "completed", "tag": "4c597805-3835-4f59-b320-5614de6b4ec6"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:51:02.687331 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 4c597805-3835-4f59-b320-5614de6b4ec6, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=4c597805-3835-4f59-b320-5614de6b4ec6,segment=NetworkSegment(e912b2b1-808c-4d37-a99d-fcfdb9d2a5db),segment_id=e912b2b1-808c-4d37-a99d-fcfdb9d2a5db)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:51:02.715138 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:51:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-81f96307-a776-4c56-b401-860dc9854991 x-openstack-request-id: req-81f96307-a776-4c56-b401-860dc9854991 {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:51:02.715623 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b5d96599-f79e-47ef-bc01-a14589555ab4", "name": "network-vif-plugged", "status": "completed", "tag": "4c597805-3835-4f59-b320-5614de6b4ec6", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:51:02.716255 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-81f96307-a776-4c56-b401-860dc9854991 {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:51:02.716916 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b5d96599-f79e-47ef-bc01-a14589555ab4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4c597805-3835-4f59-b320-5614de6b4ec6', 'code': 200} Nov 02 12:51:02.820322 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:02.821231 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-12fe1344-05ce-4444-8ac6-bef22283d61b req-9e5ecea0-dafe-46e7-a5a1-910a5a29dc87 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 210 time: 0.0501759 Nov 02 12:51:02.908979 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=4c597805-3835-4f59-b320-5614de6b4ec6,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:03.007424 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5da6d5f0-f58a-496f-ac02-943331448f54 req-16deb580-2a8d-419f-965f-aa5bbcae3eee tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:03.010214 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5da6d5f0-f58a-496f-ac02-943331448f54 req-16deb580-2a8d-419f-965f-aa5bbcae3eee tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.0788052 Nov 02 12:51:03.078729 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5da6d5f0-f58a-496f-ac02-943331448f54 req-0e74fd37-add0-4087-80e3-4378e743937f tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0573239 Nov 02 12:51:03.274746 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d179e2af-596e-41fa-b351-bc8da9043940 req-56316cf5-7c1e-4b49-acac-cc764bb4f916 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:03.277678 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:03.278007 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d179e2af-596e-41fa-b351-bc8da9043940 req-56316cf5-7c1e-4b49-acac-cc764bb4f916 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 946 time: 0.0957458 Nov 02 12:51:03.366993 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d179e2af-596e-41fa-b351-bc8da9043940 req-36aca2e7-8601-402c-b8b3-8a8ef8829349 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0811403 Nov 02 12:51:03.946443 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-35813800-ccdd-4ed4-9848-96b402b4c64a req-20ae8432-7d8a-485f-8c7e-a06e33217eb2 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 210 time: 0.0295646 Nov 02 12:51:04.251551 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-34e824b4-086d-4c11-97a7-7e07210c1960 req-e64fbaec-facb-47ea-b25c-486c40ee5bd6 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:04.253395 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-34e824b4-086d-4c11-97a7-7e07210c1960 req-e64fbaec-facb-47ea-b25c-486c40ee5bd6 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.0714204 Nov 02 12:51:04.306123 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3990a0c4-d443-4f3a-98a6-ed6d199e58ea req-97c4d79b-91df-4488-b016-125fff8e66b3 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=2cf235b6-e4c1-4b00-8971-dbd528d6ad92 HTTP/1.1" status: 200 len: 217 time: 0.0691741 Nov 02 12:51:04.399361 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-34e824b4-086d-4c11-97a7-7e07210c1960 req-80f12e1a-520b-4a72-aac9-7e0656a8c2c7 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1011970 Nov 02 12:51:04.410133 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3990a0c4-d443-4f3a-98a6-ed6d199e58ea req-25e16d01-67e2-4f65-ab95-1b1e2a616758 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:04.411992 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3990a0c4-d443-4f3a-98a6-ed6d199e58ea req-25e16d01-67e2-4f65-ab95-1b1e2a616758 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=b29075d9-9995-4f6f-8ebd-8f7d748977ef HTTP/1.1" status: 200 len: 859 time: 0.0907772 Nov 02 12:51:04.457774 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3990a0c4-d443-4f3a-98a6-ed6d199e58ea req-ef39bc98-34f7-473b-af5d-0d068a45180d service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=c965eaf1-5fb6-4689-8b12-fa3913e4f081&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0373819 Nov 02 12:51:04.645480 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43dd81df-3b1f-4c6d-8297-e014304955de req-4238b48b-bc27-494e-9bc3-5439738a3ca7 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:04.647280 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-43dd81df-3b1f-4c6d-8297-e014304955de req-4238b48b-bc27-494e-9bc3-5439738a3ca7 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 946 time: 0.1160123 Nov 02 12:51:04.661066 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3990a0c4-d443-4f3a-98a6-ed6d199e58ea req-cd020c4c-3326-4961-87ef-f6e855fdac3d service neutron] 10.222.0.90 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1882632 Nov 02 12:51:04.691645 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f37f3362-4849-441d-b563-99587fb23ae8 req-b64f1eb7-6fe1-4d34-be2e-472588e825db service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:04.696794 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-f37f3362-4849-441d-b563-99587fb23ae8 req-b64f1eb7-6fe1-4d34-be2e-472588e825db service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 1099 time: 0.0990338 Nov 02 12:51:04.791439 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-f37f3362-4849-441d-b563-99587fb23ae8 req-89b97ce2-64cd-47c3-9973-be1918cac210 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0886075 Nov 02 12:51:04.801319 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-43dd81df-3b1f-4c6d-8297-e014304955de req-9ca3e910-e0e1-4be3-a21f-8511de21586c tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1391649 Nov 02 12:51:04.846501 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3990a0c4-d443-4f3a-98a6-ed6d199e58ea req-f146536a-1994-486b-9168-bca2d0426516 service neutron] 10.222.0.90 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1762352 Nov 02 12:51:05.075378 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-32378b8f-077b-4fb1-b6bd-0c2c2fbf22c4 req-7048e63f-ccfe-4162-8335-a694a2aa79b3 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 210 time: 0.0345738 Nov 02 12:51:05.652974 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a707014-4d85-4ff5-9583-a1f710daded8 req-6f3a6d90-8d55-44fc-8241-c019774bdf28 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:05.655752 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2a707014-4d85-4ff5-9583-a1f710daded8 req-6f3a6d90-8d55-44fc-8241-c019774bdf28 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.0774331 Nov 02 12:51:05.713791 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2a707014-4d85-4ff5-9583-a1f710daded8 req-4a7f6d2d-5dcf-4621-b360-aee6e86d1355 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0515733 Nov 02 12:51:05.978883 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ce84425-447d-44dd-9ff2-18cd4d62c724 req-11d1a89f-33a6-441c-9b0b-35004cdd564f tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:05.980756 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0ce84425-447d-44dd-9ff2-18cd4d62c724 req-11d1a89f-33a6-441c-9b0b-35004cdd564f tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 946 time: 0.0591884 Nov 02 12:51:06.041847 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0ce84425-447d-44dd-9ff2-18cd4d62c724 req-92b4fe11-3d84-49f6-bf41-ee676b1273c0 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0535946 Nov 02 12:51:06.232968 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a18a83d5-7237-40e2-ae7f-6a88d2ba3b99 req-2b45596f-bf76-49bc-b3ed-8d2c859205fb tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 210 time: 0.0341079 Nov 02 12:51:06.878709 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfc22acf-2588-462c-a92b-70aee321debc req-47f48a9e-76ba-46b7-8d5d-322fd77aa4d1 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:06.880413 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-dfc22acf-2588-462c-a92b-70aee321debc req-47f48a9e-76ba-46b7-8d5d-322fd77aa4d1 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.0849664 Nov 02 12:51:06.973283 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-dfc22acf-2588-462c-a92b-70aee321debc req-46d7aa85-fe6c-4cb9-af99-cb1f90b0aa7c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0826428 Nov 02 12:51:07.238191 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f6516b08-5efa-4cfe-a540-eb67bf4f2996 req-a98bdfdd-9646-4a24-ba09-9aa3646742c7 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:07.239818 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f6516b08-5efa-4cfe-a540-eb67bf4f2996 req-a98bdfdd-9646-4a24-ba09-9aa3646742c7 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 946 time: 0.0779698 Nov 02 12:51:07.316244 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f6516b08-5efa-4cfe-a540-eb67bf4f2996 req-d890c8bc-65a3-4fd6-a1ad-5db6766d64a7 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0668240 Nov 02 12:51:07.458743 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f95c4f80-0880-41ac-bbd4-7d4710046b1a req-03becc69-5b2a-48c7-8b9d-634969d5e970 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 210 time: 0.0339208 Nov 02 12:51:08.275056 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5e8003d2-4d70-4bc5-9006-77b6266000c5 req-76feea0f-c1ff-4a75-baf6-24f5709a91f1 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:08.277355 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5e8003d2-4d70-4bc5-9006-77b6266000c5 req-76feea0f-c1ff-4a75-baf6-24f5709a91f1 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.1537964 Nov 02 12:51:08.291523 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a45d2256-3599-4c65-8f82-68538c367334 req-bc9d5400-7a11-4a7b-958d-b920a00f2d6e tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:08.293774 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a45d2256-3599-4c65-8f82-68538c367334 req-bc9d5400-7a11-4a7b-958d-b920a00f2d6e tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.90 "GET /v2.0/networks?id=cf53051c-17aa-4d08-a264-6c6ed50a7a96 HTTP/1.1" status: 200 len: 809 time: 0.3445389 Nov 02 12:51:08.317359 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-a45d2256-3599-4c65-8f82-68538c367334 req-b126a62a-e43a-4cb8-b064-a64249262ac3 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Request body: {'port': {'device_id': '4d6f4b48-f555-4a7a-90ea-cb2901c0d7db', 'network_id': 'cf53051c-17aa-4d08-a264-6c6ed50a7a96', 'admin_state_up': True, 'tenant_id': 'eeb1cb4c2b3844da903a64e77a350dab'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:51:08.443412 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5e8003d2-4d70-4bc5-9006-77b6266000c5 req-24644e1c-c39b-417d-b0f7-a9596fed0715 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1481776 Nov 02 12:51:08.677193 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8ad90a42-a909-4213-ab8d-aa0ff8e7d546 req-13059a0d-46fa-46cb-b71c-d31059d0b5c0 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 210 time: 0.0588272 Nov 02 12:51:08.683823 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a45d2256-3599-4c65-8f82-68538c367334 req-b126a62a-e43a-4cb8-b064-a64249262ac3 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Made reservation on behalf of eeb1cb4c2b3844da903a64e77a350dab for: {'port': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:51:08.689928 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-a45d2256-3599-4c65-8f82-68538c367334 req-b126a62a-e43a-4cb8-b064-a64249262ac3 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:09.109308 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a62a705-c92d-4e15-9eae-fa54e7ee98bb req-53385c93-3064-4c47-b308-6a215824c8ce tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:09.111977 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7a62a705-c92d-4e15-9eae-fa54e7ee98bb req-53385c93-3064-4c47-b308-6a215824c8ce tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 946 time: 0.5600190 Nov 02 12:51:09.273668 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7a62a705-c92d-4e15-9eae-fa54e7ee98bb req-18b34878-8ad8-4713-b25a-fa8919f3d0c4 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1423783 Nov 02 12:51:09.284116 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [req-a45d2256-3599-4c65-8f82-68538c367334 req-b126a62a-e43a-4cb8-b064-a64249262ac3 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Allocated IP 172.20.0.11 (cf53051c-17aa-4d08-a264-6c6ed50a7a96/2d4c8b31-ca6f-4edf-b0a6-e43793692679/8d44b6a2-0cd6-468d-9078-0647f848f64e) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:51:09.554163 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7bd37625-0f00-49f2-bdd7-c6b3af861853 req-adc9940d-d130-4eb2-90d9-8bfcb646acb8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:09.557294 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-7bd37625-0f00-49f2-bdd7-c6b3af861853 req-adc9940d-d130-4eb2-90d9-8bfcb646acb8 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 1099 time: 0.0599794 Nov 02 12:51:09.651660 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-7bd37625-0f00-49f2-bdd7-c6b3af861853 req-058ff5a5-cbe1-4f19-83a8-3d840fd83eef service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0830383 Nov 02 12:51:09.670456 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-a45d2256-3599-4c65-8f82-68538c367334 req-b126a62a-e43a-4cb8-b064-a64249262ac3 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:09.688556 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e03662fd-a38c-4a9b-8b6e-bb184fef16f7 req-b3e471fc-b27d-4d1c-93ef-ccc218ac770a tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:09.690573 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e03662fd-a38c-4a9b-8b6e-bb184fef16f7 req-b3e471fc-b27d-4d1c-93ef-ccc218ac770a tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.1087914 Nov 02 12:51:09.770465 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e03662fd-a38c-4a9b-8b6e-bb184fef16f7 req-08f05381-a417-4170-9f21-f8ce94457450 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0736077 Nov 02 12:51:09.828555 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-02613ec2-4e01-4cda-b0c5-1f5a245c69f7 req-be46e358-c10c-43f9-b840-7c2b30b855d6 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 210 time: 0.0445888 Nov 02 12:51:09.833018 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-a45d2256-3599-4c65-8f82-68538c367334 req-b126a62a-e43a-4cb8-b064-a64249262ac3 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:09.922214 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a45d2256-3599-4c65-8f82-68538c367334 req-b126a62a-e43a-4cb8-b064-a64249262ac3 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Network cf53051c-17aa-4d08-a264-6c6ed50a7a96 is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:51:09.929340 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [req-a45d2256-3599-4c65-8f82-68538c367334 req-b126a62a-e43a-4cb8-b064-a64249262ac3 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:51:09.941950 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-a45d2256-3599-4c65-8f82-68538c367334 req-b126a62a-e43a-4cb8-b064-a64249262ac3 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:51:09.985959 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b126a62a-e43a-4cb8-b064-a64249262ac3 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Pushing event updated for resources: {'Port': ['ID=8d44b6a2-0cd6-468d-9078-0647f848f64e,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:10.027682 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a45d2256-3599-4c65-8f82-68538c367334 req-b126a62a-e43a-4cb8-b064-a64249262ac3 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:10.028890 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-a45d2256-3599-4c65-8f82-68538c367334 req-b126a62a-e43a-4cb8-b064-a64249262ac3 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:10.116767 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a45d2256-3599-4c65-8f82-68538c367334 req-b126a62a-e43a-4cb8-b064-a64249262ac3 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.8036277 Nov 02 12:51:10.134854 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-a45d2256-3599-4c65-8f82-68538c367334 req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Request body: {'port': {'device_id': '4d6f4b48-f555-4a7a-90ea-cb2901c0d7db', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81632'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:51:10.241113 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-a45d2256-3599-4c65-8f82-68538c367334 req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:10.610142 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37b2337b-7003-4f64-a723-b1fa9b04f379 req-32364c72-10b2-49a5-8c60-6c3baf8af33e tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:10.612946 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-37b2337b-7003-4f64-a723-b1fa9b04f379 req-32364c72-10b2-49a5-8c60-6c3baf8af33e tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 946 time: 0.1967382 Nov 02 12:51:10.763663 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-37b2337b-7003-4f64-a723-b1fa9b04f379 req-02fa9dae-3a56-45b1-925a-f94101c1da93 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1388006 Nov 02 12:51:10.851023 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57616) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:10.890733 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [req-a45d2256-3599-4c65-8f82-68538c367334 req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8d44b6a2-0cd6-468d-9078-0647f848f64e {{(pid=108543) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:51:10.923630 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-a45d2256-3599-4c65-8f82-68538c367334 req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:10.960497 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.provisioning_blocks [req-a45d2256-3599-4c65-8f82-68538c367334 req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Transition to ACTIVE for port object 8d44b6a2-0cd6-468d-9078-0647f848f64e will not be triggered until provisioned by entity L2. {{(pid=108543) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 02 12:51:11.098004 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-a45d2256-3599-4c65-8f82-68538c367334 req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:11.204676 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5b0cb756-60d3-4b41-b615-35852cf21601 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:11.243167 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3f9e407-1755-4130-a85d-56629deb375b req-594f4fd0-4452-436c-9270-4f0b8bd0ed31 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:11.257119 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e3f9e407-1755-4130-a85d-56629deb375b req-594f4fd0-4452-436c-9270-4f0b8bd0ed31 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.2726805 Nov 02 12:51:11.340314 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a3944f3-93ba-4a21-945f-61c3de877aec req-7e356c7b-167d-4284-b637-459669564163 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:11.342862 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a3944f3-93ba-4a21-945f-61c3de877aec req-7e356c7b-167d-4284-b637-459669564163 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 932 time: 0.3802223 Nov 02 12:51:11.393573 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5b0cb756-60d3-4b41-b615-35852cf21601 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:11.414056 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Pushing event updated for resources: {'Port': ['ID=8d44b6a2-0cd6-468d-9078-0647f848f64e,revision_number=2']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:11.448944 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:11.449445 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:11.449865 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:11.450862 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:11.451295 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:11.451747 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:11.452174 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:11.452599 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:11.453038 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:11.453458 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:11.454050 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:11.454358 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:11.470555 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5b0cb756-60d3-4b41-b615-35852cf21601 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:11.521870 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a3944f3-93ba-4a21-945f-61c3de877aec req-caf0da2a-4b81-4a8a-ad55-3eee089fc9b5 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/security-groups?id=eadb1119-2269-4956-923b-c60da15e2d12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1367631 Nov 02 12:51:11.548482 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e3f9e407-1755-4130-a85d-56629deb375b req-6c6d8e42-a4ed-4191-9948-1e721450f3e0 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2841668 Nov 02 12:51:11.559040 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b0cb756-60d3-4b41-b615-35852cf21601 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=df253973-afff-4790-bfc9-c7b45d346e41,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:11.582193 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-a45d2256-3599-4c65-8f82-68538c367334 req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Attempting to bind port 8d44b6a2-0cd6-468d-9078-0647f848f64e on host hv-cinder-81632 for vnic_type normal with profile {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:51:11.583216 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-a45d2256-3599-4c65-8f82-68538c367334 req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Attempting to bind port 8d44b6a2-0cd6-468d-9078-0647f848f64e by drivers openvswitch,hyperv on host hv-cinder-81632 at level 0 using segments [{'id': '9918b664-73ec-4ba3-8b79-1b2dd2746c03', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 889, 'network_id': 'cf53051c-17aa-4d08-a264-6c6ed50a7a96'}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:51:11.583910 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a45d2256-3599-4c65-8f82-68538c367334 req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Attempting to bind port 8d44b6a2-0cd6-468d-9078-0647f848f64e on network cf53051c-17aa-4d08-a264-6c6ed50a7a96 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:51:11.593894 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-5b0cb756-60d3-4b41-b615-35852cf21601 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=2364e8ea072546268958f84118fc10b1&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7352378 Nov 02 12:51:11.597201 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57642) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:11.598067 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a45d2256-3599-4c65-8f82-68538c367334 req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Port 8d44b6a2-0cd6-468d-9078-0647f848f64e on network cf53051c-17aa-4d08-a264-6c6ed50a7a96 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81632 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 02 12:51:11.598829 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a45d2256-3599-4c65-8f82-68538c367334 req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Attempting to bind port 8d44b6a2-0cd6-468d-9078-0647f848f64e on network cf53051c-17aa-4d08-a264-6c6ed50a7a96 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:51:11.611808 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b0cb756-60d3-4b41-b615-35852cf21601 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:11.612797 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b0cb756-60d3-4b41-b615-35852cf21601 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:11.613678 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b0cb756-60d3-4b41-b615-35852cf21601 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:11.615037 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b0cb756-60d3-4b41-b615-35852cf21601 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:11.616208 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b0cb756-60d3-4b41-b615-35852cf21601 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:11.616592 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b0cb756-60d3-4b41-b615-35852cf21601 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:11.617223 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b0cb756-60d3-4b41-b615-35852cf21601 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:11.617801 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b0cb756-60d3-4b41-b615-35852cf21601 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:11.618401 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b0cb756-60d3-4b41-b615-35852cf21601 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:11.619174 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b0cb756-60d3-4b41-b615-35852cf21601 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:11.619893 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b0cb756-60d3-4b41-b615-35852cf21601 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:11.620879 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a45d2256-3599-4c65-8f82-68538c367334 req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Checking agent: {'id': '0d57fa42-4660-4f08-b7dc-53a872c3c01c', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81632', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'started_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 51, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:51:11.621635 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5b0cb756-60d3-4b41-b615-35852cf21601 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:11.622950 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a45d2256-3599-4c65-8f82-68538c367334 req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Checking segment: {'id': '9918b664-73ec-4ba3-8b79-1b2dd2746c03', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 889, 'network_id': 'cf53051c-17aa-4d08-a264-6c6ed50a7a96'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108543) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:51:11.623506 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a45d2256-3599-4c65-8f82-68538c367334 req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Bound using segment: {'id': '9918b664-73ec-4ba3-8b79-1b2dd2746c03', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 889, 'network_id': 'cf53051c-17aa-4d08-a264-6c6ed50a7a96'} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:51:11.626248 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-a45d2256-3599-4c65-8f82-68538c367334 req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Bound port: 8d44b6a2-0cd6-468d-9078-0647f848f64e, host: hv-cinder-81632, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9918b664-73ec-4ba3-8b79-1b2dd2746c03', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 889, 'network_id': 'cf53051c-17aa-4d08-a264-6c6ed50a7a96'}}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:51:11.626664 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-a45d2256-3599-4c65-8f82-68538c367334 req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:11.709315 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 57646) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:11.777706 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-a45d2256-3599-4c65-8f82-68538c367334 req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] For port 8d44b6a2-0cd6-468d-9078-0647f848f64e, host hv-cinder-81632, cleared binding levels {{(pid=108543) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:51:11.784824 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-a45d2256-3599-4c65-8f82-68538c367334 req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] For port 8d44b6a2-0cd6-468d-9078-0647f848f64e, host hv-cinder-81632, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=8d44b6a2-0cd6-468d-9078-0647f848f64e,segment=NetworkSegment(9918b664-73ec-4ba3-8b79-1b2dd2746c03),segment_id=9918b664-73ec-4ba3-8b79-1b2dd2746c03)] {{(pid=108543) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:51:11.800423 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-7b489122-1e75-4eb7-b8e0-b504314babda admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:11.853970 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-7b489122-1e75-4eb7-b8e0-b504314babda admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:11.924664 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-a45d2256-3599-4c65-8f82-68538c367334 req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:12.014429 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-77e459e2-cc30-4e1e-838d-fe7776adecdc admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:12.033627 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a45d2256-3599-4c65-8f82-68538c367334 req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:12.035049 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-a45d2256-3599-4c65-8f82-68538c367334 req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:12.037477 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a45d2256-3599-4c65-8f82-68538c367334 req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] 10.222.0.90 "PUT /v2.0/ports/8d44b6a2-0cd6-468d-9078-0647f848f64e HTTP/1.1" status: 200 len: 1094 time: 1.9107704 Nov 02 12:51:12.043083 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '4d6f4b48-f555-4a7a-90ea-cb2901c0d7db', 'tag': '8d44b6a2-0cd6-468d-9078-0647f848f64e'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:51:12.047647 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c5835170-1146-4986-9c1e-9e86dea5a733" -d '{"events": [{"name": "network-changed", "server_uuid": "4d6f4b48-f555-4a7a-90ea-cb2901c0d7db", "tag": "8d44b6a2-0cd6-468d-9078-0647f848f64e"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:51:12.091235 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-7b489122-1e75-4eb7-b8e0-b504314babda admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:12.096207 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-7b489122-1e75-4eb7-b8e0-b504314babda admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:12.098181 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-7b489122-1e75-4eb7-b8e0-b504314babda admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/df253973-afff-4790-bfc9-c7b45d346e41 HTTP/1.1" status: 204 len: 168 time: 0.4988763 Nov 02 12:51:12.130349 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7b489122-1e75-4eb7-b8e0-b504314babda admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=df253973-afff-4790-bfc9-c7b45d346e41,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:12.260284 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:51:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-be791591-d3ff-4773-ac1d-daafffbcf160 x-openstack-request-id: req-be791591-d3ff-4773-ac1d-daafffbcf160 {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:51:12.260732 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "4d6f4b48-f555-4a7a-90ea-cb2901c0d7db", "tag": "8d44b6a2-0cd6-468d-9078-0647f848f64e", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:51:12.261139 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-be791591-d3ff-4773-ac1d-daafffbcf160 {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:51:12.261732 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '4d6f4b48-f555-4a7a-90ea-cb2901c0d7db', 'tag': '8d44b6a2-0cd6-468d-9078-0647f848f64e', 'status': 'completed', 'code': 200} Nov 02 12:51:12.272511 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-77e459e2-cc30-4e1e-838d-fe7776adecdc admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:12.294492 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4118e493-b7b3-422a-baf8-7ff384c59d80 service neutron] Pushing event updated for resources: {'Port': ['ID=8d44b6a2-0cd6-468d-9078-0647f848f64e,revision_number=3']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:12.352270 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a45d2256-3599-4c65-8f82-68538c367334 req-e0bd9a31-d1fd-4fbc-b57c-9a6134e355f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:12.355221 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a45d2256-3599-4c65-8f82-68538c367334 req-e0bd9a31-d1fd-4fbc-b57c-9a6134e355f1 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=eeb1cb4c2b3844da903a64e77a350dab&device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 1097 time: 0.0867984 Nov 02 12:51:12.360099 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-77e459e2-cc30-4e1e-838d-fe7776adecdc admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:12.474319 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-77e459e2-cc30-4e1e-838d-fe7776adecdc admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=dbec4ab48bdb40749a3a5acb4c509693&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7636032 Nov 02 12:51:12.479058 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57668) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:12.480305 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a45d2256-3599-4c65-8f82-68538c367334 req-ce6208b6-681a-4313-b2ee-30273f7e39cd service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=8d44b6a2-0cd6-468d-9078-0647f848f64e HTTP/1.1" status: 200 len: 217 time: 0.0625758 Nov 02 12:51:12.580463 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-77e459e2-cc30-4e1e-838d-fe7776adecdc admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=3de523ee-03fd-4fe7-b289-c241df8759bb,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:12.590341 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-0f787130-2c53-463e-bb65-0459297e2529 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:12.640253 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-0f787130-2c53-463e-bb65-0459297e2529 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:12.657296 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a45d2256-3599-4c65-8f82-68538c367334 req-b30588b7-1f0e-4cb7-9c56-5fc140cd7315 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:12.660154 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a45d2256-3599-4c65-8f82-68538c367334 req-b30588b7-1f0e-4cb7-9c56-5fc140cd7315 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=2d4c8b31-ca6f-4edf-b0a6-e43793692679 HTTP/1.1" status: 200 len: 849 time: 0.1705291 Nov 02 12:51:12.773259 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a45d2256-3599-4c65-8f82-68538c367334 req-ed25207d-8195-4e29-bafd-f1086fb0db1e service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=cf53051c-17aa-4d08-a264-6c6ed50a7a96&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.1030438 Nov 02 12:51:12.895203 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-0f787130-2c53-463e-bb65-0459297e2529 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:12.901904 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-0f787130-2c53-463e-bb65-0459297e2529 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:12.906439 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-0f787130-2c53-463e-bb65-0459297e2529 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/3de523ee-03fd-4fe7-b289-c241df8759bb HTTP/1.1" status: 204 len: 168 time: 0.4246225 Nov 02 12:51:12.946503 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0f787130-2c53-463e-bb65-0459297e2529 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=3de523ee-03fd-4fe7-b289-c241df8759bb,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:13.129645 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5264fa8-c44a-4938-abaf-74eccc2a365c req-a2b3570d-f040-496d-8fb4-57e1ee8c5725 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:13.142202 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e5264fa8-c44a-4938-abaf-74eccc2a365c req-a2b3570d-f040-496d-8fb4-57e1ee8c5725 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.2898877 Nov 02 12:51:13.147684 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a45d2256-3599-4c65-8f82-68538c367334 req-53c898b3-aa88-46d6-a927-aa94b530b967 service neutron] 10.222.0.90 "GET /v2.0/networks/cf53051c-17aa-4d08-a264-6c6ed50a7a96?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3681531 Nov 02 12:51:13.173580 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-02237631-ecc0-45bc-acc0-0137016d4241 req-711854d5-ba5b-4ed4-bf04-2b7eaab5edb2 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:13.176213 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-02237631-ecc0-45bc-acc0-0137016d4241 req-711854d5-ba5b-4ed4-bf04-2b7eaab5edb2 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 944 time: 0.1825509 Nov 02 12:51:13.270065 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57692) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:13.301125 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-519a9aa4-9c3c-4722-8a91-2221a16adf6a admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:13.446998 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-02237631-ecc0-45bc-acc0-0137016d4241 req-9058a155-2a51-484d-a860-ffd7ca4f5a86 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/security-groups?id=eadb1119-2269-4956-923b-c60da15e2d12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2373471 Nov 02 12:51:13.460244 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e5264fa8-c44a-4938-abaf-74eccc2a365c req-ae599b5a-6ff8-4870-a94b-8065f8a671f1 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3164208 Nov 02 12:51:13.494063 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-519a9aa4-9c3c-4722-8a91-2221a16adf6a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:13.498102 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:51:13.503681 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a45d2256-3599-4c65-8f82-68538c367334 req-6e46b73b-0a29-47ad-97a4-534278055bd5 service neutron] 10.222.0.90 "GET /v2.0/networks/cf53051c-17aa-4d08-a264-6c6ed50a7a96?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3258698 Nov 02 12:51:13.592981 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-519a9aa4-9c3c-4722-8a91-2221a16adf6a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:13.718010 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-519a9aa4-9c3c-4722-8a91-2221a16adf6a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=7494cc87-110f-4f90-a298-7df46d854ca3,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:13.756325 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-519a9aa4-9c3c-4722-8a91-2221a16adf6a admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=4047d18be5d74be08f2e5b2d95576827&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4837487 Nov 02 12:51:13.760741 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57706) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:13.803481 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5835170-1146-4986-9c1e-9e86dea5a733 req-c499a4be-02c5-4391-8525-f360f8df27b3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:13.805943 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c5835170-1146-4986-9c1e-9e86dea5a733 req-c499a4be-02c5-4391-8525-f360f8df27b3 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=eeb1cb4c2b3844da903a64e77a350dab&device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 1097 time: 0.0861161 Nov 02 12:51:13.891792 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-6be5b9e9-bd73-4663-9a1b-0de894dadb0d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:13.934205 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-6be5b9e9-bd73-4663-9a1b-0de894dadb0d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:14.085253 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5835170-1146-4986-9c1e-9e86dea5a733 req-105d9436-01b2-41f8-9740-953caf6b010a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:14.087872 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c5835170-1146-4986-9c1e-9e86dea5a733 req-105d9436-01b2-41f8-9740-953caf6b010a service neutron] 10.222.0.90 "GET /v2.0/networks?id=cf53051c-17aa-4d08-a264-6c6ed50a7a96 HTTP/1.1" status: 200 len: 910 time: 0.2704840 Nov 02 12:51:14.170256 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-6be5b9e9-bd73-4663-9a1b-0de894dadb0d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:14.176480 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-6be5b9e9-bd73-4663-9a1b-0de894dadb0d admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:14.178923 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-6be5b9e9-bd73-4663-9a1b-0de894dadb0d admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/7494cc87-110f-4f90-a298-7df46d854ca3 HTTP/1.1" status: 204 len: 168 time: 0.4166882 Nov 02 12:51:14.188289 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-29435d23-90e8-47c0-ab88-a566a99bac88 req-9d6bd9b9-bab5-489d-8a1f-ef7fa0a4bbd3 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:14.191002 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-29435d23-90e8-47c0-ab88-a566a99bac88 req-9d6bd9b9-bab5-489d-8a1f-ef7fa0a4bbd3 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.1913538 Nov 02 12:51:14.193175 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c5835170-1146-4986-9c1e-9e86dea5a733 req-5a44f12d-ccb2-4969-9cd9-37d7ddca1bed service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=8d44b6a2-0cd6-468d-9078-0647f848f64e HTTP/1.1" status: 200 len: 217 time: 0.0973878 Nov 02 12:51:14.230917 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6be5b9e9-bd73-4663-9a1b-0de894dadb0d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=7494cc87-110f-4f90-a298-7df46d854ca3,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:14.340945 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5835170-1146-4986-9c1e-9e86dea5a733 req-be60aa85-ad1c-47cc-a7aa-a6484123ba2e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:14.343369 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c5835170-1146-4986-9c1e-9e86dea5a733 req-be60aa85-ad1c-47cc-a7aa-a6484123ba2e service neutron] 10.222.0.90 "GET /v2.0/subnets?id=2d4c8b31-ca6f-4edf-b0a6-e43793692679 HTTP/1.1" status: 200 len: 849 time: 0.1408410 Nov 02 12:51:14.382463 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-29435d23-90e8-47c0-ab88-a566a99bac88 req-b4120f81-35da-4d02-9ba9-b17a100bd88b tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1642563 Nov 02 12:51:14.411665 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c5835170-1146-4986-9c1e-9e86dea5a733 req-459084e7-04d9-42b0-ba9c-02400f869758 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=cf53051c-17aa-4d08-a264-6c6ed50a7a96&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0526347 Nov 02 12:51:14.700876 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c5835170-1146-4986-9c1e-9e86dea5a733 req-f53ce760-4afb-4e13-ad9b-094d1664a43b service neutron] 10.222.0.90 "GET /v2.0/networks/cf53051c-17aa-4d08-a264-6c6ed50a7a96?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2793446 Nov 02 12:51:14.893555 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bc3362eb-3269-4241-9d32-35568ba8c959 req-ebb7fb07-db5e-43f4-8627-acc82027df58 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:14.896172 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bc3362eb-3269-4241-9d32-35568ba8c959 req-ebb7fb07-db5e-43f4-8627-acc82027df58 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 944 time: 0.2242427 Nov 02 12:51:14.973995 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c5835170-1146-4986-9c1e-9e86dea5a733 req-555be613-2f1c-465a-8c14-21beb7e8f760 service neutron] 10.222.0.90 "GET /v2.0/networks/cf53051c-17aa-4d08-a264-6c6ed50a7a96?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2448158 Nov 02 12:51:15.036525 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bc3362eb-3269-4241-9d32-35568ba8c959 req-95d4e7ad-1840-452e-8a07-2c32c9ad8e31 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/security-groups?id=eadb1119-2269-4956-923b-c60da15e2d12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1310706 Nov 02 12:51:15.181923 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57752) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:15.344701 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-43963ef0-0e06-4e53-b7f3-0f1c45e02ffd admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-1902419255-network', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:51:15.422792 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43dd4350-dece-47cf-b289-a3c0d0def001 req-6d0011d3-6437-43bd-9dd3-6562e0f6c44c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:15.425430 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-43dd4350-dece-47cf-b289-a3c0d0def001 req-6d0011d3-6437-43bd-9dd3-6562e0f6c44c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.0968099 Nov 02 12:51:15.515334 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-43dd4350-dece-47cf-b289-a3c0d0def001 req-87ca8844-0d1d-4cf6-bfe0-b94f446b4eb8 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0819311 Nov 02 12:51:15.517500 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-43963ef0-0e06-4e53-b7f3-0f1c45e02ffd admin admin] Made reservation on behalf of d3bf5c9bdd7f479aa4cbc28f9a007c81 for: {'network': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:51:15.521827 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-43963ef0-0e06-4e53-b7f3-0f1c45e02ffd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for network, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:15.538219 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-43963ef0-0e06-4e53-b7f3-0f1c45e02ffd admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:15.624983 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a0df6dd-e90d-486b-bb5f-384dc7833cf3 req-9cd53a99-0d69-467a-962a-17cf7d8affc2 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:15.629278 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7a0df6dd-e90d-486b-bb5f-384dc7833cf3 req-9cd53a99-0d69-467a-962a-17cf7d8affc2 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.1063538 Nov 02 12:51:15.693245 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-43963ef0-0e06-4e53-b7f3-0f1c45e02ffd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:15.738282 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7a0df6dd-e90d-486b-bb5f-384dc7833cf3 req-3e17e0a6-b208-4083-8f76-01dc271d7764 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0860987 Nov 02 12:51:15.772715 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-43963ef0-0e06-4e53-b7f3-0f1c45e02ffd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:15.827084 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-43963ef0-0e06-4e53-b7f3-0f1c45e02ffd admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 874} {{(pid=108542) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 02 12:51:15.845499 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43963ef0-0e06-4e53-b7f3-0f1c45e02ffd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4b220cd4-bcd5-478a-84dc-4e0eaa87581b,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:15.853506 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-43963ef0-0e06-4e53-b7f3-0f1c45e02ffd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:15.854048 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.db.segments_db [None req-43963ef0-0e06-4e53-b7f3-0f1c45e02ffd admin admin] Added segment e206345e-67db-4144-84ee-50b4e5db5d75 of type vlan for network adffa68a-25de-4006-9dcc-006cbedf32e3 Nov 02 12:51:15.925674 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-43963ef0-0e06-4e53-b7f3-0f1c45e02ffd admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738449409639'] for network, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:16.039957 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57774) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:16.051467 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-43963ef0-0e06-4e53-b7f3-0f1c45e02ffd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for network, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:16.053048 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-43963ef0-0e06-4e53-b7f3-0f1c45e02ffd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:16.054215 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-43963ef0-0e06-4e53-b7f3-0f1c45e02ffd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:16.173404 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43963ef0-0e06-4e53-b7f3-0f1c45e02ffd admin admin] Pushing event updated for resources: {'Network': ['ID=adffa68a-25de-4006-9dcc-006cbedf32e3,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:16.190179 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Network adffa68a-25de-4006-9dcc-006cbedf32e3 details requested by agent ovs-agent-dv-cinder-816324-1-iscsi with host dv-cinder-816324-1-iscsi {{(pid=108544) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 02 12:51:16.214017 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-43963ef0-0e06-4e53-b7f3-0f1c45e02ffd admin admin] 10.222.0.98 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 1.0257757 Nov 02 12:51:16.216820 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57782) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:16.228030 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-a4fd6daf-6c37-42c7-9d28-23aff4a627b7 admin admin] Request body: {'subnet': {'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-1902419255-subnet', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'ip_version': 4}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:51:16.274142 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-820cdcc8-41ab-4901-9524-d4a636be9317 req-16442023-7fbd-400c-9e49-9a5ae3bc61c4 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:16.279353 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-820cdcc8-41ab-4901-9524-d4a636be9317 req-16442023-7fbd-400c-9e49-9a5ae3bc61c4 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 944 time: 0.1100366 Nov 02 12:51:16.284898 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-39a40a1e-77b5-4b03-bd82-88b433c4bb97 admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-1070484556-network', 'tenant_id': '4a21557a001645f1909c2443ae4b691f'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:51:16.354089 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a4fd6daf-6c37-42c7-9d28-23aff4a627b7 admin admin] Made reservation on behalf of d3bf5c9bdd7f479aa4cbc28f9a007c81 for: {'subnet': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:51:16.357481 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a4fd6daf-6c37-42c7-9d28-23aff4a627b7 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126185635'] for subnet, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:16.370841 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-820cdcc8-41ab-4901-9524-d4a636be9317 req-f2a59b78-1881-4fdb-9836-5f1c8691ecc8 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/security-groups?id=eadb1119-2269-4956-923b-c60da15e2d12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0849185 Nov 02 12:51:16.479391 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-39a40a1e-77b5-4b03-bd82-88b433c4bb97 admin admin] Made reservation on behalf of 4a21557a001645f1909c2443ae4b691f for: {'network': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:51:16.482247 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-39a40a1e-77b5-4b03-bd82-88b433c4bb97 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for network, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:16.499647 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-39a40a1e-77b5-4b03-bd82-88b433c4bb97 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:16.696031 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a870773-5b77-44a3-8c21-e74d66253845 req-3c23dbb5-0828-4839-a461-78c4c502c357 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:16.697758 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6a870773-5b77-44a3-8c21-e74d66253845 req-3c23dbb5-0828-4839-a461-78c4c502c357 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.0608151 Nov 02 12:51:16.698310 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-39a40a1e-77b5-4b03-bd82-88b433c4bb97 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:16.705845 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a4fd6daf-6c37-42c7-9d28-23aff4a627b7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126478280', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126185617'] for subnet, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:16.765106 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6a870773-5b77-44a3-8c21-e74d66253845 req-7582bb0c-de39-451e-9701-e226f4984d13 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0553374 Nov 02 12:51:16.804912 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-39a40a1e-77b5-4b03-bd82-88b433c4bb97 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:16.817592 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a4fd6daf-6c37-42c7-9d28-23aff4a627b7 admin admin] Pushing event updated for resources: {'Subnet': ['ID=9a20b259-01c2-4b3f-8f92-0797a18ff7f7,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:16.839596 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-39a40a1e-77b5-4b03-bd82-88b433c4bb97 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 870} {{(pid=108542) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 02 12:51:16.840465 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a4fd6daf-6c37-42c7-9d28-23aff4a627b7 admin admin] Checking segment: {'id': 'e206345e-67db-4144-84ee-50b4e5db5d75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108542) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:51:16.840808 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4fd6daf-6c37-42c7-9d28-23aff4a627b7 admin admin] Network hostable DHCP agents. Network: adffa68a-25de-4006-9dcc-006cbedf32e3, hostable agents: ['1b947f40-f8bf-4088-a5dc-35ee29d90d78'], hosted agents: [] {{(pid=108542) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 02 12:51:16.862677 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-39a40a1e-77b5-4b03-bd82-88b433c4bb97 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:16.863020 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.db.segments_db [None req-39a40a1e-77b5-4b03-bd82-88b433c4bb97 admin admin] Added segment 18998ba1-fb1c-4749-aa24-56a07054fb75 of type vlan for network 0ce930ad-1b27-46c2-80e4-87a33207655e Nov 02 12:51:16.864255 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39a40a1e-77b5-4b03-bd82-88b433c4bb97 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c45a1ca8-d7b9-42f3-95b6-d637ede7202d,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:16.934910 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-39a40a1e-77b5-4b03-bd82-88b433c4bb97 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738449409639'] for network, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:16.964783 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df9d0af6-1628-48c5-acca-142017e6ac28 req-df86a29e-4b49-40c8-b763-e53cdb68178a tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:16.967558 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-df9d0af6-1628-48c5-acca-142017e6ac28 req-df86a29e-4b49-40c8-b763-e53cdb68178a tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.0964091 Nov 02 12:51:16.974729 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a4fd6daf-6c37-42c7-9d28-23aff4a627b7 admin admin] Network adffa68a-25de-4006-9dcc-006cbedf32e3 is scheduled to be hosted by DHCP agent 1b947f40-f8bf-4088-a5dc-35ee29d90d78 with binding_index 1 {{(pid=108542) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 02 12:51:16.975744 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 8d44b6a2-0cd6-468d-9078-0647f848f64e details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 12:51:17.026907 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-39a40a1e-77b5-4b03-bd82-88b433c4bb97 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for network, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:17.028937 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-39a40a1e-77b5-4b03-bd82-88b433c4bb97 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:17.031074 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-39a40a1e-77b5-4b03-bd82-88b433c4bb97 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:17.065414 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-df9d0af6-1628-48c5-acca-142017e6ac28 req-a6da7722-79bf-46f0-b74f-4ca1dab2f9f1 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0897965 Nov 02 12:51:17.084074 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-a4fd6daf-6c37-42c7-9d28-23aff4a627b7 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816324-1-iscsi, adffa68a-25de-4006-9dcc-006cbedf32e3) {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:51:17.094880 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 8d44b6a2-0cd6-468d-9078-0647f848f64e, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=8d44b6a2-0cd6-468d-9078-0647f848f64e,segment=NetworkSegment(9918b664-73ec-4ba3-8b79-1b2dd2746c03),segment_id=9918b664-73ec-4ba3-8b79-1b2dd2746c03)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:51:17.111128 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-10b1b0d2-97e3-4c41-af31-54f93c5ab0af None None] Network adffa68a-25de-4006-9dcc-006cbedf32e3 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:51:17.114926 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': '8d44b6a2-0cd6-468d-9078-0647f848f64e', 'network_id': 'cf53051c-17aa-4d08-a264-6c6ed50a7a96', 'port_id': '8d44b6a2-0cd6-468d-9078-0647f848f64e', 'mac_address': 'fa:16:3e:54:b1:ed', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 889, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2d4c8b31-ca6f-4edf-b0a6-e43793692679', 'ip_address': '172.20.0.11'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 12:51:17.135999 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a4fd6daf-6c37-42c7-9d28-23aff4a627b7 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:17.136621 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a4fd6daf-6c37-42c7-9d28-23aff4a627b7 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:17.146615 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39a40a1e-77b5-4b03-bd82-88b433c4bb97 admin admin] Pushing event updated for resources: {'Network': ['ID=0ce930ad-1b27-46c2-80e4-87a33207655e,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:17.172521 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-39a40a1e-77b5-4b03-bd82-88b433c4bb97 admin admin] 10.222.0.98 "POST /v2.0/networks HTTP/1.1" status: 201 len: 882 time: 1.1307430 Nov 02 12:51:17.175543 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57792) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:17.183678 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-9065f928-e693-4a81-b307-06cfcee6c819 admin admin] Request body: {'subnet': {'network_id': '0ce930ad-1b27-46c2-80e4-87a33207655e', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-1070484556-subnet', 'tenant_id': '4a21557a001645f1909c2443ae4b691f', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:51:17.209233 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Network 0ce930ad-1b27-46c2-80e4-87a33207655e details requested by agent ovs-agent-dv-cinder-816324-1-iscsi with host dv-cinder-816324-1-iscsi {{(pid=108544) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 02 12:51:17.244110 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-a4fd6daf-6c37-42c7-9d28-23aff4a627b7 admin admin] 10.222.0.98 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 1.0230875 Nov 02 12:51:17.248638 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 57794) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:17.254328 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-79f9ffe0-0a34-4b83-bf36-3d3a4add5bc7 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-1902419255-router', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:51:17.330060 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:17.335113 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-9065f928-e693-4a81-b307-06cfcee6c819 admin admin] Made reservation on behalf of 4a21557a001645f1909c2443ae4b691f for: {'subnet': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:51:17.339567 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-9065f928-e693-4a81-b307-06cfcee6c819 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126185635'] for subnet, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:17.392049 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8d44b6a2-0cd6-468d-9078-0647f848f64e {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:51:17.432727 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-79f9ffe0-0a34-4b83-bf36-3d3a4add5bc7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1593342', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-25677'] for router, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:17.435703 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-79f9ffe0-0a34-4b83-bf36-3d3a4add5bc7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1593154', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1595081', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1973616', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-25716'] for router, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:17.476149 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 8d44b6a2-0cd6-468d-9078-0647f848f64e, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=8d44b6a2-0cd6-468d-9078-0647f848f64e,segment=NetworkSegment(9918b664-73ec-4ba3-8b79-1b2dd2746c03),segment_id=9918b664-73ec-4ba3-8b79-1b2dd2746c03)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:51:17.550443 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-443f7ad9-b8d7-4af0-9da8-4c57658b0ad1 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp94ac73f7-a43e-5b43-a0b7-503cbb5c76bd-adffa68a-25de-4006-9dcc-006cbedf32e3', 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'fixed_ips': [{'subnet_id': '9a20b259-01c2-4b3f-8f92-0797a18ff7f7'}]}} from dv-cinder-816324-1-iscsi. {{(pid=108544) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 02 12:51:17.551855 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-443f7ad9-b8d7-4af0-9da8-4c57658b0ad1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:17.567291 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:17.583852 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-79f9ffe0-0a34-4b83-bf36-3d3a4add5bc7 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:17.609462 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d71f310-ef84-4b42-9a64-312a109916bd req-28a06292-4f09-4fd2-8785-00a9d74859a4 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:17.611514 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7d71f310-ef84-4b42-9a64-312a109916bd req-28a06292-4f09-4fd2-8785-00a9d74859a4 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 944 time: 0.1118090 Nov 02 12:51:17.695908 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7d71f310-ef84-4b42-9a64-312a109916bd req-a0546367-390c-434f-928c-e7919f4d5a80 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/security-groups?id=eadb1119-2269-4956-923b-c60da15e2d12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0717876 Nov 02 12:51:17.743917 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=8d44b6a2-0cd6-468d-9078-0647f848f64e,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:17.755037 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-9065f928-e693-4a81-b307-06cfcee6c819 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126478280', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126185617'] for subnet, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:17.893790 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.db_base_plugin_common [None req-443f7ad9-b8d7-4af0-9da8-4c57658b0ad1 None None] Allocated IP 172.20.0.2 (adffa68a-25de-4006-9dcc-006cbedf32e3/9a20b259-01c2-4b3f-8f92-0797a18ff7f7/f7367a44-35be-44cc-922e-6b32f480d883) {{(pid=108544) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:51:17.895444 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-9065f928-e693-4a81-b307-06cfcee6c819 admin admin] Checking segment: {'id': '18998ba1-fb1c-4749-aa24-56a07054fb75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 870, 'network_id': '0ce930ad-1b27-46c2-80e4-87a33207655e'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108542) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:51:17.896007 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9065f928-e693-4a81-b307-06cfcee6c819 admin admin] Network hostable DHCP agents. Network: 0ce930ad-1b27-46c2-80e4-87a33207655e, hostable agents: ['1b947f40-f8bf-4088-a5dc-35ee29d90d78'], hosted agents: [] {{(pid=108542) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 02 12:51:17.901138 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9065f928-e693-4a81-b307-06cfcee6c819 admin admin] Pushing event updated for resources: {'Subnet': ['ID=a4020aee-5682-461a-a8c4-0fd0248f0a0e,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:17.961256 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-79f9ffe0-0a34-4b83-bf36-3d3a4add5bc7 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:17.998924 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db99a465-0636-4fec-b47f-0c3c6206fa56 req-23d22541-6416-4088-a61e-a32cd2f3ef10 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:18.000689 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-db99a465-0636-4fec-b47f-0c3c6206fa56 req-23d22541-6416-4088-a61e-a32cd2f3ef10 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.0861542 Nov 02 12:51:18.014259 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9065f928-e693-4a81-b307-06cfcee6c819 admin admin] Network 0ce930ad-1b27-46c2-80e4-87a33207655e is scheduled to be hosted by DHCP agent 1b947f40-f8bf-4088-a5dc-35ee29d90d78 with binding_index 1 {{(pid=108542) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 02 12:51:18.095608 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-db99a465-0636-4fec-b47f-0c3c6206fa56 req-f2890d38-c1e7-4dc9-94bf-bd3c26676420 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0832748 Nov 02 12:51:18.097406 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe7d0453-bd37-45be-a0aa-89c00c3588be req-cb1a6a9d-9202-4b06-9366-86abf2fabff3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:18.100478 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fe7d0453-bd37-45be-a0aa-89c00c3588be req-cb1a6a9d-9202-4b06-9366-86abf2fabff3 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=28a90b1659054909ab64ba5320160f74&device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 1099 time: 0.0971954 Nov 02 12:51:18.111478 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-9065f928-e693-4a81-b307-06cfcee6c819 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816324-1-iscsi, 0ce930ad-1b27-46c2-80e4-87a33207655e) {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:51:18.124244 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-9065f928-e693-4a81-b307-06cfcee6c819 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:18.125634 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-9065f928-e693-4a81-b307-06cfcee6c819 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:18.173846 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d80e0286-7244-453f-a307-0792dc58f811 None None] Network 0ce930ad-1b27-46c2-80e4-87a33207655e requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:51:18.300013 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-9065f928-e693-4a81-b307-06cfcee6c819 admin admin] 10.222.0.98 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 846 time: 1.1227422 Nov 02 12:51:18.465210 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-443f7ad9-b8d7-4af0-9da8-4c57658b0ad1 None None] Publish callbacks [] for port, precommit_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:18.502972 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dcd2fad-37c3-447f-a3e4-9d4beda539a1 req-c7e5f68f-af9f-4940-8ce3-8b258a2e19ec tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:18.505940 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3dcd2fad-37c3-447f-a3e4-9d4beda539a1 req-c7e5f68f-af9f-4940-8ce3-8b258a2e19ec tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.2930183 Nov 02 12:51:18.532527 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['8d44b6a2-0cd6-468d-9078-0647f848f64e'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:51:18.548897 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe7d0453-bd37-45be-a0aa-89c00c3588be req-093b45ab-4705-4ace-a865-9edecd231b28 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:18.551766 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fe7d0453-bd37-45be-a0aa-89c00c3588be req-093b45ab-4705-4ace-a865-9edecd231b28 service neutron] 10.222.0.90 "GET /v2.0/networks?id=c965eaf1-5fb6-4689-8b12-fa3913e4f081 HTTP/1.1" status: 200 len: 920 time: 0.4152391 Nov 02 12:51:18.580124 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-443f7ad9-b8d7-4af0-9da8-4c57658b0ad1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669'] for port, after_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:18.601655 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-beea3620-4d75-4624-b2cc-5dfe14785e6a None None] Network 0ce930ad-1b27-46c2-80e4-87a33207655e requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:51:18.658483 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fe7d0453-bd37-45be-a0aa-89c00c3588be req-783a7c49-63cd-4012-a071-08b9cf5b4787 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d32b527e-e041-40dd-b3b1-a7c080a56c87 HTTP/1.1" status: 200 len: 217 time: 0.0883977 Nov 02 12:51:18.667990 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-443f7ad9-b8d7-4af0-9da8-4c57658b0ad1 None None] Network adffa68a-25de-4006-9dcc-006cbedf32e3 is already hosted by enough agents. {{(pid=108544) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:51:18.717209 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.scheduler.base_scheduler [None req-443f7ad9-b8d7-4af0-9da8-4c57658b0ad1 None None] Resources bound (agent type, host, resource id): {{(pid=108544) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:51:18.729515 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-443f7ad9-b8d7-4af0-9da8-4c57658b0ad1 None None] Received port after_create {{(pid=108544) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:51:18.739411 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-443f7ad9-b8d7-4af0-9da8-4c57658b0ad1 None None] Pushing event updated for resources: {'Port': ['ID=f7367a44-35be-44cc-922e-6b32f480d883,revision_number=1']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:18.794249 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3dcd2fad-37c3-447f-a3e4-9d4beda539a1 req-78f8994f-159b-467d-9d31-7dc6060c664d tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2736681 Nov 02 12:51:18.857898 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fe7d0453-bd37-45be-a0aa-89c00c3588be req-6fd72ece-ca04-42b0-be37-46c2264885fd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:18.861124 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fe7d0453-bd37-45be-a0aa-89c00c3588be req-6fd72ece-ca04-42b0-be37-46c2264885fd service neutron] 10.222.0.90 "GET /v2.0/subnets?id=b29075d9-9995-4f6f-8ebd-8f7d748977ef HTTP/1.1" status: 200 len: 859 time: 0.1881707 Nov 02 12:51:18.933925 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-443f7ad9-b8d7-4af0-9da8-4c57658b0ad1 None None] Attempting to bind port f7367a44-35be-44cc-922e-6b32f480d883 on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:51:18.935061 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-443f7ad9-b8d7-4af0-9da8-4c57658b0ad1 None None] Attempting to bind port f7367a44-35be-44cc-922e-6b32f480d883 by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': 'e206345e-67db-4144-84ee-50b4e5db5d75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3'}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:51:18.935632 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-443f7ad9-b8d7-4af0-9da8-4c57658b0ad1 None None] Attempting to bind port f7367a44-35be-44cc-922e-6b32f480d883 on network adffa68a-25de-4006-9dcc-006cbedf32e3 {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:51:18.999012 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-443f7ad9-b8d7-4af0-9da8-4c57658b0ad1 None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 51, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:51:18.999761 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-443f7ad9-b8d7-4af0-9da8-4c57658b0ad1 None None] Checking segment: {'id': 'e206345e-67db-4144-84ee-50b4e5db5d75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108544) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:51:19.000897 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-443f7ad9-b8d7-4af0-9da8-4c57658b0ad1 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:19.001189 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-443f7ad9-b8d7-4af0-9da8-4c57658b0ad1 None None] Bound using segment: {'id': 'e206345e-67db-4144-84ee-50b4e5db5d75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3'} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:51:19.002169 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-443f7ad9-b8d7-4af0-9da8-4c57658b0ad1 None None] Bound port: f7367a44-35be-44cc-922e-6b32f480d883, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e206345e-67db-4144-84ee-50b4e5db5d75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3'}}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:51:19.002948 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-443f7ad9-b8d7-4af0-9da8-4c57658b0ad1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:19.238186 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-443f7ad9-b8d7-4af0-9da8-4c57658b0ad1 None None] For port f7367a44-35be-44cc-922e-6b32f480d883, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108544) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:51:19.269929 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fe7d0453-bd37-45be-a0aa-89c00c3588be req-65358cbd-9e7e-4b1e-bb1a-ee72e73d433c service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=c965eaf1-5fb6-4689-8b12-fa3913e4f081&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.3634331 Nov 02 12:51:19.272625 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-443f7ad9-b8d7-4af0-9da8-4c57658b0ad1 None None] For port f7367a44-35be-44cc-922e-6b32f480d883, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=f7367a44-35be-44cc-922e-6b32f480d883,segment=NetworkSegment(e206345e-67db-4144-84ee-50b4e5db5d75),segment_id=e206345e-67db-4144-84ee-50b4e5db5d75)] {{(pid=108544) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:51:19.399006 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-443f7ad9-b8d7-4af0-9da8-4c57658b0ad1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:19.516207 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57838) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:19.525356 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-4dacdf24-1d70-4f24-8905-b08009b77eaa admin admin] Request body: {'network': {'name': 'tempest-VolumesActionsTest-652640348-network', 'tenant_id': 'cee4aadaaa1c4bfc9eab53171c863afc'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:51:19.534986 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3d14cb8-ed27-4a13-9a9b-0c5192c39384 req-4a6813cb-10dc-4ec2-90ed-864695bb31c8 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:19.548102 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-443f7ad9-b8d7-4af0-9da8-4c57658b0ad1 None None] Pushing event updated for resources: {'Port': ['ID=f7367a44-35be-44cc-922e-6b32f480d883,revision_number=2']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:19.549609 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e3d14cb8-ed27-4a13-9a9b-0c5192c39384 req-4a6813cb-10dc-4ec2-90ed-864695bb31c8 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 945 time: 0.6867132 Nov 02 12:51:19.578605 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-79f9ffe0-0a34-4b83-bf36-3d3a4add5bc7 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:19.677803 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4dacdf24-1d70-4f24-8905-b08009b77eaa admin admin] Made reservation on behalf of cee4aadaaa1c4bfc9eab53171c863afc for: {'network': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:51:19.680961 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4dacdf24-1d70-4f24-8905-b08009b77eaa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for network, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:19.683046 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-79f9ffe0-0a34-4b83-bf36-3d3a4add5bc7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:19.694972 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4dacdf24-1d70-4f24-8905-b08009b77eaa admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:19.706181 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5eb3eb54-0ebc-44ba-b404-6a65dfdd4aaf req-dc806682-9519-4f7e-b746-ecbce75a9423 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:19.709329 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5eb3eb54-0ebc-44ba-b404-6a65dfdd4aaf req-dc806682-9519-4f7e-b746-ecbce75a9423 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.3933606 Nov 02 12:51:19.722120 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fe7d0453-bd37-45be-a0aa-89c00c3588be req-6c1cfe12-1f7a-411b-b26e-f49ac06628cd service neutron] 10.222.0.90 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4439979 Nov 02 12:51:19.966717 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4dacdf24-1d70-4f24-8905-b08009b77eaa admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:19.982432 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 8d44b6a2-0cd6-468d-9078-0647f848f64e up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:51:20.039321 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e3d14cb8-ed27-4a13-9a9b-0c5192c39384 req-d49dd76e-f177-4e2f-855c-38e9895e352a tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/security-groups?id=eadb1119-2269-4956-923b-c60da15e2d12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4881728 Nov 02 12:51:20.089876 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4dacdf24-1d70-4f24-8905-b08009b77eaa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:20.121796 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4dacdf24-1d70-4f24-8905-b08009b77eaa admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 894} {{(pid=108542) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 02 12:51:20.151507 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4dacdf24-1d70-4f24-8905-b08009b77eaa admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:20.152251 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.db.segments_db [None req-4dacdf24-1d70-4f24-8905-b08009b77eaa admin admin] Added segment 7e37cf0e-11fc-42e8-8944-aa0ee11b5aba of type vlan for network d893837d-c57e-4d25-b162-f9b6551bd5a1 Nov 02 12:51:20.176174 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5eb3eb54-0ebc-44ba-b404-6a65dfdd4aaf req-0b0dbbd5-c849-49ae-a407-f54d08924990 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4343305 Nov 02 12:51:20.176942 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dacdf24-1d70-4f24-8905-b08009b77eaa admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=4a97767b-fe4f-43f9-9a53-b3da5ead75fd,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:20.228299 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4dacdf24-1d70-4f24-8905-b08009b77eaa admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738449409639'] for network, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:20.236759 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning for port 8d44b6a2-0cd6-468d-9078-0647f848f64e completed by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 02 12:51:20.241165 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port 8d44b6a2-0cd6-468d-9078-0647f848f64e triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:20.241536 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:20.280979 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fe7d0453-bd37-45be-a0aa-89c00c3588be req-e27fc4d2-b91e-41e7-abe6-0f1fa9094e6c service neutron] 10.222.0.90 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5429244 Nov 02 12:51:20.299602 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [None req-79f9ffe0-0a34-4b83-bf36-3d3a4add5bc7 admin admin] Allocated IP 172.27.0.93 (43464fa8-eb00-46fb-9ca0-be7342f9ddbf/44a807bc-f2b6-41f0-b765-e5d3393fe305/33c58686-52bf-437c-8c82-2fe79a0dde7c) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:51:20.357668 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-08e73cae-38c1-418e-80b3-1980715a1784 req-5a42a608-78c2-41dc-9b65-c8ef78fd01fa tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:20.362271 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-08e73cae-38c1-418e-80b3-1980715a1784 req-5a42a608-78c2-41dc-9b65-c8ef78fd01fa tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.1836088 Nov 02 12:51:20.383922 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:20.449079 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4d6f4b48-f555-4a7a-90ea-cb2901c0d7db', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8d44b6a2-0cd6-468d-9078-0647f848f64e'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:51:20.457118 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f61ef50b-20fb-42ad-be71-2e4aa6e44707" -d '{"events": [{"server_uuid": "4d6f4b48-f555-4a7a-90ea-cb2901c0d7db", "name": "network-vif-plugged", "status": "completed", "tag": "8d44b6a2-0cd6-468d-9078-0647f848f64e"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:51:20.466725 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4dacdf24-1d70-4f24-8905-b08009b77eaa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for network, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:20.470343 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4dacdf24-1d70-4f24-8905-b08009b77eaa admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:20.472044 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4dacdf24-1d70-4f24-8905-b08009b77eaa admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:20.514258 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 8d44b6a2-0cd6-468d-9078-0647f848f64e, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=8d44b6a2-0cd6-468d-9078-0647f848f64e,segment=NetworkSegment(9918b664-73ec-4ba3-8b79-1b2dd2746c03),segment_id=9918b664-73ec-4ba3-8b79-1b2dd2746c03)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:51:20.553931 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57854) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:20.578236 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:51:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-73a4feb0-3095-4310-a976-1ecf24e87e1f x-openstack-request-id: req-73a4feb0-3095-4310-a976-1ecf24e87e1f {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:51:20.578939 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4d6f4b48-f555-4a7a-90ea-cb2901c0d7db", "name": "network-vif-plugged", "status": "completed", "tag": "8d44b6a2-0cd6-468d-9078-0647f848f64e", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:51:20.579353 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-73a4feb0-3095-4310-a976-1ecf24e87e1f {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:51:20.580356 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4d6f4b48-f555-4a7a-90ea-cb2901c0d7db', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8d44b6a2-0cd6-468d-9078-0647f848f64e', 'code': 200} Nov 02 12:51:20.586208 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:20.662856 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-08e73cae-38c1-418e-80b3-1980715a1784 req-ac72e2ea-bb18-4083-8da7-11552259efe4 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2631078 Nov 02 12:51:20.674343 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dacdf24-1d70-4f24-8905-b08009b77eaa admin admin] Pushing event updated for resources: {'Network': ['ID=d893837d-c57e-4d25-b162-f9b6551bd5a1,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:20.725671 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Network d893837d-c57e-4d25-b162-f9b6551bd5a1 details requested by agent ovs-agent-dv-cinder-816324-1-iscsi with host dv-cinder-816324-1-iscsi {{(pid=108544) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 02 12:51:20.736132 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-4dacdf24-1d70-4f24-8905-b08009b77eaa admin admin] 10.222.0.98 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 1.2169223 Nov 02 12:51:20.742931 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57858) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:20.763694 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-2f6acf37-7a10-423c-8b22-b1bc52add75a admin admin] Request body: {'subnet': {'network_id': 'd893837d-c57e-4d25-b162-f9b6551bd5a1', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesActionsTest-652640348-subnet', 'tenant_id': 'cee4aadaaa1c4bfc9eab53171c863afc', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:51:20.773418 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=8d44b6a2-0cd6-468d-9078-0647f848f64e,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:20.781783 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-79f9ffe0-0a34-4b83-bf36-3d3a4add5bc7 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:20.906123 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2f6acf37-7a10-423c-8b22-b1bc52add75a admin admin] Made reservation on behalf of cee4aadaaa1c4bfc9eab53171c863afc for: {'subnet': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:51:20.910616 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2f6acf37-7a10-423c-8b22-b1bc52add75a admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126185635'] for subnet, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:20.972563 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-42374c59-9426-4378-8d82-616fddc57ebd admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:20.999163 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-79f9ffe0-0a34-4b83-bf36-3d3a4add5bc7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:21.117136 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-79f9ffe0-0a34-4b83-bf36-3d3a4add5bc7 admin admin] Network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:51:21.127058 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [None req-79f9ffe0-0a34-4b83-bf36-3d3a4add5bc7 admin admin] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:51:21.133130 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [None req-79f9ffe0-0a34-4b83-bf36-3d3a4add5bc7 admin admin] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:51:21.142396 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-79f9ffe0-0a34-4b83-bf36-3d3a4add5bc7 admin admin] Pushing event updated for resources: {'Port': ['ID=33c58686-52bf-437c-8c82-2fe79a0dde7c,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:21.145669 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-80182758-1fcb-463c-beae-fa87bbd0460a None None] Network adffa68a-25de-4006-9dcc-006cbedf32e3 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:51:21.185245 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef8d8291-435b-466e-9cbe-e1b8fb2c48c8 req-56210dc7-de85-4806-9077-5dbac7403f99 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:21.187054 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ef8d8291-435b-466e-9cbe-e1b8fb2c48c8 req-56210dc7-de85-4806-9077-5dbac7403f99 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 1099 time: 0.1180563 Nov 02 12:51:21.252998 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-c0626b93-bdc2-4b7e-81be-6f69d315b04a None None] Provisioning complete for port f7367a44-35be-44cc-922e-6b32f480d883 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:21.253752 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c0626b93-bdc2-4b7e-81be-6f69d315b04a None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:21.353337 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-42374c59-9426-4378-8d82-616fddc57ebd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:21.453611 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-42374c59-9426-4378-8d82-616fddc57ebd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:21.463045 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ef8d8291-435b-466e-9cbe-e1b8fb2c48c8 req-be9f4f6d-0f6f-4cd5-bf95-d83587180005 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=eadb1119-2269-4956-923b-c60da15e2d12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2660112 Nov 02 12:51:21.510109 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b57e2631-4980-46fc-81e7-2145bd3e723a req-0a5b7ea3-4e1f-468d-8c74-4f2d918a8877 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:21.526637 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b57e2631-4980-46fc-81e7-2145bd3e723a req-0a5b7ea3-4e1f-468d-8c74-4f2d918a8877 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.2106078 Nov 02 12:51:21.532790 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c0626b93-bdc2-4b7e-81be-6f69d315b04a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:21.541298 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d1af9852-9648-4277-8377-08c62f04bd42 req-6a935461-461e-458f-b151-7b46407f720c tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:21.552085 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d1af9852-9648-4277-8377-08c62f04bd42 req-6a935461-461e-458f-b151-7b46407f720c tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 946 time: 0.3352292 Nov 02 12:51:21.555333 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-42374c59-9426-4378-8d82-616fddc57ebd admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=d396e83c5d5f41a8860f8cc84473d968&name=default HTTP/1.1" status: 200 len: 2996 time: 0.9964552 Nov 02 12:51:21.556768 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57874) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:21.591290 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42374c59-9426-4378-8d82-616fddc57ebd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6bedd9a8-8ac1-418b-8423-f616f8090730,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:21.621394 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2f6acf37-7a10-423c-8b22-b1bc52add75a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126478280', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126185617'] for subnet, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:21.635334 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-c0626b93-bdc2-4b7e-81be-6f69d315b04a None None] For port f7367a44-35be-44cc-922e-6b32f480d883, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=f7367a44-35be-44cc-922e-6b32f480d883,segment=NetworkSegment(e206345e-67db-4144-84ee-50b4e5db5d75),segment_id=e206345e-67db-4144-84ee-50b4e5db5d75)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:51:21.664970 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b57e2631-4980-46fc-81e7-2145bd3e723a req-bd835313-bfd9-4e17-afb4-4b4d32f1777e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1342776 Nov 02 12:51:21.677851 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d1af9852-9648-4277-8377-08c62f04bd42 req-4cd844e1-f4c3-44ef-82b5-c8c9aa83854f tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/security-groups?id=eadb1119-2269-4956-923b-c60da15e2d12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1245749 Nov 02 12:51:21.729537 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c0626b93-bdc2-4b7e-81be-6f69d315b04a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:21.745913 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f6acf37-7a10-423c-8b22-b1bc52add75a admin admin] Pushing event updated for resources: {'Subnet': ['ID=79af21c7-51eb-4af2-b5ee-7b5a1e1fb617,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:21.801186 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2f6acf37-7a10-423c-8b22-b1bc52add75a admin admin] Checking segment: {'id': '7e37cf0e-11fc-42e8-8944-aa0ee11b5aba', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 894, 'network_id': 'd893837d-c57e-4d25-b162-f9b6551bd5a1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108542) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:51:21.804801 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f6acf37-7a10-423c-8b22-b1bc52add75a admin admin] Network hostable DHCP agents. Network: d893837d-c57e-4d25-b162-f9b6551bd5a1, hostable agents: ['1b947f40-f8bf-4088-a5dc-35ee29d90d78'], hosted agents: [] {{(pid=108542) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 02 12:51:21.820498 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-18cd31c0-c31c-458f-9201-c1c01fe55037 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:21.852364 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-18cd31c0-c31c-458f-9201-c1c01fe55037 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:21.889029 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0626b93-bdc2-4b7e-81be-6f69d315b04a None None] Pushing event updated for resources: {'Port': ['ID=f7367a44-35be-44cc-922e-6b32f480d883,revision_number=3']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:21.966993 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-79f9ffe0-0a34-4b83-bf36-3d3a4add5bc7 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:21.980034 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-19237b60-a250-499d-8d43-5e356fc9c885 None None] Provisioning complete for port f7367a44-35be-44cc-922e-6b32f480d883 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:21.980663 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-19237b60-a250-499d-8d43-5e356fc9c885 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:22.009638 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-18cd31c0-c31c-458f-9201-c1c01fe55037 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:22.017953 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-207e0307-79fc-4eba-8241-b665ec7f3246 req-75d4d74d-f326-442c-8f74-f0317c5b5161 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:22.019890 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-207e0307-79fc-4eba-8241-b665ec7f3246 req-75d4d74d-f326-442c-8f74-f0317c5b5161 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.1159675 Nov 02 12:51:22.031722 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-18cd31c0-c31c-458f-9201-c1c01fe55037 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:22.048739 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device f7367a44-35be-44cc-922e-6b32f480d883 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:51:22.049325 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-18cd31c0-c31c-458f-9201-c1c01fe55037 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/6bedd9a8-8ac1-418b-8423-f616f8090730 HTTP/1.1" status: 204 len: 168 time: 0.4896846 Nov 02 12:51:22.062717 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2f6acf37-7a10-423c-8b22-b1bc52add75a admin admin] Network d893837d-c57e-4d25-b162-f9b6551bd5a1 is scheduled to be hosted by DHCP agent 1b947f40-f8bf-4088-a5dc-35ee29d90d78 with binding_index 1 {{(pid=108542) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 02 12:51:22.082224 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18cd31c0-c31c-458f-9201-c1c01fe55037 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6bedd9a8-8ac1-418b-8423-f616f8090730,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:22.174048 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-207e0307-79fc-4eba-8241-b665ec7f3246 req-d2902895-9b95-48bd-a9e8-8b6503085fed tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1426198 Nov 02 12:51:22.223708 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port f7367a44-35be-44cc-922e-6b32f480d883 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:22.224300 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:22.232836 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-2f6acf37-7a10-423c-8b22-b1bc52add75a admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816324-1-iscsi, d893837d-c57e-4d25-b162-f9b6551bd5a1) {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:51:22.239760 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2f6acf37-7a10-423c-8b22-b1bc52add75a admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:22.240745 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2f6acf37-7a10-423c-8b22-b1bc52add75a admin admin] Publish callbacks [] for subnet, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:22.273763 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-e72aadd1-783b-4c70-9332-9805966933c1 None None] Network d893837d-c57e-4d25-b162-f9b6551bd5a1 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:51:22.344233 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-79f9ffe0-0a34-4b83-bf36-3d3a4add5bc7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1593163', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1595034'] for router, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:22.405636 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-2f6acf37-7a10-423c-8b22-b1bc52add75a admin admin] 10.222.0.98 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 845 time: 1.6535177 Nov 02 12:51:22.491679 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-56e7303e-0777-4e78-8c51-f11b655c8c93 None None] Network d893837d-c57e-4d25-b162-f9b6551bd5a1 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:51:22.881954 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-79f9ffe0-0a34-4b83-bf36-3d3a4add5bc7 admin admin] Router 10f9b13b-6fcd-41e4-937a-5876beb694b1 is scheduled to L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc with binding_index 1 {{(pid=108543) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 02 12:51:23.124818 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c94b6df4-12cc-4a9f-b79b-5625308c4ef4 req-5543b678-4f43-454a-83f8-17f2cd1ec8a4 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:23.126609 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c94b6df4-12cc-4a9f-b79b-5625308c4ef4 req-5543b678-4f43-454a-83f8-17f2cd1ec8a4 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.3022661 Nov 02 12:51:23.141971 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cc2cff82-223d-4af2-8781-c4bda7443ca4 req-d063e2b2-73cc-4c7c-96b7-51e995a1f967 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:23.147396 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cc2cff82-223d-4af2-8781-c4bda7443ca4 req-d063e2b2-73cc-4c7c-96b7-51e995a1f967 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 946 time: 0.1919019 Nov 02 12:51:23.391782 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-79f9ffe0-0a34-4b83-bf36-3d3a4add5bc7 admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108543) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:51:23.411244 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cc2cff82-223d-4af2-8781-c4bda7443ca4 req-3e303b8d-ef44-4aa6-837d-07a9df9596cd tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/security-groups?id=eadb1119-2269-4956-923b-c60da15e2d12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2561481 Nov 02 12:51:23.413985 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] Sync routers for ids ['10f9b13b-6fcd-41e4-937a-5876beb694b1'] in dv-cinder-816324-1-iscsi {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:51:23.417694 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c94b6df4-12cc-4a9f-b79b-5625308c4ef4 req-7ca6d18d-89a4-4315-b812-c60976e096bb tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2685113 Nov 02 12:51:23.451377 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] Routers {'10f9b13b-6fcd-41e4-937a-5876beb694b1'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:51:23.452106 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:50:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['10f9b13b-6fcd-41e4-937a-5876beb694b1'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:23.593692 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f9a8fef-5e55-46e4-9589-13792abf8da3 req-7863a367-22dd-49c3-a9df-5b4ee908e29e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:23.595742 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3f9a8fef-5e55-46e4-9589-13792abf8da3 req-7863a367-22dd-49c3-a9df-5b4ee908e29e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.0674188 Nov 02 12:51:23.604595 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] Set router 10f9b13b-6fcd-41e4-937a-5876beb694b1 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:51:23.679473 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3f9a8fef-5e55-46e4-9589-13792abf8da3 req-e9afeb4d-49de-43bf-a1a1-1160aab49529 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0638382 Nov 02 12:51:23.685276 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-79f9ffe0-0a34-4b83-bf36-3d3a4add5bc7 admin admin] Publish callbacks [] for router, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:23.689939 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-79f9ffe0-0a34-4b83-bf36-3d3a4add5bc7 admin admin] 10.222.0.98 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 6.4376338 Nov 02 12:51:23.690068 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-8b533ba2-3864-4e2e-82a7-31f11d66e182 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:23.690524 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57918) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:23.929608 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device f7367a44-35be-44cc-922e-6b32f480d883 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:51:23.973508 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'name': 'tempest-TestShelveInstance-1902419255-router', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:17Z', 'updated_at': '2021-11-02T12:51:21Z', 'revision_number': 3, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'gw_port': {'id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b1:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 365, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:19Z', 'updated_at': '2021-11-02T12:51:20Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:24.042688 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] Checking router: 10f9b13b-6fcd-41e4-937a-5876beb694b1 for host: dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:51:24.043465 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] Updating router 10f9b13b-6fcd-41e4-937a-5876beb694b1 port 33c58686-52bf-437c-8c82-2fe79a0dde7c binding host dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 02 12:51:24.051089 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port f7367a44-35be-44cc-922e-6b32f480d883 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:24.052021 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:24.072003 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:24.083632 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 57926) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:24.288177 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-d0522261-3ac9-4c62-a4fd-a5a909f679d6 admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-2134929835-network', 'tenant_id': '697de566c0334435b902950f6f31da45'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:51:24.422610 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] Publish callbacks [] for port, precommit_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:24.461700 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-d0522261-3ac9-4c62-a4fd-a5a909f679d6 admin admin] Made reservation on behalf of 697de566c0334435b902950f6f31da45 for: {'network': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:51:24.469096 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d0522261-3ac9-4c62-a4fd-a5a909f679d6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for network, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:24.490262 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d0522261-3ac9-4c62-a4fd-a5a909f679d6 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:24.551887 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:24.711782 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] Attempting to bind port 33c58686-52bf-437c-8c82-2fe79a0dde7c on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:51:24.713622 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] Attempting to bind port 33c58686-52bf-437c-8c82-2fe79a0dde7c by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}] {{(pid=108545) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:51:24.713622 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] Attempting to bind port 33c58686-52bf-437c-8c82-2fe79a0dde7c on network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:51:24.716121 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95b9ab27-a692-4181-9a78-be6cd3a109e5 None None] Pushing event updated for resources: {'Port': ['ID=33c58686-52bf-437c-8c82-2fe79a0dde7c,revision_number=2']} {{(pid=108545) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:24.727572 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 51, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:51:24.728362 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] Checking segment: {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108545) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:51:24.729226 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:24.729995 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] Bound using segment: {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'} {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:51:24.730778 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] Bound port: 33c58686-52bf-437c-8c82-2fe79a0dde7c, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}}] {{(pid=108545) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:51:24.732757 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:24.736847 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95b9ab27-a692-4181-9a78-be6cd3a109e5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:24.737574 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95b9ab27-a692-4181-9a78-be6cd3a109e5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:24.738106 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95b9ab27-a692-4181-9a78-be6cd3a109e5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:24.738734 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95b9ab27-a692-4181-9a78-be6cd3a109e5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:24.739258 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95b9ab27-a692-4181-9a78-be6cd3a109e5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:24.740004 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95b9ab27-a692-4181-9a78-be6cd3a109e5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:24.740538 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95b9ab27-a692-4181-9a78-be6cd3a109e5 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:24.741052 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95b9ab27-a692-4181-9a78-be6cd3a109e5 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:24.741608 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95b9ab27-a692-4181-9a78-be6cd3a109e5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:24.742610 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95b9ab27-a692-4181-9a78-be6cd3a109e5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:24.743222 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95b9ab27-a692-4181-9a78-be6cd3a109e5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:24.744005 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95b9ab27-a692-4181-9a78-be6cd3a109e5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:24.745254 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-049ef013-1b7b-450f-b5e2-a3dfed418c73 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:24.809253 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d0522261-3ac9-4c62-a4fd-a5a909f679d6 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:24.846831 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-51bf05f0-c2f0-4922-8730-9b3851d75935 req-50fd95b0-4c8e-4900-a68a-4c489ab3a5c3 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:24.857738 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-51bf05f0-c2f0-4922-8730-9b3851d75935 req-50fd95b0-4c8e-4900-a68a-4c489ab3a5c3 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.1802707 Nov 02 12:51:24.865125 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.db [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] For port 33c58686-52bf-437c-8c82-2fe79a0dde7c, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108545) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:51:24.869524 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.db [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] For port 33c58686-52bf-437c-8c82-2fe79a0dde7c, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=33c58686-52bf-437c-8c82-2fe79a0dde7c,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108545) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:51:24.906696 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e7d6e6f-fef7-448f-9ca9-35950e260ee5 req-fec3e2bf-4ae3-4715-aecf-8ce092b7da1c tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:24.910022 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7e7d6e6f-fef7-448f-9ca9-35950e260ee5 req-fec3e2bf-4ae3-4715-aecf-8ce092b7da1c tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 946 time: 0.2297411 Nov 02 12:51:24.921609 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d0522261-3ac9-4c62-a4fd-a5a909f679d6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:24.969607 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:25.000502 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-d0522261-3ac9-4c62-a4fd-a5a909f679d6 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 892} {{(pid=108543) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 02 12:51:25.040206 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-51bf05f0-c2f0-4922-8730-9b3851d75935 req-f591b47c-9ac5-4e92-a241-7b2b7588f23c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1842878 Nov 02 12:51:25.079001 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d0522261-3ac9-4c62-a4fd-a5a909f679d6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:25.079001 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.db.segments_db [None req-d0522261-3ac9-4c62-a4fd-a5a909f679d6 admin admin] Added segment c8ecb7dc-9cc8-47a7-94e7-62f066a97c10 of type vlan for network 89f406ae-1b9f-4be7-8881-87075d7c5aa1 Nov 02 12:51:25.079912 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0522261-3ac9-4c62-a4fd-a5a909f679d6 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9d5da3ed-bc60-4581-ab0f-f49b32a79555,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:25.095364 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95b9ab27-a692-4181-9a78-be6cd3a109e5 None None] Pushing event updated for resources: {'Port': ['ID=33c58686-52bf-437c-8c82-2fe79a0dde7c,revision_number=3']} {{(pid=108545) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:25.108929 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] Routers {'10f9b13b-6fcd-41e4-937a-5876beb694b1'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:51:25.109580 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:50:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['10f9b13b-6fcd-41e4-937a-5876beb694b1'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:25.292213 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_common [None req-049ef013-1b7b-450f-b5e2-a3dfed418c73 admin admin] Allocated IP 172.20.0.1 (adffa68a-25de-4006-9dcc-006cbedf32e3/9a20b259-01c2-4b3f-8f92-0797a18ff7f7/0201d689-2e60-4ec9-800a-0897da7fce09) {{(pid=108542) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:51:25.402698 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] Set router 10f9b13b-6fcd-41e4-937a-5876beb694b1 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:51:25.513846 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7e7d6e6f-fef7-448f-9ca9-35950e260ee5 req-39dc097f-3506-4bb8-82b5-0fe4a2e40090 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/security-groups?id=eadb1119-2269-4956-923b-c60da15e2d12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5624490 Nov 02 12:51:25.583272 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d0522261-3ac9-4c62-a4fd-a5a909f679d6 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738449409639'] for network, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:25.622241 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57962) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:25.634954 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e718fd8-04f2-459b-9eed-f3235476a375 req-38a62940-0e2b-46c1-98bf-5a17b0b058bf tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:25.636763 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8e718fd8-04f2-459b-9eed-f3235476a375 req-38a62940-0e2b-46c1-98bf-5a17b0b058bf tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.1280494 Nov 02 12:51:25.655625 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0225d5d2-5583-442d-8e75-5a3f16e767ae None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:25.705478 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-049ef013-1b7b-450f-b5e2-a3dfed418c73 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:25.715824 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d0522261-3ac9-4c62-a4fd-a5a909f679d6 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for network, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:25.716852 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-d0522261-3ac9-4c62-a4fd-a5a909f679d6 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:25.717519 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d0522261-3ac9-4c62-a4fd-a5a909f679d6 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:25.738364 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8e718fd8-04f2-459b-9eed-f3235476a375 req-46e93e11-02ee-4586-891d-43d8fd1adb6e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0821209 Nov 02 12:51:25.834448 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-d0522261-3ac9-4c62-a4fd-a5a909f679d6 admin admin] 10.222.0.98 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.7455153 Nov 02 12:51:25.836661 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 57968) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:25.842498 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d0522261-3ac9-4c62-a4fd-a5a909f679d6 admin admin] Pushing event updated for resources: {'Network': ['ID=89f406ae-1b9f-4be7-8881-87075d7c5aa1,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:25.845140 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-a5985f9f-302a-4bd9-85bd-3b048565986e admin admin] Request body: {'subnet': {'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-2134929835-subnet', 'tenant_id': '697de566c0334435b902950f6f31da45', 'ip_version': 4}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:51:25.877399 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Network 89f406ae-1b9f-4be7-8881-87075d7c5aa1 details requested by agent ovs-agent-dv-cinder-816324-1-iscsi with host dv-cinder-816324-1-iscsi {{(pid=108544) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 02 12:51:25.931404 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-021b90a6-bfff-46d2-9e69-a10f0c623c6a admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:25.952602 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-049ef013-1b7b-450f-b5e2-a3dfed418c73 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:25.958254 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'name': 'tempest-TestShelveInstance-1902419255-router', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:17Z', 'updated_at': '2021-11-02T12:51:21Z', 'revision_number': 3, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'gw_port': {'id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b1:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 365, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:19Z', 'updated_at': '2021-11-02T12:51:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:26.021797 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ceb9ed2e-f3c2-4fbf-842c-b2fa28b7fa77 None None] The sync data for ids ['10f9b13b-6fcd-41e4-937a-5876beb694b1'] in dv-cinder-816324-1-iscsi is: [{'id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'name': 'tempest-TestShelveInstance-1902419255-router', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:17Z', 'updated_at': '2021-11-02T12:51:21Z', 'revision_number': 3, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'gw_port': {'id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b1:29', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 365, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:19Z', 'updated_at': '2021-11-02T12:51:24Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}] {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:51:26.029091 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-049ef013-1b7b-450f-b5e2-a3dfed418c73 admin admin] Network adffa68a-25de-4006-9dcc-006cbedf32e3 is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:51:26.032053 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-049ef013-1b7b-450f-b5e2-a3dfed418c73 admin admin] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:51:26.034583 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-049ef013-1b7b-450f-b5e2-a3dfed418c73 admin admin] Pushing event updated for resources: {'Port': ['ID=0201d689-2e60-4ec9-800a-0897da7fce09,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:26.051410 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [None req-049ef013-1b7b-450f-b5e2-a3dfed418c73 admin admin] Received port after_create {{(pid=108542) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:51:26.133864 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-a5985f9f-302a-4bd9-85bd-3b048565986e admin admin] Made reservation on behalf of 697de566c0334435b902950f6f31da45 for: {'subnet': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:51:26.137007 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a5985f9f-302a-4bd9-85bd-3b048565986e admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126185635'] for subnet, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:26.243485 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-049ef013-1b7b-450f-b5e2-a3dfed418c73 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1590217'] for router_interface, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:26.419370 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-021b90a6-bfff-46d2-9e69-a10f0c623c6a admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:26.552202 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-baf488c1-4436-426f-8091-8882d03a11df None None] Provisioning complete for port 0201d689-2e60-4ec9-800a-0897da7fce09 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:26.554643 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-baf488c1-4436-426f-8091-8882d03a11df None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:26.571146 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-021b90a6-bfff-46d2-9e69-a10f0c623c6a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:26.715870 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-baf488c1-4436-426f-8091-8882d03a11df None None] Port 0201d689-2e60-4ec9-800a-0897da7fce09 cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:51:26.767676 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-021b90a6-bfff-46d2-9e69-a10f0c623c6a admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=fd26d614-d427-4f07-9fdb-7e0cd3760f0f,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:26.919079 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:27.173691 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b548dcfe-60e8-4a08-b018-2559f1208a63 req-ef928fc3-661a-465a-bdcf-d9c1535175f7 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:27.183497 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b548dcfe-60e8-4a08-b018-2559f1208a63 req-ef928fc3-661a-465a-bdcf-d9c1535175f7 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.2076931 Nov 02 12:51:27.301707 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-021b90a6-bfff-46d2-9e69-a10f0c623c6a admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=65b6d3ae08e543c3835b276d07dc0293&name=default HTTP/1.1" status: 200 len: 2996 time: 1.6768577 Nov 02 12:51:27.312048 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 58002) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:27.373615 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b548dcfe-60e8-4a08-b018-2559f1208a63 req-4b404584-3705-40b6-8295-4a02bbde1ea5 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1694758 Nov 02 12:51:27.427436 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-049ef013-1b7b-450f-b5e2-a3dfed418c73 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:27.663646 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-2e7e6b17-dadf-46da-82ff-345b3cc8273e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:27.753503 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-2e7e6b17-dadf-46da-82ff-345b3cc8273e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:27.802575 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-6deb8a27-9df1-4d22-8351-44729dd1d65b tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:27.806005 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-6deb8a27-9df1-4d22-8351-44729dd1d65b tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/networks?id=bfe7dfe3-4b23-4454-b60a-4955be8d2d31 HTTP/1.1" status: 200 len: 815 time: 0.4303260 Nov 02 12:51:27.828188 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a5985f9f-302a-4bd9-85bd-3b048565986e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126478280', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126185617'] for subnet, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:27.907361 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-e693c4a6-454f-44c9-833d-f9a8ffc52e28 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/quotas/dfe80527be524672a94a38908e154182 HTTP/1.1" status: 200 len: 375 time: 0.0781755 Nov 02 12:51:28.018634 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-6dc3f35c-f1de-49e5-8cbf-dfc29bf9a024 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?tenant_id=dfe80527be524672a94a38908e154182&fields=id HTTP/1.1" status: 200 len: 255 time: 0.0961347 Nov 02 12:51:28.041187 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a5985f9f-302a-4bd9-85bd-3b048565986e admin admin] Pushing event updated for resources: {'Subnet': ['ID=ae24c2fe-abba-48cd-9d91-28a628d2ef95,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:28.057556 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-a5985f9f-302a-4bd9-85bd-3b048565986e admin admin] Checking segment: {'id': 'c8ecb7dc-9cc8-47a7-94e7-62f066a97c10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108542) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:51:28.058034 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5985f9f-302a-4bd9-85bd-3b048565986e admin admin] Network hostable DHCP agents. Network: 89f406ae-1b9f-4be7-8881-87075d7c5aa1, hostable agents: ['1b947f40-f8bf-4088-a5dc-35ee29d90d78'], hosted agents: [] {{(pid=108542) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 02 12:51:28.060563 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 33c58686-52bf-437c-8c82-2fe79a0dde7c up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:51:28.095739 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-2e7e6b17-dadf-46da-82ff-345b3cc8273e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:28.100903 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-2e7e6b17-dadf-46da-82ff-345b3cc8273e admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:28.103693 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-2e7e6b17-dadf-46da-82ff-345b3cc8273e admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/fd26d614-d427-4f07-9fdb-7e0cd3760f0f HTTP/1.1" status: 204 len: 168 time: 0.7948716 Nov 02 12:51:28.110339 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-049ef013-1b7b-450f-b5e2-a3dfed418c73 admin admin] Publish callbacks [] for port, precommit_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:28.147982 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e7e6b17-dadf-46da-82ff-345b3cc8273e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=fd26d614-d427-4f07-9fdb-7e0cd3760f0f,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:28.197629 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-049ef013-1b7b-450f-b5e2-a3dfed418c73 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126476609'] for port, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:28.212133 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 33c58686-52bf-437c-8c82-2fe79a0dde7c triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:28.212629 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:28.221145 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-b752a404-fde2-4289-8681-d703e4e4e7ed service neutron] 10.222.0.98 "GET /v2.0/networks/bfe7dfe3-4b23-4454-b60a-4955be8d2d31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1858737 Nov 02 12:51:28.286802 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a5985f9f-302a-4bd9-85bd-3b048565986e admin admin] Network 89f406ae-1b9f-4be7-8881-87075d7c5aa1 is scheduled to be hosted by DHCP agent 1b947f40-f8bf-4088-a5dc-35ee29d90d78 with binding_index 1 {{(pid=108542) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 02 12:51:28.316891 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-049ef013-1b7b-450f-b5e2-a3dfed418c73 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1649136', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1590109'] for router_interface, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:28.319934 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-049ef013-1b7b-450f-b5e2-a3dfed418c73 admin admin] Pushing event updated for resources: {'Port': ['ID=0201d689-2e60-4ec9-800a-0897da7fce09,revision_number=2']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:28.383379 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-4c4b4ead-5186-447c-acf0-82821d747bbb service neutron] 10.222.0.98 "GET /v2.0/networks/bfe7dfe3-4b23-4454-b60a-4955be8d2d31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1488149 Nov 02 12:51:28.423651 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:28.477747 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] For port 33c58686-52bf-437c-8c82-2fe79a0dde7c, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=33c58686-52bf-437c-8c82-2fe79a0dde7c,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:51:28.493811 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:28.511280 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-a5985f9f-302a-4bd9-85bd-3b048565986e admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816324-1-iscsi, 89f406ae-1b9f-4be7-8881-87075d7c5aa1) {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:51:28.530425 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5d80f715-5faf-433b-b25a-3e3e08a5fcf1 None None] Network 89f406ae-1b9f-4be7-8881-87075d7c5aa1 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:51:28.548590 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-a5985f9f-302a-4bd9-85bd-3b048565986e admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:28.549557 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a5985f9f-302a-4bd9-85bd-3b048565986e admin admin] Publish callbacks [] for subnet, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:28.556966 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a7bf496-b420-4a67-8ab7-02041e7ae965 req-c84f13ee-675d-4d94-a921-64cb449a21ff tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:28.568507 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:28.577376 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9a7bf496-b420-4a67-8ab7-02041e7ae965 req-c84f13ee-675d-4d94-a921-64cb449a21ff tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.1794534 Nov 02 12:51:28.624575 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-049ef013-1b7b-450f-b5e2-a3dfed418c73 admin admin] Network adffa68a-25de-4006-9dcc-006cbedf32e3 is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:51:28.626577 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-049ef013-1b7b-450f-b5e2-a3dfed418c73 admin admin] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:51:28.675482 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9a7bf496-b420-4a67-8ab7-02041e7ae965 req-a7e6efab-9877-4b46-ae57-90327f458217 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0964181 Nov 02 12:51:28.707616 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-a5985f9f-302a-4bd9-85bd-3b048565986e admin admin] 10.222.0.98 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 2.8692954 Nov 02 12:51:28.712160 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 58024) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:28.728974 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-29179fe8-5187-438c-b88e-8210a4169ef4 admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:51:28.890996 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-29179fe8-5187-438c-b88e-8210a4169ef4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1593342', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-25677'] for router, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:28.899881 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-29179fe8-5187-438c-b88e-8210a4169ef4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1593154', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1595081', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1973616', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-25716'] for router, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:28.985696 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-049ef013-1b7b-450f-b5e2-a3dfed418c73 admin admin] Router 10f9b13b-6fcd-41e4-937a-5876beb694b1 has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108542) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 12:51:29.039459 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c1da6482-f874-4dba-9be7-fd1ed0dbf6df req-4f805c29-e4a4-45b8-acfe-fa3a38068652 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:29.049461 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c1da6482-f874-4dba-9be7-fd1ed0dbf6df req-4f805c29-e4a4-45b8-acfe-fa3a38068652 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 946 time: 0.2113070 Nov 02 12:51:29.236914 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-049ef013-1b7b-450f-b5e2-a3dfed418c73 admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108542) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:51:29.250625 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-049ef013-1b7b-450f-b5e2-a3dfed418c73 admin admin] 10.222.0.98 "PUT /v2.0/routers/10f9b13b-6fcd-41e4-937a-5876beb694b1/add_router_interface HTTP/1.1" status: 200 len: 503 time: 5.5586166 Nov 02 12:51:29.272993 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-29179fe8-5187-438c-b88e-8210a4169ef4 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:29.304613 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] Sync routers for ids ['10f9b13b-6fcd-41e4-937a-5876beb694b1'] in dv-cinder-816324-1-iscsi {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:51:29.360580 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-3ccf5116-3f95-4600-8cdf-e8148c6b170e None None] Provisioning complete for port 0201d689-2e60-4ec9-800a-0897da7fce09 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:29.366178 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-3ccf5116-3f95-4600-8cdf-e8148c6b170e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:29.391611 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dd8726bb-e57c-41c0-b8c4-84fe336ad7fe req-99b4ebc1-b403-492f-a278-e6efeb6cce68 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:29.393599 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-dd8726bb-e57c-41c0-b8c4-84fe336ad7fe req-99b4ebc1-b403-492f-a278-e6efeb6cce68 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.4195225 Nov 02 12:51:29.441398 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] Routers {'10f9b13b-6fcd-41e4-937a-5876beb694b1'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:51:29.442671 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:51:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['10f9b13b-6fcd-41e4-937a-5876beb694b1'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:29.459539 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-3ccf5116-3f95-4600-8cdf-e8148c6b170e None None] Port 0201d689-2e60-4ec9-800a-0897da7fce09 cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:51:29.481541 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c1da6482-f874-4dba-9be7-fd1ed0dbf6df req-95986159-1e6d-4131-82b4-2684ac69c56d tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/security-groups?id=eadb1119-2269-4956-923b-c60da15e2d12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2606354 Nov 02 12:51:29.560788 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Pushing event updated for resources: {'Port': ['ID=33c58686-52bf-437c-8c82-2fe79a0dde7c,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:29.777583 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c9eb1c2d-a4e5-41a4-af46-7452b8cc2fff None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp94ac73f7-a43e-5b43-a0b7-503cbb5c76bd-89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'tenant_id': '697de566c0334435b902950f6f31da45', 'fixed_ips': [{'subnet_id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95'}]}} from dv-cinder-816324-1-iscsi. {{(pid=108544) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 02 12:51:29.778511 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c9eb1c2d-a4e5-41a4-af46-7452b8cc2fff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:29.814085 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-29179fe8-5187-438c-b88e-8210a4169ef4 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:29.839447 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-dd8726bb-e57c-41c0-b8c4-84fe336ad7fe req-4d659353-a0ef-4fae-bb45-0ccacde000ae tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4272556 Nov 02 12:51:30.008006 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.db_base_plugin_common [None req-c9eb1c2d-a4e5-41a4-af46-7452b8cc2fff None None] Allocated IP 172.20.0.2 (89f406ae-1b9f-4be7-8881-87075d7c5aa1/ae24c2fe-abba-48cd-9d91-28a628d2ef95/135dfe61-cf29-438c-a3e1-47697452f814) {{(pid=108544) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:51:30.093339 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 33c58686-52bf-437c-8c82-2fe79a0dde7c up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:51:30.123054 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device bf7c4605-4045-4117-af22-08d75129b835 details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 12:51:30.160950 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] Set router 10f9b13b-6fcd-41e4-937a-5876beb694b1 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:51:30.198011 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-36952e69-222f-47c7-959c-3052d3a4f674 req-06a82152-02e3-4972-8a1b-52876fecbc33 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=0d21bc42-7392-483d-b042-8c4ffea9a7f2 HTTP/1.1" status: 200 len: 210 time: 0.1052315 Nov 02 12:51:30.234661 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b84fa8b3-23f2-4b39-b177-bd45d3ecd867 req-1e95afcc-703f-4768-a889-f12069db6329 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:30.237308 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b84fa8b3-23f2-4b39-b177-bd45d3ecd867 req-1e95afcc-703f-4768-a889-f12069db6329 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.90 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 946 time: 0.3512967 Nov 02 12:51:30.468857 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 33c58686-52bf-437c-8c82-2fe79a0dde7c triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:30.469823 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:30.547274 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-b84fa8b3-23f2-4b39-b177-bd45d3ecd867 req-6cbd1e64-6f25-4c44-9b52-cceadf206ec9 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Deleting port 8d44b6a2-0cd6-468d-9078-0647f848f64e {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:51:30.548133 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b84fa8b3-23f2-4b39-b177-bd45d3ecd867 req-6cbd1e64-6f25-4c44-9b52-cceadf206ec9 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:30.591923 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c9eb1c2d-a4e5-41a4-af46-7452b8cc2fff None None] Publish callbacks [] for port, precommit_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:30.595515 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port bf7c4605-4045-4117-af22-08d75129b835, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=bf7c4605-4045-4117-af22-08d75129b835,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:51:30.625148 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': 'bf7c4605-4045-4117-af22-08d75129b835', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'port_id': 'bf7c4605-4045-4117-af22-08d75129b835', 'mac_address': 'fa:16:3e:8b:d9:62', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 854, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 12:51:30.833662 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c9eb1c2d-a4e5-41a4-af46-7452b8cc2fff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669'] for port, after_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:30.854804 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:30.968233 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:30.989040 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-29179fe8-5187-438c-b88e-8210a4169ef4 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:30.990292 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id bf7c4605-4045-4117-af22-08d75129b835 {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:51:31.011808 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c9eb1c2d-a4e5-41a4-af46-7452b8cc2fff None None] Network 89f406ae-1b9f-4be7-8881-87075d7c5aa1 is already hosted by enough agents. {{(pid=108544) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:51:31.049345 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-29179fe8-5187-438c-b88e-8210a4169ef4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:31.056580 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.scheduler.base_scheduler [None req-c9eb1c2d-a4e5-41a4-af46-7452b8cc2fff None None] Resources bound (agent type, host, resource id): {{(pid=108544) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:51:31.061582 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c9eb1c2d-a4e5-41a4-af46-7452b8cc2fff None None] Received port after_create {{(pid=108544) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:51:31.093954 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9eb1c2d-a4e5-41a4-af46-7452b8cc2fff None None] Pushing event updated for resources: {'Port': ['ID=135dfe61-cf29-438c-a3e1-47697452f814,revision_number=1']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:31.110826 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port bf7c4605-4045-4117-af22-08d75129b835, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=bf7c4605-4045-4117-af22-08d75129b835,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:51:31.145516 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'name': 'tempest-TestShelveInstance-1902419255-router', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:17Z', 'updated_at': '2021-11-02T12:51:26Z', 'revision_number': 4, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'gw_port': {'id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b1:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 365, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:19Z', 'updated_at': '2021-11-02T12:51:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '0201d689-2e60-4ec9-800a-0897da7fce09', 'name': '', 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'mac_address': 'fa:16:3e:34:99:55', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '9a20b259-01c2-4b3f-8f92-0797a18ff7f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:24Z', 'updated_at': '2021-11-02T12:51:27Z', 'revision_number': 2, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'subnets': [{'id': '9a20b259-01c2-4b3f-8f92-0797a18ff7f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:31.209570 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-053a1925-7cbe-42e8-aadc-2e6bb65a5654 req-625421f5-2036-4bd2-a442-3556211e4065 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:31.211923 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-053a1925-7cbe-42e8-aadc-2e6bb65a5654 req-625421f5-2036-4bd2-a442-3556211e4065 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 946 time: 0.4045849 Nov 02 12:51:31.223366 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] Checking router: 10f9b13b-6fcd-41e4-937a-5876beb694b1 for host: dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:51:31.223905 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] Updating router 10f9b13b-6fcd-41e4-937a-5876beb694b1 port 0201d689-2e60-4ec9-800a-0897da7fce09 binding host dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 02 12:51:31.233004 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-b84fa8b3-23f2-4b39-b177-bd45d3ecd867 req-6cbd1e64-6f25-4c44-9b52-cceadf206ec9 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] For port 8d44b6a2-0cd6-468d-9078-0647f848f64e, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=8d44b6a2-0cd6-468d-9078-0647f848f64e,segment=NetworkSegment(9918b664-73ec-4ba3-8b79-1b2dd2746c03),segment_id=9918b664-73ec-4ba3-8b79-1b2dd2746c03)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:51:31.234931 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b84fa8b3-23f2-4b39-b177-bd45d3ecd867 req-6cbd1e64-6f25-4c44-9b52-cceadf206ec9 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:31.289783 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:31.304596 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:31.314621 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-b84fa8b3-23f2-4b39-b177-bd45d3ecd867 req-6cbd1e64-6f25-4c44-9b52-cceadf206ec9 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Calling delete_port for 8d44b6a2-0cd6-468d-9078-0647f848f64e owned by compute:nova {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:51:31.390298 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=bf7c4605-4045-4117-af22-08d75129b835,revision_number=6']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:31.401653 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-c9eb1c2d-a4e5-41a4-af46-7452b8cc2fff None None] Attempting to bind port 135dfe61-cf29-438c-a3e1-47697452f814 on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:51:31.402101 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-c9eb1c2d-a4e5-41a4-af46-7452b8cc2fff None None] Attempting to bind port 135dfe61-cf29-438c-a3e1-47697452f814 by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': 'c8ecb7dc-9cc8-47a7-94e7-62f066a97c10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1'}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:51:31.402748 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9eb1c2d-a4e5-41a4-af46-7452b8cc2fff None None] Attempting to bind port 135dfe61-cf29-438c-a3e1-47697452f814 on network 89f406ae-1b9f-4be7-8881-87075d7c5aa1 {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:51:31.520054 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['bf7c4605-4045-4117-af22-08d75129b835'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:51:31.537317 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58100) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:31.544081 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-4ddea673-8a7a-48e1-8f28-ff80930c26b5 admin admin] Request body: {'network': {'name': 'tempest-TestShelveInstance-685743967-network', 'tenant_id': '8207b92ade05471e96c3fb2b69070dc9'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:51:31.633750 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9eb1c2d-a4e5-41a4-af46-7452b8cc2fff None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 51, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:51:31.634638 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9eb1c2d-a4e5-41a4-af46-7452b8cc2fff None None] Checking segment: {'id': 'c8ecb7dc-9cc8-47a7-94e7-62f066a97c10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108544) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:51:31.635273 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c9eb1c2d-a4e5-41a4-af46-7452b8cc2fff None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:31.636413 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c9eb1c2d-a4e5-41a4-af46-7452b8cc2fff None None] Bound using segment: {'id': 'c8ecb7dc-9cc8-47a7-94e7-62f066a97c10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1'} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:51:31.636927 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-c9eb1c2d-a4e5-41a4-af46-7452b8cc2fff None None] Bound port: 135dfe61-cf29-438c-a3e1-47697452f814, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c8ecb7dc-9cc8-47a7-94e7-62f066a97c10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1'}}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:51:31.637842 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c9eb1c2d-a4e5-41a4-af46-7452b8cc2fff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:31.681717 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4ddea673-8a7a-48e1-8f28-ff80930c26b5 admin admin] Made reservation on behalf of 8207b92ade05471e96c3fb2b69070dc9 for: {'network': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:51:31.692664 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4ddea673-8a7a-48e1-8f28-ff80930c26b5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for network, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:31.704494 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4ddea673-8a7a-48e1-8f28-ff80930c26b5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:31.914136 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4ddea673-8a7a-48e1-8f28-ff80930c26b5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:31.915990 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5f39aeda-fb18-4408-916c-6f74bb95c72b req-5ada591b-f907-4b68-a4a9-d0a1ee4965fb tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:31.918817 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5f39aeda-fb18-4408-916c-6f74bb95c72b req-5ada591b-f907-4b68-a4a9-d0a1ee4965fb tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 944 time: 0.4225609 Nov 02 12:51:31.977116 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-053a1925-7cbe-42e8-aadc-2e6bb65a5654 req-93cf50a1-d612-4fad-9786-848e5d34fb49 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/security-groups?id=eadb1119-2269-4956-923b-c60da15e2d12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.7464089 Nov 02 12:51:31.983539 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-c9eb1c2d-a4e5-41a4-af46-7452b8cc2fff None None] For port 135dfe61-cf29-438c-a3e1-47697452f814, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108544) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:51:32.000146 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4ddea673-8a7a-48e1-8f28-ff80930c26b5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:32.031139 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-4ddea673-8a7a-48e1-8f28-ff80930c26b5 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 855} {{(pid=108542) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 02 12:51:32.056044 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [None req-29179fe8-5187-438c-b88e-8210a4169ef4 admin admin] Allocated IP 172.27.0.227 (43464fa8-eb00-46fb-9ca0-be7342f9ddbf/44a807bc-f2b6-41f0-b765-e5d3393fe305/c81df0e3-6336-4caa-8387-60c3321fe152) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:51:32.056964 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-c9eb1c2d-a4e5-41a4-af46-7452b8cc2fff None None] For port 135dfe61-cf29-438c-a3e1-47697452f814, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=135dfe61-cf29-438c-a3e1-47697452f814,segment=NetworkSegment(c8ecb7dc-9cc8-47a7-94e7-62f066a97c10),segment_id=c8ecb7dc-9cc8-47a7-94e7-62f066a97c10)] {{(pid=108544) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:51:32.067387 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4ddea673-8a7a-48e1-8f28-ff80930c26b5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:32.072534 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.db.segments_db [None req-4ddea673-8a7a-48e1-8f28-ff80930c26b5 admin admin] Added segment b7dd916f-2223-4397-bf62-f54ca54f5493 of type vlan for network caeed602-a9f7-4485-9f47-7818b602d82c Nov 02 12:51:32.105499 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b84fa8b3-23f2-4b39-b177-bd45d3ecd867 req-6cbd1e64-6f25-4c44-9b52-cceadf206ec9 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:32.139589 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ddea673-8a7a-48e1-8f28-ff80930c26b5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e1632635-1eba-4e80-b6e6-ee933a5008a1,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:32.165908 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c9eb1c2d-a4e5-41a4-af46-7452b8cc2fff None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:32.245742 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6cbd1e64-6f25-4c44-9b52-cceadf206ec9 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Pushing event deleted for resources: {'Port': ['ID=8d44b6a2-0cd6-468d-9078-0647f848f64e,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:32.295592 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4ddea673-8a7a-48e1-8f28-ff80930c26b5 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738449409639'] for network, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:32.320960 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-74963117-6f93-4483-9da3-2edc45feb01b req-3b634dff-5a39-4564-88b2-477355f6636e tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=0d21bc42-7392-483d-b042-8c4ffea9a7f2 HTTP/1.1" status: 200 len: 210 time: 0.1371171 Nov 02 12:51:32.321951 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-b84fa8b3-23f2-4b39-b177-bd45d3ecd867 req-6cbd1e64-6f25-4c44-9b52-cceadf206ec9 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] No DVR routers for this DVR port 8d44b6a2-0cd6-468d-9078-0647f848f64e on host hv-cinder-81632 {{(pid=108543) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 12:51:32.344106 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b84fa8b3-23f2-4b39-b177-bd45d3ecd867 req-6cbd1e64-6f25-4c44-9b52-cceadf206ec9 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:32.350418 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b84fa8b3-23f2-4b39-b177-bd45d3ecd867 req-6cbd1e64-6f25-4c44-9b52-cceadf206ec9 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.90 "DELETE /v2.0/ports/8d44b6a2-0cd6-468d-9078-0647f848f64e HTTP/1.1" status: 204 len: 173 time: 2.0960186 Nov 02 12:51:32.362838 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '4d6f4b48-f555-4a7a-90ea-cb2901c0d7db', 'name': 'network-vif-deleted', 'tag': '8d44b6a2-0cd6-468d-9078-0647f848f64e'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:51:32.363975 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-163219ba-d329-47d0-9ab3-303bc313f41c" -d '{"events": [{"server_uuid": "4d6f4b48-f555-4a7a-90ea-cb2901c0d7db", "name": "network-vif-deleted", "tag": "8d44b6a2-0cd6-468d-9078-0647f848f64e"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:51:32.433331 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5f39aeda-fb18-4408-916c-6f74bb95c72b req-7488dcef-66bf-444f-b190-b7008330765a tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4447975 Nov 02 12:51:32.511093 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4ddea673-8a7a-48e1-8f28-ff80930c26b5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for network, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:32.516785 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4ddea673-8a7a-48e1-8f28-ff80930c26b5 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:32.517488 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4ddea673-8a7a-48e1-8f28-ff80930c26b5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:32.523365 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:51:32 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3368bf2d-38cd-4b57-bdb4-1b30f4b2c0ff x-openstack-request-id: req-3368bf2d-38cd-4b57-bdb4-1b30f4b2c0ff {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:51:32.524403 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "4d6f4b48-f555-4a7a-90ea-cb2901c0d7db", "name": "network-vif-deleted", "tag": "8d44b6a2-0cd6-468d-9078-0647f848f64e", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:51:32.525040 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-3368bf2d-38cd-4b57-bdb4-1b30f4b2c0ff {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:51:32.525931 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '4d6f4b48-f555-4a7a-90ea-cb2901c0d7db', 'name': 'network-vif-deleted', 'tag': '8d44b6a2-0cd6-468d-9078-0647f848f64e', 'status': 'completed', 'code': 200} Nov 02 12:51:32.560093 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-29179fe8-5187-438c-b88e-8210a4169ef4 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:32.742854 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-29179fe8-5187-438c-b88e-8210a4169ef4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:32.830688 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ddea673-8a7a-48e1-8f28-ff80930c26b5 admin admin] Pushing event updated for resources: {'Network': ['ID=caeed602-a9f7-4485-9f47-7818b602d82c,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:32.888354 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-4ddea673-8a7a-48e1-8f28-ff80930c26b5 admin admin] 10.222.0.98 "POST /v2.0/networks HTTP/1.1" status: 201 len: 881 time: 1.3483088 Nov 02 12:51:32.892770 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58122) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:32.894448 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Network caeed602-a9f7-4485-9f47-7818b602d82c details requested by agent ovs-agent-dv-cinder-816324-1-iscsi with host dv-cinder-816324-1-iscsi {{(pid=108544) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 02 12:51:32.959850 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-4e788870-e153-4007-8d48-9df38b90e754 admin admin] Request body: {'subnet': {'network_id': 'caeed602-a9f7-4485-9f47-7818b602d82c', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestShelveInstance-685743967-subnet', 'tenant_id': '8207b92ade05471e96c3fb2b69070dc9', 'ip_version': 4}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:51:32.961065 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-29179fe8-5187-438c-b88e-8210a4169ef4 admin admin] Network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:51:32.968484 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [None req-29179fe8-5187-438c-b88e-8210a4169ef4 admin admin] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:51:32.981787 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [None req-29179fe8-5187-438c-b88e-8210a4169ef4 admin admin] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:51:33.145986 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29179fe8-5187-438c-b88e-8210a4169ef4 admin admin] Pushing event updated for resources: {'Port': ['ID=c81df0e3-6336-4caa-8387-60c3321fe152,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:33.233922 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-4e788870-e153-4007-8d48-9df38b90e754 admin admin] Made reservation on behalf of 8207b92ade05471e96c3fb2b69070dc9 for: {'subnet': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:51:33.242650 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4e788870-e153-4007-8d48-9df38b90e754 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126185635'] for subnet, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:33.366566 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] Publish callbacks [] for port, precommit_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:33.440501 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9eb1c2d-a4e5-41a4-af46-7452b8cc2fff None None] Pushing event updated for resources: {'Port': ['ID=135dfe61-cf29-438c-a3e1-47697452f814,revision_number=2']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:33.484508 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:33.588793 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c57d25ab-5828-47d1-b6f2-ac572ae35e61 req-aaa3609b-8d45-4f00-a5c0-0f95f831ed2a tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=4d6f4b48-f555-4a7a-90ea-cb2901c0d7db HTTP/1.1" status: 200 len: 210 time: 0.1718843 Nov 02 12:51:33.595123 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:33.838529 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] Attempting to bind port 0201d689-2e60-4ec9-800a-0897da7fce09 on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:51:33.838966 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] Attempting to bind port 0201d689-2e60-4ec9-800a-0897da7fce09 by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': 'e206345e-67db-4144-84ee-50b4e5db5d75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3'}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:51:33.839689 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] Attempting to bind port 0201d689-2e60-4ec9-800a-0897da7fce09 on network adffa68a-25de-4006-9dcc-006cbedf32e3 {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:51:33.848532 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb1fe6be-3c88-4bd3-a96b-c1f07e12bbf8 None None] Pushing event updated for resources: {'Port': ['ID=0201d689-2e60-4ec9-800a-0897da7fce09,revision_number=3']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:33.871303 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 51, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:51:33.873139 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] Checking segment: {'id': 'e206345e-67db-4144-84ee-50b4e5db5d75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108544) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:51:33.874518 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:33.875353 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] Bound using segment: {'id': 'e206345e-67db-4144-84ee-50b4e5db5d75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3'} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:51:33.876078 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] Bound port: 0201d689-2e60-4ec9-800a-0897da7fce09, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'e206345e-67db-4144-84ee-50b4e5db5d75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3'}}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:51:33.876695 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:33.882764 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0ac6bd9b-97d6-436c-a8c2-b4453a1bcaf2 req-22336e4a-aead-4fbf-bbdd-337aab0c1979 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=0d21bc42-7392-483d-b042-8c4ffea9a7f2 HTTP/1.1" status: 200 len: 210 time: 0.2531176 Nov 02 12:51:34.081480 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] For port 0201d689-2e60-4ec9-800a-0897da7fce09, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108544) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:51:34.085880 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] For port 0201d689-2e60-4ec9-800a-0897da7fce09, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=0201d689-2e60-4ec9-800a-0897da7fce09,segment=NetworkSegment(e206345e-67db-4144-84ee-50b4e5db5d75),segment_id=e206345e-67db-4144-84ee-50b4e5db5d75)] {{(pid=108544) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:51:34.094829 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device bf7c4605-4045-4117-af22-08d75129b835 up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:51:34.241449 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 135dfe61-cf29-438c-a3e1-47697452f814 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:51:34.368222 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:34.465854 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-c31bc7e4-e086-49e5-834e-56d27343658f None None] Provisioning complete for port 0201d689-2e60-4ec9-800a-0897da7fce09 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:34.466227 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c31bc7e4-e086-49e5-834e-56d27343658f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:34.472922 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4e788870-e153-4007-8d48-9df38b90e754 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126478280', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126185617'] for subnet, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:34.538780 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port bf7c4605-4045-4117-af22-08d75129b835 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:34.539154 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:34.575953 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb1fe6be-3c88-4bd3-a96b-c1f07e12bbf8 None None] Pushing event updated for resources: {'Port': ['ID=0201d689-2e60-4ec9-800a-0897da7fce09,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:34.587791 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] Routers {'10f9b13b-6fcd-41e4-937a-5876beb694b1'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:51:34.588471 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:51:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['10f9b13b-6fcd-41e4-937a-5876beb694b1'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:34.704116 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e788870-e153-4007-8d48-9df38b90e754 admin admin] Pushing event updated for resources: {'Subnet': ['ID=981d49eb-4000-4cb3-981b-174f2c0b159a,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:34.721114 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4e788870-e153-4007-8d48-9df38b90e754 admin admin] Checking segment: {'id': 'b7dd916f-2223-4397-bf62-f54ca54f5493', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': 'caeed602-a9f7-4485-9f47-7818b602d82c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108542) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:51:34.723812 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e788870-e153-4007-8d48-9df38b90e754 admin admin] Network hostable DHCP agents. Network: caeed602-a9f7-4485-9f47-7818b602d82c, hostable agents: ['1b947f40-f8bf-4088-a5dc-35ee29d90d78'], hosted agents: [] {{(pid=108542) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 02 12:51:34.804502 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 135dfe61-cf29-438c-a3e1-47697452f814 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:34.805159 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:34.819844 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a4ca171e-d965-48ea-b71e-fbb0677abbb0 None None] Network 89f406ae-1b9f-4be7-8881-87075d7c5aa1 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:51:34.895669 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4e788870-e153-4007-8d48-9df38b90e754 admin admin] Network caeed602-a9f7-4485-9f47-7818b602d82c is scheduled to be hosted by DHCP agent 1b947f40-f8bf-4088-a5dc-35ee29d90d78 with binding_index 1 {{(pid=108542) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 02 12:51:34.991838 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-4e788870-e153-4007-8d48-9df38b90e754 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816324-1-iscsi, caeed602-a9f7-4485-9f47-7818b602d82c) {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:51:35.011719 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-4e788870-e153-4007-8d48-9df38b90e754 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:35.015222 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4e788870-e153-4007-8d48-9df38b90e754 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:35.021738 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9e3ef3e3-a0cf-4be8-b051-7c0c043ee405 None None] Network caeed602-a9f7-4485-9f47-7818b602d82c requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:51:35.149328 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-6c47e541-bdbe-4bdb-8b2a-a6b494a20ba5 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.98 "GET /v2.0/networks?tenant_id=f8553176e5c84edb8b82d01321b30b1c&shared=False HTTP/1.1" status: 200 len: 213 time: 0.1150649 Nov 02 12:51:35.184303 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-4e788870-e153-4007-8d48-9df38b90e754 admin admin] 10.222.0.98 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 844 time: 2.2870793 Nov 02 12:51:35.185538 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58188) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:35.213752 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-279f1737-bd68-4ac9-8011-bf3a183b3737 admin admin] Request body: {'router': {'name': 'tempest-TestShelveInstance-685743967-router', 'tenant_id': '8207b92ade05471e96c3fb2b69070dc9', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:51:35.221201 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-8a74525e-678a-4990-88c6-191fcff8cc83 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:35.222876 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-8a74525e-678a-4990-88c6-191fcff8cc83 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.90 "GET /v2.0/networks?id=bfe7dfe3-4b23-4454-b60a-4955be8d2d31 HTTP/1.1" status: 200 len: 815 time: 1.7265148 Nov 02 12:51:35.261605 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-aeadb98d-49f4-4f26-8b38-7981c2025d01 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Request body: {'port': {'device_id': '0d21bc42-7392-483d-b042-8c4ffea9a7f2', 'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31', 'admin_state_up': True, 'tenant_id': 'dfe80527be524672a94a38908e154182'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:51:35.296876 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:35.299431 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-29179fe8-5187-438c-b88e-8210a4169ef4 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:35.338065 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da7afae4-032c-42e7-980e-209845aa890f req-aae521df-7a19-4d86-a6b1-63074f539890 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:35.351842 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-da7afae4-032c-42e7-980e-209845aa890f req-aae521df-7a19-4d86-a6b1-63074f539890 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 944 time: 1.1739621 Nov 02 12:51:35.356909 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] Set router 10f9b13b-6fcd-41e4-937a-5876beb694b1 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:51:35.366604 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7cc2c649-db32-4af2-b17b-1b744ef40a5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bf7c4605-4045-4117-af22-08d75129b835'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:51:35.369354 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4547a88a-ea18-4fa9-9570-52b8fa26520a" -d '{"events": [{"server_uuid": "7cc2c649-db32-4af2-b17b-1b744ef40a5f", "name": "network-vif-plugged", "status": "completed", "tag": "bf7c4605-4045-4117-af22-08d75129b835"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:51:35.419076 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-279f1737-bd68-4ac9-8011-bf3a183b3737 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1593342', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-25677'] for router, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:35.420733 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-279f1737-bd68-4ac9-8011-bf3a183b3737 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1593154', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1595081', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1973616', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-25716'] for router, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:35.578867 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-279f1737-bd68-4ac9-8011-bf3a183b3737 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:35.764910 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port bf7c4605-4045-4117-af22-08d75129b835, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=bf7c4605-4045-4117-af22-08d75129b835,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:51:35.772373 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-644d2c13-9156-43a1-871a-ea9400b5f37e tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:35.776714 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:35.789921 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-644d2c13-9156-43a1-871a-ea9400b5f37e tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.98 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.5983973 Nov 02 12:51:35.791090 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c31bc7e4-e086-49e5-834e-56d27343658f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:35.822410 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-da7afae4-032c-42e7-980e-209845aa890f req-24ed56a9-6be9-4993-916d-5cb3bee9e604 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4693713 Nov 02 12:51:35.862643 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-934a63bb-7d33-4b22-98c3-ebf6fa1141c8 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.98 "GET /v2.0/quotas/f8553176e5c84edb8b82d01321b30b1c HTTP/1.1" status: 200 len: 375 time: 0.0713272 Nov 02 12:51:35.862951 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:35.864003 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 8d44b6a2-0cd6-468d-9078-0647f848f64e no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:51:35.896462 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] No Port match for: 8d44b6a2-0cd6-468d-9078-0647f848f64e {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:51:35.897092 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 8d44b6a2-0cd6-468d-9078-0647f848f64e not bound to the agent host hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:51:36.026544 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-279f1737-bd68-4ac9-8011-bf3a183b3737 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:36.309676 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-087abcf5-676e-4398-9ef9-27573d949602 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.98 "GET /v2.0/ports?tenant_id=f8553176e5c84edb8b82d01321b30b1c&fields=id HTTP/1.1" status: 200 len: 210 time: 0.4435959 Nov 02 12:51:36.324211 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-aeadb98d-49f4-4f26-8b38-7981c2025d01 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Made reservation on behalf of dfe80527be524672a94a38908e154182 for: {'port': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:51:36.331721 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-aeadb98d-49f4-4f26-8b38-7981c2025d01 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:36.385345 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-c31bc7e4-e086-49e5-834e-56d27343658f None None] For port 0201d689-2e60-4ec9-800a-0897da7fce09, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=0201d689-2e60-4ec9-800a-0897da7fce09,segment=NetworkSegment(e206345e-67db-4144-84ee-50b4e5db5d75),segment_id=e206345e-67db-4144-84ee-50b4e5db5d75)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:51:36.412292 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] For port 135dfe61-cf29-438c-a3e1-47697452f814, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=135dfe61-cf29-438c-a3e1-47697452f814,segment=NetworkSegment(c8ecb7dc-9cc8-47a7-94e7-62f066a97c10),segment_id=c8ecb7dc-9cc8-47a7-94e7-62f066a97c10)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:51:36.461978 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-227d3448-37f2-4a8b-b70a-53f3a09141ab req-789a397b-4d8c-44fc-80d4-474c40336637 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=0d21bc42-7392-483d-b042-8c4ffea9a7f2 HTTP/1.1" status: 200 len: 210 time: 0.2118945 Nov 02 12:51:36.467714 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-29179fe8-5187-438c-b88e-8210a4169ef4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1593163', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1595034'] for router, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:36.532295 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:36.535473 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c31bc7e4-e086-49e5-834e-56d27343658f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:36.647342 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=bf7c4605-4045-4117-af22-08d75129b835,revision_number=7']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:36.745909 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-81c9436a-a8f6-4a0a-8159-5861f33851d2 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp94ac73f7-a43e-5b43-a0b7-503cbb5c76bd-caeed602-a9f7-4485-9f47-7818b602d82c', 'network_id': 'caeed602-a9f7-4485-9f47-7818b602d82c', 'tenant_id': '8207b92ade05471e96c3fb2b69070dc9', 'fixed_ips': [{'subnet_id': '981d49eb-4000-4cb3-981b-174f2c0b159a'}]}} from dv-cinder-816324-1-iscsi. {{(pid=108544) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 02 12:51:36.747255 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-81c9436a-a8f6-4a0a-8159-5861f33851d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:36.854941 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:51:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-87c5ba71-b93c-4fbe-bc27-f856cd9060c7 x-openstack-request-id: req-87c5ba71-b93c-4fbe-bc27-f856cd9060c7 {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:51:36.855409 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7cc2c649-db32-4af2-b17b-1b744ef40a5f", "name": "network-vif-plugged", "status": "completed", "tag": "bf7c4605-4045-4117-af22-08d75129b835", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:51:36.866080 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-87c5ba71-b93c-4fbe-bc27-f856cd9060c7 {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:51:36.866927 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7cc2c649-db32-4af2-b17b-1b744ef40a5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bf7c4605-4045-4117-af22-08d75129b835', 'code': 200} Nov 02 12:51:36.915200 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-279f1737-bd68-4ac9-8011-bf3a183b3737 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:36.942897 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-849dd09a-53d7-4cb0-b36a-b1a029e5fa7e None None] Provisioning complete for port 0201d689-2e60-4ec9-800a-0897da7fce09 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:36.943494 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-849dd09a-53d7-4cb0-b36a-b1a029e5fa7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:37.025087 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-279f1737-bd68-4ac9-8011-bf3a183b3737 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:37.483605 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_common [None req-279f1737-bd68-4ac9-8011-bf3a183b3737 admin admin] Allocated IP 172.27.0.246 (43464fa8-eb00-46fb-9ca0-be7342f9ddbf/44a807bc-f2b6-41f0-b765-e5d3393fe305/22dd88eb-dc23-4b7d-a289-a316ccafbbe0) {{(pid=108542) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:51:37.698218 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f75ad397-3aeb-45e9-9a44-2270c134e151 req-a3faccd3-9ce0-4251-bc43-a2429b1e5457 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:37.716655 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f75ad397-3aeb-45e9-9a44-2270c134e151 req-a3faccd3-9ce0-4251-bc43-a2429b1e5457 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.4866862 Nov 02 12:51:37.806324 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c068392-c900-4df7-a336-5dc990bc0709 req-4dd2d628-3269-47dc-ac43-5267f4e53e10 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:37.817614 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8c068392-c900-4df7-a336-5dc990bc0709 req-4dd2d628-3269-47dc-ac43-5267f4e53e10 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/networks?id=cf53051c-17aa-4d08-a264-6c6ed50a7a96 HTTP/1.1" status: 200 len: 809 time: 0.5177920 Nov 02 12:51:37.837415 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-aeadb98d-49f4-4f26-8b38-7981c2025d01 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Allocated IP 172.20.0.3 (bfe7dfe3-4b23-4454-b60a-4955be8d2d31/8f42833a-0a0e-4198-a7cf-e79133593615/4767bbe8-ea52-4258-9417-d866fb33fb53) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:51:37.876699 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-279f1737-bd68-4ac9-8011-bf3a183b3737 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:37.894805 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8c068392-c900-4df7-a336-5dc990bc0709 req-396b6e94-8a2a-479c-b497-1698e7dd9d8b tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/quotas/eeb1cb4c2b3844da903a64e77a350dab HTTP/1.1" status: 200 len: 375 time: 0.0612285 Nov 02 12:51:37.979867 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8c068392-c900-4df7-a336-5dc990bc0709 req-b043d5c8-0e7e-4892-833a-afee532b7059 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?tenant_id=eeb1cb4c2b3844da903a64e77a350dab&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0692101 Nov 02 12:51:38.078795 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-29179fe8-5187-438c-b88e-8210a4169ef4 admin admin] Router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 is scheduled to L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc with binding_index 1 {{(pid=108543) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 02 12:51:38.121304 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Pushing event updated for resources: {'Port': ['ID=135dfe61-cf29-438c-a3e1-47697452f814,revision_number=3']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:38.221841 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-279f1737-bd68-4ac9-8011-bf3a183b3737 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:38.302362 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f75ad397-3aeb-45e9-9a44-2270c134e151 req-8d3e4965-e550-4004-bc75-907eed0608ea tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5729043 Nov 02 12:51:38.415318 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-279f1737-bd68-4ac9-8011-bf3a183b3737 admin admin] Network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:51:38.430665 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-279f1737-bd68-4ac9-8011-bf3a183b3737 admin admin] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:51:38.461908 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [None req-279f1737-bd68-4ac9-8011-bf3a183b3737 admin admin] Received port after_create {{(pid=108542) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:51:38.546079 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'name': 'tempest-TestShelveInstance-1902419255-router', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:17Z', 'updated_at': '2021-11-02T12:51:26Z', 'revision_number': 4, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'gw_port': {'id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b1:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 365, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:19Z', 'updated_at': '2021-11-02T12:51:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '0201d689-2e60-4ec9-800a-0897da7fce09', 'name': '', 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'mac_address': 'fa:16:3e:34:99:55', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '9a20b259-01c2-4b3f-8f92-0797a18ff7f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:24Z', 'updated_at': '2021-11-02T12:51:34Z', 'revision_number': 4, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'subnets': [{'id': '9a20b259-01c2-4b3f-8f92-0797a18ff7f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:38.688496 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a1d6c99-906e-407d-a4ba-bce7040852be None None] The sync data for ids ['10f9b13b-6fcd-41e4-937a-5876beb694b1'] in dv-cinder-816324-1-iscsi is: [{'id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'name': 'tempest-TestShelveInstance-1902419255-router', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:17Z', 'updated_at': '2021-11-02T12:51:26Z', 'revision_number': 4, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'gw_port': {'id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b1:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 365, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:19Z', 'updated_at': '2021-11-02T12:51:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '0201d689-2e60-4ec9-800a-0897da7fce09', 'name': '', 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'mac_address': 'fa:16:3e:34:99:55', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '9a20b259-01c2-4b3f-8f92-0797a18ff7f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:24Z', 'updated_at': '2021-11-02T12:51:34Z', 'revision_number': 4, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'subnets': [{'id': '9a20b259-01c2-4b3f-8f92-0797a18ff7f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:51:38.935532 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.db_base_plugin_common [None req-81c9436a-a8f6-4a0a-8159-5861f33851d2 None None] Allocated IP 172.20.0.2 (caeed602-a9f7-4485-9f47-7818b602d82c/981d49eb-4000-4cb3-981b-174f2c0b159a/57760200-5fe9-4008-b7e8-6f2b065c140b) {{(pid=108544) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:51:38.993800 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 135dfe61-cf29-438c-a3e1-47697452f814 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:51:39.154505 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-279f1737-bd68-4ac9-8011-bf3a183b3737 admin admin] Pushing event updated for resources: {'Port': ['ID=22dd88eb-dc23-4b7d-a289-a316ccafbbe0,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:39.224086 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c31bc7e4-e086-49e5-834e-56d27343658f None None] Pushing event updated for resources: {'Port': ['ID=0201d689-2e60-4ec9-800a-0897da7fce09,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:39.370998 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-849dd09a-53d7-4cb0-b36a-b1a029e5fa7e None None] Provisioning complete for port 135dfe61-cf29-438c-a3e1-47697452f814 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:39.372821 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-849dd09a-53d7-4cb0-b36a-b1a029e5fa7e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:39.478194 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 135dfe61-cf29-438c-a3e1-47697452f814 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:39.480253 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:39.644127 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ca9ec101-e576-4a33-aa9a-c4b6f96f0d42 req-b40a0ced-7586-4b75-be15-2e074c5f402f tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.98 "GET /v2.0/ports?device_id=8b94e21b-3dc3-4565-a6b9-bd394a3d15ee HTTP/1.1" status: 200 len: 210 time: 0.5640945 Nov 02 12:51:39.649685 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8c068392-c900-4df7-a336-5dc990bc0709 req-8fe7984f-af61-4a48-9a2f-a419feeda8b9 service neutron] 10.222.0.98 "GET /v2.0/networks/cf53051c-17aa-4d08-a264-6c6ed50a7a96?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.6395707 Nov 02 12:51:39.746090 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-279f1737-bd68-4ac9-8011-bf3a183b3737 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:40.160474 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-81c9436a-a8f6-4a0a-8159-5861f33851d2 None None] Publish callbacks [] for port, precommit_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:40.416219 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-279f1737-bd68-4ac9-8011-bf3a183b3737 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1593163', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1595034'] for router, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:40.426883 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-81c9436a-a8f6-4a0a-8159-5861f33851d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669'] for port, after_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:40.585188 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-81c9436a-a8f6-4a0a-8159-5861f33851d2 None None] Network caeed602-a9f7-4485-9f47-7818b602d82c is already hosted by enough agents. {{(pid=108544) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:51:40.617814 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-aeadb98d-49f4-4f26-8b38-7981c2025d01 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:40.637371 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.scheduler.base_scheduler [None req-81c9436a-a8f6-4a0a-8159-5861f33851d2 None None] Resources bound (agent type, host, resource id): {{(pid=108544) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:51:40.644954 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-81c9436a-a8f6-4a0a-8159-5861f33851d2 None None] Received port after_create {{(pid=108544) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:51:40.666573 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-bdea3386-4131-4617-8f61-6a49a28d9f43 None None] Provisioning complete for port 135dfe61-cf29-438c-a3e1-47697452f814 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:40.667023 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-bdea3386-4131-4617-8f61-6a49a28d9f43 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:40.681195 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81c9436a-a8f6-4a0a-8159-5861f33851d2 None None] Pushing event updated for resources: {'Port': ['ID=57760200-5fe9-4008-b7e8-6f2b065c140b,revision_number=1']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:40.913013 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 0201d689-2e60-4ec9-800a-0897da7fce09 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:51:40.936026 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-279f1737-bd68-4ac9-8011-bf3a183b3737 admin admin] Router a72e5e28-7ed6-44ee-a885-44b7d3fc15a7 is scheduled to L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc with binding_index 1 {{(pid=108542) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 02 12:51:40.988962 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8c068392-c900-4df7-a336-5dc990bc0709 req-f89e348b-fb15-4808-9336-0c11d481b940 service neutron] 10.222.0.98 "GET /v2.0/networks/cf53051c-17aa-4d08-a264-6c6ed50a7a96?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 1.1332374 Nov 02 12:51:41.175655 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-70edbf67-b7f1-4fc6-94b1-fa9ff6c6ff3c req-b2913a9e-3bdc-415b-9b73-b869bf1382b5 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=0d21bc42-7392-483d-b042-8c4ffea9a7f2 HTTP/1.1" status: 200 len: 210 time: 0.5964847 Nov 02 12:51:41.222195 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-29179fe8-5187-438c-b88e-8210a4169ef4 admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108543) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:51:41.243347 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] Sync routers for ids ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'] in dv-cinder-816324-1-iscsi {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:51:41.256533 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-aeadb98d-49f4-4f26-8b38-7981c2025d01 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:41.268944 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-81c9436a-a8f6-4a0a-8159-5861f33851d2 None None] Attempting to bind port 57760200-5fe9-4008-b7e8-6f2b065c140b on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:51:41.270109 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-81c9436a-a8f6-4a0a-8159-5861f33851d2 None None] Attempting to bind port 57760200-5fe9-4008-b7e8-6f2b065c140b by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': 'b7dd916f-2223-4397-bf62-f54ca54f5493', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': 'caeed602-a9f7-4485-9f47-7818b602d82c'}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:51:41.273796 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-81c9436a-a8f6-4a0a-8159-5861f33851d2 None None] Attempting to bind port 57760200-5fe9-4008-b7e8-6f2b065c140b on network caeed602-a9f7-4485-9f47-7818b602d82c {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:51:41.284464 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['4c597805-3835-4f59-b320-5614de6b4ec6'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:51:41.301888 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] Routers {'2a2f63fd-e512-4ad2-9007-46e6ab6e8134'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:51:41.306248 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:51:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:41.424724 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-81c9436a-a8f6-4a0a-8159-5861f33851d2 None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 51, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:51:41.425309 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-81c9436a-a8f6-4a0a-8159-5861f33851d2 None None] Checking segment: {'id': 'b7dd916f-2223-4397-bf62-f54ca54f5493', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': 'caeed602-a9f7-4485-9f47-7818b602d82c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108544) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:51:41.425580 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-81c9436a-a8f6-4a0a-8159-5861f33851d2 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:41.425912 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-81c9436a-a8f6-4a0a-8159-5861f33851d2 None None] Bound using segment: {'id': 'b7dd916f-2223-4397-bf62-f54ca54f5493', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': 'caeed602-a9f7-4485-9f47-7818b602d82c'} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:51:41.426535 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-81c9436a-a8f6-4a0a-8159-5861f33851d2 None None] Bound port: 57760200-5fe9-4008-b7e8-6f2b065c140b, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b7dd916f-2223-4397-bf62-f54ca54f5493', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': 'caeed602-a9f7-4485-9f47-7818b602d82c'}}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:51:41.426988 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-81c9436a-a8f6-4a0a-8159-5861f33851d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:41.674039 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-29179fe8-5187-438c-b88e-8210a4169ef4 admin admin] Publish callbacks [] for router, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:41.681281 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-29179fe8-5187-438c-b88e-8210a4169ef4 admin admin] 10.222.0.98 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 12.9672427 Nov 02 12:51:41.697706 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 58262) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:41.782640 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-d6886170-c3c8-4e50-860f-497a0525ecdf tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.90 "GET /v2.0/networks?tenant_id=f8553176e5c84edb8b82d01321b30b1c&shared=False HTTP/1.1" status: 200 len: 213 time: 0.0696225 Nov 02 12:51:41.885581 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-aeadb98d-49f4-4f26-8b38-7981c2025d01 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Network bfe7dfe3-4b23-4454-b60a-4955be8d2d31 is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:51:41.954715 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-aeadb98d-49f4-4f26-8b38-7981c2025d01 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:51:41.962303 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aeadb98d-49f4-4f26-8b38-7981c2025d01 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Pushing event updated for resources: {'Port': ['ID=4767bbe8-ea52-4258-9417-d866fb33fb53,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:41.975348 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-aeadb98d-49f4-4f26-8b38-7981c2025d01 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:51:42.051834 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 0201d689-2e60-4ec9-800a-0897da7fce09 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:42.052394 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:42.174511 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-81c9436a-a8f6-4a0a-8159-5861f33851d2 None None] For port 57760200-5fe9-4008-b7e8-6f2b065c140b, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108544) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:51:42.231796 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-aeadb98d-49f4-4f26-8b38-7981c2025d01 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:42.232881 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-aeadb98d-49f4-4f26-8b38-7981c2025d01 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:42.252953 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-81c9436a-a8f6-4a0a-8159-5861f33851d2 None None] For port 57760200-5fe9-4008-b7e8-6f2b065c140b, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=57760200-5fe9-4008-b7e8-6f2b065c140b,segment=NetworkSegment(b7dd916f-2223-4397-bf62-f54ca54f5493),segment_id=b7dd916f-2223-4397-bf62-f54ca54f5493)] {{(pid=108544) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:51:42.341013 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9ca9364-2058-468e-b6a9-4a9fae191528 req-bcabc46c-b10b-45f9-9089-9b6e421b82c7 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:42.346276 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f9ca9364-2058-468e-b6a9-4a9fae191528 req-bcabc46c-b10b-45f9-9089-9b6e421b82c7 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.8767490 Nov 02 12:51:42.353231 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-2d02baf7-99c7-4276-aa41-665fbee1c030 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:42.360316 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-2d02baf7-99c7-4276-aa41-665fbee1c030 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 769 time: 0.5598776 Nov 02 12:51:42.370214 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-81c9436a-a8f6-4a0a-8159-5861f33851d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:42.386589 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-16929b66-c60d-47bb-b5c3-5da0e9ac3484 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Request body: {'port': {'device_id': '8b94e21b-3dc3-4565-a6b9-bd394a3d15ee', 'network_id': '41ba5328-8dc5-4a66-a20d-744b82293eda', 'admin_state_up': True, 'tenant_id': 'f8553176e5c84edb8b82d01321b30b1c'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:51:42.459230 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] Set router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:51:42.639544 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-279f1737-bd68-4ac9-8011-bf3a183b3737 admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108542) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:51:42.680295 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-aeadb98d-49f4-4f26-8b38-7981c2025d01 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 7.4444737 Nov 02 12:51:42.726789 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] Sync routers for ids ['a72e5e28-7ed6-44ee-a885-44b7d3fc15a7'] in dv-cinder-816324-1-iscsi {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:51:42.741219 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-d93a02da-72d0-4255-8a1c-996a6fab6282 service neutron] Request body: {'port': {'device_id': '0d21bc42-7392-483d-b042-8c4ffea9a7f2', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81632'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:51:42.811365 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81c9436a-a8f6-4a0a-8159-5861f33851d2 None None] Pushing event updated for resources: {'Port': ['ID=57760200-5fe9-4008-b7e8-6f2b065c140b,revision_number=2']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:42.847941 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-279f1737-bd68-4ac9-8011-bf3a183b3737 admin admin] Publish callbacks [] for router, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:42.855728 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-279f1737-bd68-4ac9-8011-bf3a183b3737 admin admin] 10.222.0.98 "POST /v2.0/routers HTTP/1.1" status: 201 len: 920 time: 7.6553004 Nov 02 12:51:42.861504 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58284) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:43.181187 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] Routers {'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:51:43.191071 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:51:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['a72e5e28-7ed6-44ee-a885-44b7d3fc15a7'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:43.545958 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-16929b66-c60d-47bb-b5c3-5da0e9ac3484 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Made reservation on behalf of f8553176e5c84edb8b82d01321b30b1c for: {'port': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:51:43.552907 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-16929b66-c60d-47bb-b5c3-5da0e9ac3484 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:43.572230 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f9ca9364-2058-468e-b6a9-4a9fae191528 req-e96c9bdc-45a5-4a97-8618-ff07adf8934b tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 1.1705804 Nov 02 12:51:43.573309 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-d93a02da-72d0-4255-8a1c-996a6fab6282 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:43.634006 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-16929b66-c60d-47bb-b5c3-5da0e9ac3484 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:43.634745 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 57760200-5fe9-4008-b7e8-6f2b065c140b up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:51:43.663466 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T12:51:33Z', 'revision_number': 3, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port': {'id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:1f:c3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:31Z', 'updated_at': '2021-11-02T12:51:32Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:43.726276 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] Checking router: 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 for host: dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:51:43.726737 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] Updating router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 port c81df0e3-6336-4caa-8387-60c3321fe152 binding host dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 02 12:51:43.786930 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:43.859898 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-42bbcad6-33d3-4cae-b6d5-dea3190bca1b req-ef54808e-95e6-4785-8cdd-73c1a684c500 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.98 "GET /v2.0/ports?device_id=8b94e21b-3dc3-4565-a6b9-bd394a3d15ee HTTP/1.1" status: 200 len: 210 time: 0.3582878 Nov 02 12:51:43.922054 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] Set router a72e5e28-7ed6-44ee-a885-44b7d3fc15a7 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:51:44.070971 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99670f5b-5306-4584-9f12-51c810ec8889 req-06b20e87-9272-42c3-8e35-148c86a02b1c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:44.072868 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-99670f5b-5306-4584-9f12-51c810ec8889 req-06b20e87-9272-42c3-8e35-148c86a02b1c service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=28a90b1659054909ab64ba5320160f74&device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 1099 time: 0.9804173 Nov 02 12:51:44.088571 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b114f8e6-c291-46a7-80c2-bbc7d09a8feb req-96d6ba13-c20c-4fe4-8aa1-a83f6c994b96 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=78f23d67-5bb3-42d7-b7ea-79c832aab569 HTTP/1.1" status: 200 len: 210 time: 0.3254774 Nov 02 12:51:44.447635 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-16929b66-c60d-47bb-b5c3-5da0e9ac3484 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:44.725131 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 57760200-5fe9-4008-b7e8-6f2b065c140b triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:44.725787 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:44.807669 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99670f5b-5306-4584-9f12-51c810ec8889 req-a1be3e5c-db93-41b4-901b-3d676389ae8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:44.810029 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-99670f5b-5306-4584-9f12-51c810ec8889 req-a1be3e5c-db93-41b4-901b-3d676389ae8e service neutron] 10.222.0.90 "GET /v2.0/networks?id=c965eaf1-5fb6-4689-8b12-fa3913e4f081 HTTP/1.1" status: 200 len: 920 time: 0.6741734 Nov 02 12:51:44.874787 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7', 'name': 'tempest-TestShelveInstance-685743967-router', 'tenant_id': '8207b92ade05471e96c3fb2b69070dc9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.246'}], 'enable_snat': True}, 'gw_port_id': '22dd88eb-dc23-4b7d-a289-a316ccafbbe0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:35Z', 'updated_at': '2021-11-02T12:51:39Z', 'revision_number': 3, 'project_id': '8207b92ade05471e96c3fb2b69070dc9', 'gw_port': {'id': '22dd88eb-dc23-4b7d-a289-a316ccafbbe0', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:79:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 407, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:37Z', 'updated_at': '2021-11-02T12:51:37Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:44.964839 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-99670f5b-5306-4584-9f12-51c810ec8889 req-2e1f21c1-9269-4912-84b8-0affa41cddf4 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d32b527e-e041-40dd-b3b1-a7c080a56c87 HTTP/1.1" status: 200 len: 217 time: 0.1315022 Nov 02 12:51:44.997240 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] Publish callbacks [] for port, precommit_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:44.997902 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] Checking router: a72e5e28-7ed6-44ee-a885-44b7d3fc15a7 for host: dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:51:44.997902 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] Updating router a72e5e28-7ed6-44ee-a885-44b7d3fc15a7 port 22dd88eb-dc23-4b7d-a289-a316ccafbbe0 binding host dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 02 12:51:45.055442 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-16929b66-c60d-47bb-b5c3-5da0e9ac3484 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:45.100439 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:45.109995 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99670f5b-5306-4584-9f12-51c810ec8889 req-cb883d25-3504-46d6-aa52-546165b0e937 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:45.113237 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-99670f5b-5306-4584-9f12-51c810ec8889 req-cb883d25-3504-46d6-aa52-546165b0e937 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=b29075d9-9995-4f6f-8ebd-8f7d748977ef HTTP/1.1" status: 200 len: 859 time: 0.1130772 Nov 02 12:51:45.241127 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] Attempting to bind port c81df0e3-6336-4caa-8387-60c3321fe152 on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:51:45.241939 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] Attempting to bind port c81df0e3-6336-4caa-8387-60c3321fe152 by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}] {{(pid=108545) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:51:45.242832 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] Attempting to bind port c81df0e3-6336-4caa-8387-60c3321fe152 on network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:51:45.252497 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_common [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-16929b66-c60d-47bb-b5c3-5da0e9ac3484 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Allocated IP 192.168.233.219 (41ba5328-8dc5-4a66-a20d-744b82293eda/842a3ec7-e9a3-40a5-b477-63472d7a5707/8037c526-562d-44b7-8677-fa21b26add41) {{(pid=108542) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:51:45.260480 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 51, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:51:45.261425 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] Checking segment: {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108545) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:51:45.262437 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:45.263262 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] Bound using segment: {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'} {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:51:45.265784 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] Bound port: c81df0e3-6336-4caa-8387-60c3321fe152, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}}] {{(pid=108545) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:51:45.267316 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:45.275572 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-be34dd83-1bdd-47b3-866c-a8092f30230b req-66d2c7c3-05cc-4128-a6b1-f98be2d62e7d tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:45.294280 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-be34dd83-1bdd-47b3-866c-a8092f30230b req-66d2c7c3-05cc-4128-a6b1-f98be2d62e7d tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=0d21bc42-7392-483d-b042-8c4ffea9a7f2 HTTP/1.1" status: 200 len: 931 time: 1.2334745 Nov 02 12:51:45.420677 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e74f0b06-6716-4d6f-a569-747b86802c6e None None] Pushing event updated for resources: {'Port': ['ID=c81df0e3-6336-4caa-8387-60c3321fe152,revision_number=2']} {{(pid=108545) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:45.427645 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-8dd8b2fd-c0d6-4062-ba13-6805d1803094 None None] Network caeed602-a9f7-4485-9f47-7818b602d82c requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:51:45.435756 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:45.449158 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.db [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] For port c81df0e3-6336-4caa-8387-60c3321fe152, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108545) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:51:45.458606 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.db [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] For port c81df0e3-6336-4caa-8387-60c3321fe152, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=c81df0e3-6336-4caa-8387-60c3321fe152,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108545) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:51:45.548020 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-16929b66-c60d-47bb-b5c3-5da0e9ac3484 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Publish callbacks [] for port, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:45.557485 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:45.583684 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:45.711885 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-d93a02da-72d0-4255-8a1c-996a6fab6282 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4767bbe8-ea52-4258-9417-d866fb33fb53 {{(pid=108543) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:51:45.735586 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-d93a02da-72d0-4255-8a1c-996a6fab6282 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:45.747373 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16929b66-c60d-47bb-b5c3-5da0e9ac3484 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Pushing event updated for resources: {'SecurityGroup': ['ID=e08e9b2e-bc35-40ca-a7bb-1d6bfbdd9ad3,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:45.772612 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.provisioning_blocks [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-d93a02da-72d0-4255-8a1c-996a6fab6282 service neutron] Transition to ACTIVE for port object 4767bbe8-ea52-4258-9417-d866fb33fb53 will not be triggered until provisioned by entity L2. {{(pid=108543) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 02 12:51:45.813849 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] Routers {'2a2f63fd-e512-4ad2-9007-46e6ab6e8134'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:51:45.813849 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:51:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:45.875900 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-99670f5b-5306-4584-9f12-51c810ec8889 req-6e603fae-7d3b-4473-afcc-1e583bc0048f service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=c965eaf1-5fb6-4689-8b12-fa3913e4f081&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.7101753 Nov 02 12:51:45.881421 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.90', 58693) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:45.883875 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-85a3d3cb-98c4-4afb-884a-ed82911cc634 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:45.926826 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-16929b66-c60d-47bb-b5c3-5da0e9ac3484 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:45.995743 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-d93a02da-72d0-4255-8a1c-996a6fab6282 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:46.135704 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e74f0b06-6716-4d6f-a569-747b86802c6e None None] Pushing event updated for resources: {'Port': ['ID=c81df0e3-6336-4caa-8387-60c3321fe152,revision_number=3']} {{(pid=108545) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:46.181648 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] Publish callbacks [] for port, precommit_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:46.200906 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-30f7586a-8c8b-4bb9-a012-75ef6226a783 None None] Provisioning complete for port 57760200-5fe9-4008-b7e8-6f2b065c140b triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:46.202497 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-30f7586a-8c8b-4bb9-a012-75ef6226a783 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:46.263829 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-16929b66-c60d-47bb-b5c3-5da0e9ac3484 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Network 41ba5328-8dc5-4a66-a20d-744b82293eda is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:51:46.280663 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-16929b66-c60d-47bb-b5c3-5da0e9ac3484 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:51:46.284447 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d93a02da-72d0-4255-8a1c-996a6fab6282 service neutron] Pushing event updated for resources: {'Port': ['ID=4767bbe8-ea52-4258-9417-d866fb33fb53,revision_number=2']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:46.291985 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] For port 57760200-5fe9-4008-b7e8-6f2b065c140b, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=57760200-5fe9-4008-b7e8-6f2b065c140b,segment=NetworkSegment(b7dd916f-2223-4397-bf62-f54ca54f5493),segment_id=b7dd916f-2223-4397-bf62-f54ca54f5493)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:51:46.301404 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5ade59fc-a720-4c9a-88d6-bfda06f33e8f req-9be6c7ff-12b5-44e7-90a1-7ed7c83b4ee3 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:46.303897 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5ade59fc-a720-4c9a-88d6-bfda06f33e8f req-9be6c7ff-12b5-44e7-90a1-7ed7c83b4ee3 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 1.4981146 Nov 02 12:51:46.316610 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-16929b66-c60d-47bb-b5c3-5da0e9ac3484 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Received port after_create {{(pid=108542) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:51:46.328960 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-16929b66-c60d-47bb-b5c3-5da0e9ac3484 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Pushing event updated for resources: {'Port': ['ID=8037c526-562d-44b7-8677-fa21b26add41,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:46.382854 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] Set router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:51:46.383213 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-be34dd83-1bdd-47b3-866c-a8092f30230b req-ffaa7698-5855-4884-aecf-d13b824fb643 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.0783677 Nov 02 12:51:46.459898 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:46.473731 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:46.479067 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-30f7586a-8c8b-4bb9-a012-75ef6226a783 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:46.629617 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-16929b66-c60d-47bb-b5c3-5da0e9ac3484 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:46.631216 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-16929b66-c60d-47bb-b5c3-5da0e9ac3484 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for port, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:46.767230 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-16929b66-c60d-47bb-b5c3-5da0e9ac3484 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201 len: 938 time: 4.3929098 Nov 02 12:51:46.786315 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-07ebc04b-ed79-4a60-9b18-eb994a507804 service neutron] Request body: {'port': {'device_id': '8b94e21b-3dc3-4565-a6b9-bd394a3d15ee', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81632'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:51:46.890704 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Pushing event updated for resources: {'Port': ['ID=57760200-5fe9-4008-b7e8-6f2b065c140b,revision_number=3']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:46.902636 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d9725eb-3c30-4256-906a-803e24c2d6fc req-5c1b7766-f0d3-44d3-abc4-7fdfb60ee7c1 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:46.905523 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_common [None req-85a3d3cb-98c4-4afb-884a-ed82911cc634 admin admin] Allocated IP 172.20.0.1 (caeed602-a9f7-4485-9f47-7818b602d82c/981d49eb-4000-4cb3-981b-174f2c0b159a/8cecf398-cb8a-44a0-8ac5-4fb0469dd771) {{(pid=108542) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:51:46.916389 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7d9725eb-3c30-4256-906a-803e24c2d6fc req-5c1b7766-f0d3-44d3-abc4-7fdfb60ee7c1 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.3435428 Nov 02 12:51:46.933378 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] Attempting to bind port 22dd88eb-dc23-4b7d-a289-a316ccafbbe0 on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:51:46.937085 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] Attempting to bind port 22dd88eb-dc23-4b7d-a289-a316ccafbbe0 by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:51:46.937085 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] Attempting to bind port 22dd88eb-dc23-4b7d-a289-a316ccafbbe0 on network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:51:46.991157 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-d93a02da-72d0-4255-8a1c-996a6fab6282 service neutron] Attempting to bind port 4767bbe8-ea52-4258-9417-d866fb33fb53 on host hv-cinder-81632 for vnic_type normal with profile {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:51:46.991496 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-d93a02da-72d0-4255-8a1c-996a6fab6282 service neutron] Attempting to bind port 4767bbe8-ea52-4258-9417-d866fb33fb53 by drivers openvswitch,hyperv on host hv-cinder-81632 at level 0 using segments [{'id': 'e912b2b1-808c-4d37-a99d-fcfdb9d2a5db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31'}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:51:46.991875 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-d93a02da-72d0-4255-8a1c-996a6fab6282 service neutron] Attempting to bind port 4767bbe8-ea52-4258-9417-d866fb33fb53 on network bfe7dfe3-4b23-4454-b60a-4955be8d2d31 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:51:47.000094 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0740778a-4dca-46eb-9d98-d8d34b6099e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:47.008419 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-07ebc04b-ed79-4a60-9b18-eb994a507804 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:47.012226 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-d93a02da-72d0-4255-8a1c-996a6fab6282 service neutron] Port 4767bbe8-ea52-4258-9417-d866fb33fb53 on network bfe7dfe3-4b23-4454-b60a-4955be8d2d31 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81632 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 02 12:51:47.012709 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-d93a02da-72d0-4255-8a1c-996a6fab6282 service neutron] Attempting to bind port 4767bbe8-ea52-4258-9417-d866fb33fb53 on network bfe7dfe3-4b23-4454-b60a-4955be8d2d31 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:51:47.019197 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-99670f5b-5306-4584-9f12-51c810ec8889 req-19e422af-d144-48b6-84ad-7e5b257e9f7c service neutron] 10.222.0.90 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=segments HTTP/1.1" status: 200 len: 212 time: 1.1048522 Nov 02 12:51:47.033527 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5ade59fc-a720-4c9a-88d6-bfda06f33e8f req-f28c1db5-3828-45fd-9063-1083f5687a37 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6795309 Nov 02 12:51:47.045167 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c068392-c900-4df7-a336-5dc990bc0709 req-c53ccacb-7780-459c-801b-cb77d88d3099 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:47.047566 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 51, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:51:47.047920 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8c068392-c900-4df7-a336-5dc990bc0709 req-c53ccacb-7780-459c-801b-cb77d88d3099 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.90 "GET /v2.0/networks?id=cf53051c-17aa-4d08-a264-6c6ed50a7a96 HTTP/1.1" status: 200 len: 809 time: 1.1495781 Nov 02 12:51:47.048081 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] Checking segment: {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108544) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:51:47.048515 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:47.049042 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] Bound using segment: {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:51:47.050098 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] Bound port: 22dd88eb-dc23-4b7d-a289-a316ccafbbe0, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:51:47.051102 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:47.068310 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.db.api [None req-30f7586a-8c8b-4bb9-a012-75ef6226a783 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=108544) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 02 12:51:47.069960 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG oslo_db.api [None req-30f7586a-8c8b-4bb9-a012-75ef6226a783 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 02 12:51:47.147068 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c090be43-24cd-4a5c-af09-473336400880 None None] Pushing event updated for resources: {'Port': ['ID=22dd88eb-dc23-4b7d-a289-a316ccafbbe0,revision_number=2']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:47.151116 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-8c068392-c900-4df7-a336-5dc990bc0709 req-2dd0ba44-19e8-471b-9332-ceb520d725ce tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Request body: {'port': {'device_id': '78f23d67-5bb3-42d7-b7ea-79c832aab569', 'network_id': 'cf53051c-17aa-4d08-a264-6c6ed50a7a96', 'admin_state_up': True, 'tenant_id': 'eeb1cb4c2b3844da903a64e77a350dab'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:51:47.157163 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-d93a02da-72d0-4255-8a1c-996a6fab6282 service neutron] Checking agent: {'id': '0d57fa42-4660-4f08-b7dc-53a872c3c01c', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81632', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'started_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 51, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:51:47.157702 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-d93a02da-72d0-4255-8a1c-996a6fab6282 service neutron] Checking segment: {'id': 'e912b2b1-808c-4d37-a99d-fcfdb9d2a5db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108543) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:51:47.158546 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-d93a02da-72d0-4255-8a1c-996a6fab6282 service neutron] Bound using segment: {'id': 'e912b2b1-808c-4d37-a99d-fcfdb9d2a5db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31'} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:51:47.159166 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-d93a02da-72d0-4255-8a1c-996a6fab6282 service neutron] Bound port: 4767bbe8-ea52-4258-9417-d866fb33fb53, host: hv-cinder-81632, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e912b2b1-808c-4d37-a99d-fcfdb9d2a5db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31'}}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:51:47.159857 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-d93a02da-72d0-4255-8a1c-996a6fab6282 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:47.185030 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T12:51:33Z', 'revision_number': 3, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port': {'id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:1f:c3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:31Z', 'updated_at': '2021-11-02T12:51:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:47.206326 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] For port 22dd88eb-dc23-4b7d-a289-a316ccafbbe0, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108544) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:51:47.218007 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] For port 22dd88eb-dc23-4b7d-a289-a316ccafbbe0, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=22dd88eb-dc23-4b7d-a289-a316ccafbbe0,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108544) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:51:47.317360 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:47.341744 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-85a3d3cb-98c4-4afb-884a-ed82911cc634 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:47.470502 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a401f59-b665-43c8-b25c-386b8a6c94b7 None None] The sync data for ids ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'] in dv-cinder-816324-1-iscsi is: [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T12:51:33Z', 'revision_number': 3, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port': {'id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:1f:c3', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:31Z', 'updated_at': '2021-11-02T12:51:45Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}] {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:51:47.782773 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c090be43-24cd-4a5c-af09-473336400880 None None] Pushing event updated for resources: {'Port': ['ID=22dd88eb-dc23-4b7d-a289-a316ccafbbe0,revision_number=3']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:47.795554 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.notifiers.nova [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-07ebc04b-ed79-4a60-9b18-eb994a507804 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8037c526-562d-44b7-8677-fa21b26add41 {{(pid=108542) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:51:47.806233 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-07ebc04b-ed79-4a60-9b18-eb994a507804 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:47.831319 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.provisioning_blocks [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-07ebc04b-ed79-4a60-9b18-eb994a507804 service neutron] Transition to ACTIVE for port object 8037c526-562d-44b7-8677-fa21b26add41 will not be triggered until provisioned by entity L2. {{(pid=108542) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 02 12:51:47.834152 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-85a3d3cb-98c4-4afb-884a-ed82911cc634 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:47.894624 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] Routers {'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:51:47.896601 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:51:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['a72e5e28-7ed6-44ee-a885-44b7d3fc15a7'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:47.901343 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85a3d3cb-98c4-4afb-884a-ed82911cc634 admin admin] Network caeed602-a9f7-4485-9f47-7818b602d82c is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:51:47.906236 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-85a3d3cb-98c4-4afb-884a-ed82911cc634 admin admin] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:51:47.922221 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [None req-85a3d3cb-98c4-4afb-884a-ed82911cc634 admin admin] Received port after_create {{(pid=108542) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:51:48.007002 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-85a3d3cb-98c4-4afb-884a-ed82911cc634 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1590217'] for router_interface, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:48.013599 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-07ebc04b-ed79-4a60-9b18-eb994a507804 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126476609'] for port, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:48.172805 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85a3d3cb-98c4-4afb-884a-ed82911cc634 admin admin] Pushing event updated for resources: {'Port': ['ID=8cecf398-cb8a-44a0-8ac5-4fb0469dd771,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:48.350830 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-b8c2c108-8ca2-4992-b919-5623d9eb86fa None None] Provisioning complete for port 57760200-5fe9-4008-b7e8-6f2b065c140b triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:48.351688 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-b8c2c108-8ca2-4992-b919-5623d9eb86fa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:48.547796 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7d9725eb-3c30-4256-906a-803e24c2d6fc req-7eab79a9-37d9-4e3d-aba0-094db6d20107 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 1.6301591 Nov 02 12:51:48.698825 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] Set router a72e5e28-7ed6-44ee-a885-44b7d3fc15a7 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:51:48.822836 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07ebc04b-ed79-4a60-9b18-eb994a507804 service neutron] Pushing event updated for resources: {'Port': ['ID=8037c526-562d-44b7-8677-fa21b26add41,revision_number=2']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:48.940046 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.managers [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-07ebc04b-ed79-4a60-9b18-eb994a507804 service neutron] Attempting to bind port 8037c526-562d-44b7-8677-fa21b26add41 on host hv-cinder-81632 for vnic_type normal with profile {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:51:48.940688 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.managers [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-07ebc04b-ed79-4a60-9b18-eb994a507804 service neutron] Attempting to bind port 8037c526-562d-44b7-8677-fa21b26add41 by drivers openvswitch,hyperv on host hv-cinder-81632 at level 0 using segments [{'id': '914624d2-b577-476c-8aac-4af5f5930ab2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '41ba5328-8dc5-4a66-a20d-744b82293eda'}] {{(pid=108542) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:51:48.941593 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-07ebc04b-ed79-4a60-9b18-eb994a507804 service neutron] Attempting to bind port 8037c526-562d-44b7-8677-fa21b26add41 on network 41ba5328-8dc5-4a66-a20d-744b82293eda {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:51:48.960339 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-07ebc04b-ed79-4a60-9b18-eb994a507804 service neutron] Port 8037c526-562d-44b7-8677-fa21b26add41 on network 41ba5328-8dc5-4a66-a20d-744b82293eda not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81632 {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 02 12:51:48.961683 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-07ebc04b-ed79-4a60-9b18-eb994a507804 service neutron] Attempting to bind port 8037c526-562d-44b7-8677-fa21b26add41 on network 41ba5328-8dc5-4a66-a20d-744b82293eda {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:51:48.980129 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-07ebc04b-ed79-4a60-9b18-eb994a507804 service neutron] Checking agent: {'id': '0d57fa42-4660-4f08-b7dc-53a872c3c01c', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81632', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'started_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 51, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:51:48.980129 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-07ebc04b-ed79-4a60-9b18-eb994a507804 service neutron] Checking segment: {'id': '914624d2-b577-476c-8aac-4af5f5930ab2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '41ba5328-8dc5-4a66-a20d-744b82293eda'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108542) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:51:48.981433 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-07ebc04b-ed79-4a60-9b18-eb994a507804 service neutron] Bound using segment: {'id': '914624d2-b577-476c-8aac-4af5f5930ab2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '41ba5328-8dc5-4a66-a20d-744b82293eda'} {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:51:48.982282 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.managers [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-07ebc04b-ed79-4a60-9b18-eb994a507804 service neutron] Bound port: 8037c526-562d-44b7-8677-fa21b26add41, host: hv-cinder-81632, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '914624d2-b577-476c-8aac-4af5f5930ab2', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 879, 'network_id': '41ba5328-8dc5-4a66-a20d-744b82293eda'}}] {{(pid=108542) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:51:48.982998 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-07ebc04b-ed79-4a60-9b18-eb994a507804 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:48.998652 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d7b7218c-9671-46a0-92cb-5d91771d30d8 req-ab809222-1e37-46af-a959-00af159a6c09 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=78f23d67-5bb3-42d7-b7ea-79c832aab569 HTTP/1.1" status: 200 len: 210 time: 0.1669149 Nov 02 12:51:49.192478 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 57760200-5fe9-4008-b7e8-6f2b065c140b up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:51:49.203986 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-99670f5b-5306-4584-9f12-51c810ec8889 req-0b672293-5b98-446b-b757-e21fc47771ad service neutron] 10.222.0.90 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 2.1486001 Nov 02 12:51:49.210411 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-d93a02da-72d0-4255-8a1c-996a6fab6282 service neutron] For port 4767bbe8-ea52-4258-9417-d866fb33fb53, host hv-cinder-81632, cleared binding levels {{(pid=108543) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:51:49.270128 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-699255ac-ebe1-4db3-be98-6e05e2e92412 req-6663162c-ad96-4480-9323-0046fd44b224 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:49.276406 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-699255ac-ebe1-4db3-be98-6e05e2e92412 req-6663162c-ad96-4480-9323-0046fd44b224 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.98 "GET /v2.0/ports?device_id=8b94e21b-3dc3-4565-a6b9-bd394a3d15ee HTTP/1.1" status: 200 len: 948 time: 0.9201233 Nov 02 12:51:49.282079 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-07ebc04b-ed79-4a60-9b18-eb994a507804 service neutron] For port 8037c526-562d-44b7-8677-fa21b26add41, host hv-cinder-81632, cleared binding levels {{(pid=108542) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:51:49.282758 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-07ebc04b-ed79-4a60-9b18-eb994a507804 service neutron] For port 8037c526-562d-44b7-8677-fa21b26add41, host hv-cinder-81632, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=8037c526-562d-44b7-8677-fa21b26add41,segment=NetworkSegment(914624d2-b577-476c-8aac-4af5f5930ab2),segment_id=914624d2-b577-476c-8aac-4af5f5930ab2)] {{(pid=108542) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:51:49.294884 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-85a3d3cb-98c4-4afb-884a-ed82911cc634 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:49.328090 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-d93a02da-72d0-4255-8a1c-996a6fab6282 service neutron] For port 4767bbe8-ea52-4258-9417-d866fb33fb53, host hv-cinder-81632, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=4767bbe8-ea52-4258-9417-d866fb33fb53,segment=NetworkSegment(e912b2b1-808c-4d37-a99d-fcfdb9d2a5db),segment_id=e912b2b1-808c-4d37-a99d-fcfdb9d2a5db)] {{(pid=108543) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:51:49.503053 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-07ebc04b-ed79-4a60-9b18-eb994a507804 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126476609'] for port, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:49.530939 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-d93a02da-72d0-4255-8a1c-996a6fab6282 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:49.601950 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-699255ac-ebe1-4db3-be98-6e05e2e92412 req-5c8f4295-e8ed-4977-b6a0-04f645e66248 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.98 "GET /v2.0/security-groups?id=e08e9b2e-bc35-40ca-a7bb-1d6bfbdd9ad3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2780046 Nov 02 12:51:49.681501 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-07ebc04b-ed79-4a60-9b18-eb994a507804 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:49.691085 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 57760200-5fe9-4008-b7e8-6f2b065c140b triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:49.691085 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:49.697395 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-07ebc04b-ed79-4a60-9b18-eb994a507804 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for port, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:49.700038 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-07ebc04b-ed79-4a60-9b18-eb994a507804 service neutron] 10.222.0.90 "PUT /v2.0/ports/8037c526-562d-44b7-8677-fa21b26add41 HTTP/1.1" status: 200 len: 1098 time: 2.9168358 Nov 02 12:51:49.700038 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '8b94e21b-3dc3-4565-a6b9-bd394a3d15ee', 'tag': '8037c526-562d-44b7-8677-fa21b26add41'}] {{(pid=108542) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:51:49.707621 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [None req-0740778a-4dca-46eb-9d98-d8d34b6099e1 admin admin] Allocated IP 172.20.0.1 (89f406ae-1b9f-4be7-8881-87075d7c5aa1/ae24c2fe-abba-48cd-9d91-28a628d2ef95/80a55893-6272-4299-8834-e840aa37d37b) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:51:49.710579 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-8c068392-c900-4df7-a336-5dc990bc0709 req-2dd0ba44-19e8-471b-9332-ceb520d725ce tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Made reservation on behalf of eeb1cb4c2b3844da903a64e77a350dab for: {'port': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:51:49.717531 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-8c068392-c900-4df7-a336-5dc990bc0709 req-2dd0ba44-19e8-471b-9332-ceb520d725ce tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:49.732301 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8fdc2194739644bb754d6b187539f80d2eba7dc5c5d5392f1a2d22d03c0a316c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a469a690-5b34-4263-aab6-41b4bd50296a" -d '{"events": [{"name": "network-changed", "server_uuid": "8b94e21b-3dc3-4565-a6b9-bd394a3d15ee", "tag": "8037c526-562d-44b7-8677-fa21b26add41"}]}' {{(pid=108542) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:51:49.744705 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-d93a02da-72d0-4255-8a1c-996a6fab6282 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:49.746347 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-d93a02da-72d0-4255-8a1c-996a6fab6282 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:49.755606 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-d93a02da-72d0-4255-8a1c-996a6fab6282 service neutron] 10.222.0.90 "PUT /v2.0/ports/4767bbe8-ea52-4258-9417-d866fb33fb53 HTTP/1.1" status: 200 len: 1093 time: 7.0435288 Nov 02 12:51:49.798566 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a612a5d7-29e7-41d6-8a8a-06d96bca9b13 req-f1976da4-251e-4f50-9aa4-4365762a4179 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:49.827652 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a612a5d7-29e7-41d6-8a8a-06d96bca9b13 req-f1976da4-251e-4f50-9aa4-4365762a4179 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=0d21bc42-7392-483d-b042-8c4ffea9a7f2 HTTP/1.1" status: 200 len: 943 time: 0.6477571 Nov 02 12:51:49.840913 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '0d21bc42-7392-483d-b042-8c4ffea9a7f2', 'tag': '4767bbe8-ea52-4258-9417-d866fb33fb53'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:51:49.853716 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a34b9d85-18b1-4be0-a6a2-3d706f11489d" -d '{"events": [{"name": "network-changed", "server_uuid": "0d21bc42-7392-483d-b042-8c4ffea9a7f2", "tag": "4767bbe8-ea52-4258-9417-d866fb33fb53"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:51:49.926262 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07ebc04b-ed79-4a60-9b18-eb994a507804 service neutron] Pushing event updated for resources: {'Port': ['ID=8037c526-562d-44b7-8677-fa21b26add41,revision_number=3']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:49.995550 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a612a5d7-29e7-41d6-8a8a-06d96bca9b13 req-d1772a7f-5d73-4383-a08c-710347fa1547 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1298451 Nov 02 12:51:50.033186 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-e3ada172-9d49-4c35-ba1e-505e17ee4e81 None None] Provisioning complete for port 8cecf398-cb8a-44a0-8ac5-4fb0469dd771 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:50.037278 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-e3ada172-9d49-4c35-ba1e-505e17ee4e81 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:50.238201 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d93a02da-72d0-4255-8a1c-996a6fab6282 service neutron] Pushing event updated for resources: {'Port': ['ID=4767bbe8-ea52-4258-9417-d866fb33fb53,revision_number=3']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:50.251806 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-85a3d3cb-98c4-4afb-884a-ed82911cc634 admin admin] Publish callbacks [] for port, precommit_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:50.292920 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-6cadab7a-f9e2-4223-97f1-78291c090468 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:50.296993 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-6cadab7a-f9e2-4223-97f1-78291c090468 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=dfe80527be524672a94a38908e154182&device_id=0d21bc42-7392-483d-b042-8c4ffea9a7f2 HTTP/1.1" status: 200 len: 1096 time: 0.3636427 Nov 02 12:51:50.319820 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-e3ada172-9d49-4c35-ba1e-505e17ee4e81 None None] Port 8cecf398-cb8a-44a0-8ac5-4fb0469dd771 cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:51:50.354416 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device c81df0e3-6336-4caa-8387-60c3321fe152 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:51:50.361465 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7', 'name': 'tempest-TestShelveInstance-685743967-router', 'tenant_id': '8207b92ade05471e96c3fb2b69070dc9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.246'}], 'enable_snat': True}, 'gw_port_id': '22dd88eb-dc23-4b7d-a289-a316ccafbbe0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:35Z', 'updated_at': '2021-11-02T12:51:39Z', 'revision_number': 3, 'project_id': '8207b92ade05471e96c3fb2b69070dc9', 'gw_port': {'id': '22dd88eb-dc23-4b7d-a289-a316ccafbbe0', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:79:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 407, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:37Z', 'updated_at': '2021-11-02T12:51:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:50.398761 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-d928f81b-8d64-4d0c-9054-c81bda46e02e service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=4767bbe8-ea52-4258-9417-d866fb33fb53 HTTP/1.1" status: 200 len: 217 time: 0.0813727 Nov 02 12:51:50.402522 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-85a3d3cb-98c4-4afb-884a-ed82911cc634 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126476609'] for port, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:50.490210 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:51:50.517765 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-6d77672f-706b-4883-a7ef-bc0b572a6485 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:50.520478 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-6d77672f-706b-4883-a7ef-bc0b572a6485 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=8f42833a-0a0e-4198-a7cf-e79133593615 HTTP/1.1" status: 200 len: 855 time: 0.1100214 Nov 02 12:51:50.595745 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-83287302-0a8e-4125-9644-2686cf26f9f1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:50.597364 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-83287302-0a8e-4125-9644-2686cf26f9f1 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=f8553176e5c84edb8b82d01321b30b1c&device_id=8b94e21b-3dc3-4565-a6b9-bd394a3d15ee HTTP/1.1" status: 200 len: 1101 time: 0.6194310 Nov 02 12:51:50.638691 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-7dfbde67-9d1d-4165-b80e-e3e791421ef7 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=bfe7dfe3-4b23-4454-b60a-4955be8d2d31&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0575919 Nov 02 12:51:50.714297 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89d14f92-c0e8-486a-aa89-02ddbf82e0c1 req-4cc3f09f-dda4-4bb8-9b7b-2a96e7ed58e2 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:50.728195 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-89d14f92-c0e8-486a-aa89-02ddbf82e0c1 req-4cc3f09f-dda4-4bb8-9b7b-2a96e7ed58e2 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.6638527 Nov 02 12:51:50.766112 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-7b6629cc-e424-475c-86c7-b95da3eacf9f service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.219&port_id=8037c526-562d-44b7-8677-fa21b26add41 HTTP/1.1" status: 200 len: 217 time: 0.1440840 Nov 02 12:51:50.819349 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-d49cda5c-8771-49f4-9c2f-cfe5407b35f8 service neutron] 10.222.0.90 "GET /v2.0/networks/bfe7dfe3-4b23-4454-b60a-4955be8d2d31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1615984 Nov 02 12:51:50.823700 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62241efd-f0c0-419e-b964-99cd39617f49 None None] The sync data for ids ['a72e5e28-7ed6-44ee-a885-44b7d3fc15a7'] in dv-cinder-816324-1-iscsi is: [{'id': 'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7', 'name': 'tempest-TestShelveInstance-685743967-router', 'tenant_id': '8207b92ade05471e96c3fb2b69070dc9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.246'}], 'enable_snat': True}, 'gw_port_id': '22dd88eb-dc23-4b7d-a289-a316ccafbbe0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:35Z', 'updated_at': '2021-11-02T12:51:39Z', 'revision_number': 3, 'project_id': '8207b92ade05471e96c3fb2b69070dc9', 'gw_port': {'id': '22dd88eb-dc23-4b7d-a289-a316ccafbbe0', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:79:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 407, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:37Z', 'updated_at': '2021-11-02T12:51:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}] {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:51:50.861166 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0740778a-4dca-46eb-9d98-d8d34b6099e1 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:50.887782 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c42ab824-4e69-46ac-8a27-3abc527c912a req-bbdd9ced-d260-4842-8056-5170bce4b565 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:50.890881 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c42ab824-4e69-46ac-8a27-3abc527c912a req-bbdd9ced-d260-4842-8056-5170bce4b565 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.4303284 Nov 02 12:51:50.993491 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port c81df0e3-6336-4caa-8387-60c3321fe152 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:50.994395 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:50.998158 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-c0571b24-3691-424c-ad37-c98ea3428dc7 req-7c4db1f1-230d-4464-8182-6b1b926c5eeb service neutron] 10.222.0.90 "GET /v2.0/networks/bfe7dfe3-4b23-4454-b60a-4955be8d2d31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1657269 Nov 02 12:51:51.003516 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-85a3d3cb-98c4-4afb-884a-ed82911cc634 admin admin] Pushing event updated for resources: {'Port': ['ID=8cecf398-cb8a-44a0-8ac5-4fb0469dd771,revision_number=2']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:51.008655 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-85a3d3cb-98c4-4afb-884a-ed82911cc634 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1649136', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1590109'] for router_interface, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:51.091483 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-c5b34893-353c-4d09-babd-01d971fe5334 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:51.101932 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-c5b34893-353c-4d09-babd-01d971fe5334 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=842a3ec7-e9a3-40a5-b477-63472d7a5707 HTTP/1.1" status: 200 len: 843 time: 0.3129349 Nov 02 12:51:51.107760 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [req-8c068392-c900-4df7-a336-5dc990bc0709 req-2dd0ba44-19e8-471b-9332-ceb520d725ce tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Allocated IP 172.20.0.8 (cf53051c-17aa-4d08-a264-6c6ed50a7a96/2d4c8b31-ca6f-4edf-b0a6-e43793692679/28651645-026f-45f9-aa05-0f14a102b65a) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:51:51.198557 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-85a3d3cb-98c4-4afb-884a-ed82911cc634 admin admin] Network caeed602-a9f7-4485-9f47-7818b602d82c is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:51:51.201454 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-85a3d3cb-98c4-4afb-884a-ed82911cc634 admin admin] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:51:51.270318 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:51.370690 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-89d14f92-c0e8-486a-aa89-02ddbf82e0c1 req-b209ae1b-fd5c-4763-a937-5eb348f68f60 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.6410470 Nov 02 12:51:51.390575 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] For port c81df0e3-6336-4caa-8387-60c3321fe152, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=c81df0e3-6336-4caa-8387-60c3321fe152,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:51:51.483386 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:51.531025 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-07bbd328-9ffd-4365-9cb6-05d0bac50854 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:51.532551 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-07bbd328-9ffd-4365-9cb6-05d0bac50854 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=41ba5328-8dc5-4a66-a20d-744b82293eda&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.3998024 Nov 02 12:51:51.542417 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c42ab824-4e69-46ac-8a27-3abc527c912a req-8cd88505-1fa1-4979-a48e-918ef30f564e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.6217110 Nov 02 12:51:51.640324 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:51:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-716dbe75-e30b-4668-b28c-109a0beacf8f x-openstack-request-id: req-716dbe75-e30b-4668-b28c-109a0beacf8f {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:51:51.640921 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "8b94e21b-3dc3-4565-a6b9-bd394a3d15ee", "tag": "8037c526-562d-44b7-8677-fa21b26add41", "status": "completed", "code": 200}]} {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:51:51.648765 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-716dbe75-e30b-4668-b28c-109a0beacf8f {{(pid=108542) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:51:51.648765 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '8b94e21b-3dc3-4565-a6b9-bd394a3d15ee', 'tag': '8037c526-562d-44b7-8677-fa21b26add41', 'status': 'completed', 'code': 200} Nov 02 12:51:51.790452 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0740778a-4dca-46eb-9d98-d8d34b6099e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:51.830314 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-85a3d3cb-98c4-4afb-884a-ed82911cc634 admin admin] Router a72e5e28-7ed6-44ee-a885-44b7d3fc15a7 has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108542) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 12:51:51.955217 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58368) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:51.980177 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Pushing event updated for resources: {'Port': ['ID=c81df0e3-6336-4caa-8387-60c3321fe152,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:52.052781 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-3c7a6a4e-d70f-40f1-a5a5-51d8a9acf9d0 None None] Provisioning complete for port 8cecf398-cb8a-44a0-8ac5-4fb0469dd771 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:52.058489 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-3c7a6a4e-d70f-40f1-a5a5-51d8a9acf9d0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:52.079663 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-f2543dae-3a48-485f-8928-4b1613f94b2e service neutron] 10.222.0.90 "GET /v2.0/networks/41ba5328-8dc5-4a66-a20d-744b82293eda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4948199 Nov 02 12:51:52.137961 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:51:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7a1ea163-76dc-4c16-bf4b-3d4aa135579c x-openstack-request-id: req-7a1ea163-76dc-4c16-bf4b-3d4aa135579c {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:51:52.138441 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "0d21bc42-7392-483d-b042-8c4ffea9a7f2", "tag": "4767bbe8-ea52-4258-9417-d866fb33fb53", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:51:52.138852 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-7a1ea163-76dc-4c16-bf4b-3d4aa135579c {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:51:52.139488 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '0d21bc42-7392-483d-b042-8c4ffea9a7f2', 'tag': '4767bbe8-ea52-4258-9417-d866fb33fb53', 'status': 'completed', 'code': 200} Nov 02 12:51:52.233157 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-3c7a6a4e-d70f-40f1-a5a5-51d8a9acf9d0 None None] Port 8cecf398-cb8a-44a0-8ac5-4fb0469dd771 cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:51:52.354158 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b145ddc7-4463-4050-9e1b-c4e546773062 req-90e7a35c-194f-4096-8b64-2c9d69ac32e7 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=78f23d67-5bb3-42d7-b7ea-79c832aab569 HTTP/1.1" status: 200 len: 210 time: 0.2276077 Nov 02 12:51:52.372103 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_v2 [None req-569a3dd2-7272-4a33-8f67-a6da5bf8f4c2 admin admin] Deleting subnet a4020aee-5682-461a-a8c4-0fd0248f0a0e {{(pid=108542) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 02 12:51:52.406303 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-569a3dd2-7272-4a33-8f67-a6da5bf8f4c2 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:52.432851 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a34b9d85-18b1-4be0-a6a2-3d706f11489d req-ee3c6b15-9bea-4660-91d7-c8ed1edf4da5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:52.435897 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-a34b9d85-18b1-4be0-a6a2-3d706f11489d req-ee3c6b15-9bea-4660-91d7-c8ed1edf4da5 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=dfe80527be524672a94a38908e154182&device_id=0d21bc42-7392-483d-b042-8c4ffea9a7f2 HTTP/1.1" status: 200 len: 1096 time: 0.5190730 Nov 02 12:51:52.560645 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-85a3d3cb-98c4-4afb-884a-ed82911cc634 admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108542) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:51:52.587197 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-85a3d3cb-98c4-4afb-884a-ed82911cc634 admin admin] 10.222.0.98 "PUT /v2.0/routers/a72e5e28-7ed6-44ee-a885-44b7d3fc15a7/add_router_interface HTTP/1.1" status: 200 len: 503 time: 9.7225823 Nov 02 12:51:52.618423 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0740778a-4dca-46eb-9d98-d8d34b6099e1 admin admin] Network 89f406ae-1b9f-4be7-8881-87075d7c5aa1 is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:51:52.625422 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [None req-0740778a-4dca-46eb-9d98-d8d34b6099e1 admin admin] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:51:52.677445 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0740778a-4dca-46eb-9d98-d8d34b6099e1 admin admin] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:51:52.678788 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-569a3dd2-7272-4a33-8f67-a6da5bf8f4c2 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3344686'] for subnet, precommit_delete_associations {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:52.763270 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-569a3dd2-7272-4a33-8f67-a6da5bf8f4c2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-933154'] for subnet, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:52.886464 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0740778a-4dca-46eb-9d98-d8d34b6099e1 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1590217'] for router_interface, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:52.932370 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-63325219-1f2c-4553-88e6-4d7a5246ca99 req-225cca54-e3f2-4ea8-bebd-28f793f9352a service neutron] 10.222.0.90 "GET /v2.0/networks/41ba5328-8dc5-4a66-a20d-744b82293eda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.7707160 Nov 02 12:51:53.011846 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a34b9d85-18b1-4be0-a6a2-3d706f11489d req-e02f2a97-b417-405a-92df-f1fc002160f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:53.019138 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-a34b9d85-18b1-4be0-a6a2-3d706f11489d req-e02f2a97-b417-405a-92df-f1fc002160f9 service neutron] 10.222.0.90 "GET /v2.0/networks?id=bfe7dfe3-4b23-4454-b60a-4955be8d2d31 HTTP/1.1" status: 200 len: 916 time: 0.5350399 Nov 02 12:51:53.028718 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-569a3dd2-7272-4a33-8f67-a6da5bf8f4c2 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-933141', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126478215', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126185624'] for subnet, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:53.061903 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0740778a-4dca-46eb-9d98-d8d34b6099e1 admin admin] Pushing event updated for resources: {'Port': ['ID=80a55893-6272-4299-8834-e840aa37d37b,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:53.109895 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-569a3dd2-7272-4a33-8f67-a6da5bf8f4c2 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=a4020aee-5682-461a-a8c4-0fd0248f0a0e,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:53.194107 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-d381bb20-5368-47b0-837a-ee5d336919f7 None None] Provisioning complete for port 80a55893-6272-4299-8834-e840aa37d37b triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:53.195940 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-d381bb20-5368-47b0-837a-ee5d336919f7 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:53.231913 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-8c068392-c900-4df7-a336-5dc990bc0709 req-2dd0ba44-19e8-471b-9332-ceb520d725ce tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:53.246513 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-a34b9d85-18b1-4be0-a6a2-3d706f11489d req-8c9c7990-7163-4016-8a7d-93d1ff78242a service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=4767bbe8-ea52-4258-9417-d866fb33fb53 HTTP/1.1" status: 200 len: 217 time: 0.2169347 Nov 02 12:51:53.253514 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-569a3dd2-7272-4a33-8f67-a6da5bf8f4c2 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:53.270101 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-569a3dd2-7272-4a33-8f67-a6da5bf8f4c2 admin admin] 10.222.0.98 "DELETE /v2.0/subnets/a4020aee-5682-461a-a8c4-0fd0248f0a0e HTTP/1.1" status: 204 len: 168 time: 1.3074305 Nov 02 12:51:53.277950 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-d381bb20-5368-47b0-837a-ee5d336919f7 None None] Port 80a55893-6272-4299-8834-e840aa37d37b cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:51:53.284258 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88ccfe9d-8cdb-4c48-b502-7a8746257b3e req-1177c097-b5a2-4a86-82ce-cdb7d41739c4 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:53.288030 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-88ccfe9d-8cdb-4c48-b502-7a8746257b3e req-1177c097-b5a2-4a86-82ce-cdb7d41739c4 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.98 "GET /v2.0/ports?device_id=8b94e21b-3dc3-4565-a6b9-bd394a3d15ee HTTP/1.1" status: 200 len: 948 time: 1.1312985 Nov 02 12:51:53.290889 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 58380) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:53.401102 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a34b9d85-18b1-4be0-a6a2-3d706f11489d req-a0f38d8c-c0bc-4733-a0b7-1ad8258b3fe0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:53.405128 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-a34b9d85-18b1-4be0-a6a2-3d706f11489d req-a0f38d8c-c0bc-4733-a0b7-1ad8258b3fe0 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=8f42833a-0a0e-4198-a7cf-e79133593615 HTTP/1.1" status: 200 len: 855 time: 0.1328986 Nov 02 12:51:53.480152 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-a34b9d85-18b1-4be0-a6a2-3d706f11489d req-5f068813-4680-4271-9bef-47b91337cab6 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=bfe7dfe3-4b23-4454-b60a-4955be8d2d31&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0653379 Nov 02 12:51:53.511137 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-7cc2acae-7c02-49fc-89d4-fd967009f8d9 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:53.536071 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49a223dc-2e2f-4220-bd6e-f27b4be5983f req-25d81205-dcb4-48f3-8aaa-9625ec389c3f tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:53.551584 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-49a223dc-2e2f-4220-bd6e-f27b4be5983f req-25d81205-dcb4-48f3-8aaa-9625ec389c3f tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=0d21bc42-7392-483d-b042-8c4ffea9a7f2 HTTP/1.1" status: 200 len: 943 time: 0.9539957 Nov 02 12:51:53.692145 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-a34b9d85-18b1-4be0-a6a2-3d706f11489d req-c9191047-c9c8-4d0c-8e0a-a9f5d25c769c service neutron] 10.222.0.90 "GET /v2.0/networks/bfe7dfe3-4b23-4454-b60a-4955be8d2d31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2020566 Nov 02 12:51:53.795959 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-88ccfe9d-8cdb-4c48-b502-7a8746257b3e req-faf1395d-b5fb-4c43-a0aa-b8d017ccb417 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.98 "GET /v2.0/security-groups?id=e08e9b2e-bc35-40ca-a7bb-1d6bfbdd9ad3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4621327 Nov 02 12:51:53.917670 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-53ce4f35-6eb2-449d-8ed8-da26f1bbefb7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-972735'] for network, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:53.929087 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 22dd88eb-dc23-4b7d-a289-a316ccafbbe0 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:51:53.934918 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-a34b9d85-18b1-4be0-a6a2-3d706f11489d req-5b2d03c3-6281-47ad-9f3a-e892a117895b service neutron] 10.222.0.90 "GET /v2.0/networks/bfe7dfe3-4b23-4454-b60a-4955be8d2d31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2336712 Nov 02 12:51:53.970305 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a469a690-5b34-4263-aab6-41b4bd50296a req-772e5338-1365-42ac-9e0a-853012a6c030 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:53.973540 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a469a690-5b34-4263-aab6-41b4bd50296a req-772e5338-1365-42ac-9e0a-853012a6c030 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=f8553176e5c84edb8b82d01321b30b1c&device_id=8b94e21b-3dc3-4565-a6b9-bd394a3d15ee HTTP/1.1" status: 200 len: 1101 time: 0.6806383 Nov 02 12:51:53.984989 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-8c068392-c900-4df7-a336-5dc990bc0709 req-2dd0ba44-19e8-471b-9332-ceb520d725ce tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:54.048131 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 22dd88eb-dc23-4b7d-a289-a316ccafbbe0 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:54.048793 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:54.120963 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 4767bbe8-ea52-4258-9417-d866fb33fb53 details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 12:51:54.171642 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-49a223dc-2e2f-4220-bd6e-f27b4be5983f req-a9c19553-4e8f-4fa1-a78e-295165089431 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5619650 Nov 02 12:51:54.306809 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2dd0ba44-19e8-471b-9332-ceb520d725ce tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Pushing event updated for resources: {'Port': ['ID=28651645-026f-45f9-aa05-0f14a102b65a,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:54.502975 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-8c068392-c900-4df7-a336-5dc990bc0709 req-2dd0ba44-19e8-471b-9332-ceb520d725ce tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Network cf53051c-17aa-4d08-a264-6c6ed50a7a96 is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:51:54.511844 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 4767bbe8-ea52-4258-9417-d866fb33fb53, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=4767bbe8-ea52-4258-9417-d866fb33fb53,segment=NetworkSegment(e912b2b1-808c-4d37-a99d-fcfdb9d2a5db),segment_id=e912b2b1-808c-4d37-a99d-fcfdb9d2a5db)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:51:54.562725 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': '4767bbe8-ea52-4258-9417-d866fb33fb53', 'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31', 'port_id': '4767bbe8-ea52-4258-9417-d866fb33fb53', 'mac_address': 'fa:16:3e:1a:ae:3b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 862, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8f42833a-0a0e-4198-a7cf-e79133593615', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 12:51:54.565710 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:54.645392 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] Sync routers for ids ['a72e5e28-7ed6-44ee-a885-44b7d3fc15a7'] in dv-cinder-816324-1-iscsi {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:51:54.699402 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0740778a-4dca-46eb-9d98-d8d34b6099e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:54.701264 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] Routers {'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:51:54.702351 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:51:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['a72e5e28-7ed6-44ee-a885-44b7d3fc15a7'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:54.715915 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:54.725065 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a469a690-5b34-4263-aab6-41b4bd50296a req-0a7c549c-c658-45bf-a5da-d37e6786001f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:54.727946 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a469a690-5b34-4263-aab6-41b4bd50296a req-0a7c549c-c658-45bf-a5da-d37e6786001f service neutron] 10.222.0.90 "GET /v2.0/networks?id=41ba5328-8dc5-4a66-a20d-744b82293eda HTTP/1.1" status: 200 len: 870 time: 0.7303534 Nov 02 12:51:54.736031 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] For port 22dd88eb-dc23-4b7d-a289-a316ccafbbe0, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=22dd88eb-dc23-4b7d-a289-a316ccafbbe0,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:51:54.746735 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4767bbe8-ea52-4258-9417-d866fb33fb53 {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:51:54.785608 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 4767bbe8-ea52-4258-9417-d866fb33fb53, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=4767bbe8-ea52-4258-9417-d866fb33fb53,segment=NetworkSegment(e912b2b1-808c-4d37-a99d-fcfdb9d2a5db),segment_id=e912b2b1-808c-4d37-a99d-fcfdb9d2a5db)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:51:54.827457 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:54.828651 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device c81df0e3-6336-4caa-8387-60c3321fe152 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:51:54.954641 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:54.960894 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] Set router a72e5e28-7ed6-44ee-a885-44b7d3fc15a7 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:51:55.032442 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Pushing event updated for resources: {'Port': ['ID=22dd88eb-dc23-4b7d-a289-a316ccafbbe0,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:55.049293 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:55.049842 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:55.050530 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:55.051084 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:55.051622 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:55.052262 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:55.052816 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:55.053416 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:55.053960 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:55.054529 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:55.055064 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:55.055605 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:51:55.142494 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port c81df0e3-6336-4caa-8387-60c3321fe152 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:55.143049 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:55.230060 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=4767bbe8-ea52-4258-9417-d866fb33fb53,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:55.271144 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['4767bbe8-ea52-4258-9417-d866fb33fb53'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:51:55.284750 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6417d329-ff69-4762-9bab-352c58d1378a req-4affad6c-4756-4132-aa9b-3ae19133b413 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:55.287223 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6417d329-ff69-4762-9bab-352c58d1378a req-4affad6c-4756-4132-aa9b-3ae19133b413 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 1.1707129 Nov 02 12:51:55.288813 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [req-8c068392-c900-4df7-a336-5dc990bc0709 req-2dd0ba44-19e8-471b-9332-ceb520d725ce tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:51:55.312654 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-53ce4f35-6eb2-449d-8ed8-da26f1bbefb7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-930985', 'neutron.services.segments.db._delete_segments_for_network-8738449897966'] for network, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:55.317941 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-8c068392-c900-4df7-a336-5dc990bc0709 req-2dd0ba44-19e8-471b-9332-ceb520d725ce tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:51:55.448550 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7', 'name': 'tempest-TestShelveInstance-685743967-router', 'tenant_id': '8207b92ade05471e96c3fb2b69070dc9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.246'}], 'enable_snat': True}, 'gw_port_id': '22dd88eb-dc23-4b7d-a289-a316ccafbbe0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:35Z', 'updated_at': '2021-11-02T12:51:48Z', 'revision_number': 4, 'project_id': '8207b92ade05471e96c3fb2b69070dc9', 'gw_port': {'id': '22dd88eb-dc23-4b7d-a289-a316ccafbbe0', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:79:e0', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 407, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:37Z', 'updated_at': '2021-11-02T12:51:47Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '8cecf398-cb8a-44a0-8ac5-4fb0469dd771', 'name': '', 'network_id': 'caeed602-a9f7-4485-9f47-7818b602d82c', 'tenant_id': '8207b92ade05471e96c3fb2b69070dc9', 'mac_address': 'fa:16:3e:45:59:a7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7', 'device_owner': 'network:router_interface', 'standard_attr_id': 414, 'fixed_ips': [{'subnet_id': '981d49eb-4000-4cb3-981b-174f2c0b159a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:45Z', 'updated_at': '2021-11-02T12:51:49Z', 'revision_number': 2, 'project_id': '8207b92ade05471e96c3fb2b69070dc9', 'subnets': [{'id': '981d49eb-4000-4cb3-981b-174f2c0b159a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:55.502172 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c068392-c900-4df7-a336-5dc990bc0709 req-2dd0ba44-19e8-471b-9332-ceb520d725ce tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:55.503767 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-8c068392-c900-4df7-a336-5dc990bc0709 req-2dd0ba44-19e8-471b-9332-ceb520d725ce tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:55.508580 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] Checking router: a72e5e28-7ed6-44ee-a885-44b7d3fc15a7 for host: dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:51:55.509454 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] Updating router a72e5e28-7ed6-44ee-a885-44b7d3fc15a7 port 8cecf398-cb8a-44a0-8ac5-4fb0469dd771 binding host dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 02 12:51:55.567019 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:55.578306 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a469a690-5b34-4263-aab6-41b4bd50296a req-8814958d-0849-49e7-823e-5f434b9286ae service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=192.168.233.219&port_id=8037c526-562d-44b7-8677-fa21b26add41 HTTP/1.1" status: 200 len: 217 time: 0.7911482 Nov 02 12:51:55.749819 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 22dd88eb-dc23-4b7d-a289-a316ccafbbe0 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:51:55.751814 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.services.segments.db [None req-53ce4f35-6eb2-449d-8ed8-da26f1bbefb7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['0ce930ad-1b27-46c2-80e4-87a33207655e']}} {{(pid=108543) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:55.761949 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0f3275dc-f5ce-4e75-94bd-39c3833344a8 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:55.805883 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-634905ee-c6ed-4d2a-b2e3-3b3db275f2f5 req-6d3c168b-8712-4c59-af62-3f678e431293 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:55.819463 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-634905ee-c6ed-4d2a-b2e3-3b3db275f2f5 req-6d3c168b-8712-4c59-af62-3f678e431293 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 1.4271591 Nov 02 12:51:55.955602 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.services.segments.db [None req-53ce4f35-6eb2-449d-8ed8-da26f1bbefb7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '18998ba1-fb1c-4749-aa24-56a07054fb75') {'for_net_delete': True} {{(pid=108543) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:55.956327 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.services.segments.db [None req-53ce4f35-6eb2-449d-8ed8-da26f1bbefb7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '18998ba1-fb1c-4749-aa24-56a07054fb75') {} {{(pid=108543) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:55.959650 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 22dd88eb-dc23-4b7d-a289-a316ccafbbe0 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:55.963070 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:55.969611 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6417d329-ff69-4762-9bab-352c58d1378a req-2352ae3f-a87c-46f9-96ba-f8155e19758b tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4384048 Nov 02 12:51:55.976222 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8c068392-c900-4df7-a336-5dc990bc0709 req-2dd0ba44-19e8-471b-9332-ceb520d725ce tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 8.8929255 Nov 02 12:51:56.034732 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-8c068392-c900-4df7-a336-5dc990bc0709 req-3f3371f4-93f6-46cb-9ee3-4288b3a117df service neutron] Request body: {'port': {'device_id': '78f23d67-5bb3-42d7-b7ea-79c832aab569', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81632'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:51:56.079403 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-53ce4f35-6eb2-449d-8ed8-da26f1bbefb7 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738449902583', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3308610'] for segment, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:56.155131 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 8037c526-562d-44b7-8677-fa21b26add41 details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 12:51:56.351081 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-634905ee-c6ed-4d2a-b2e3-3b3db275f2f5 req-d016469e-78c4-4442-b0f2-261c9448f7ca tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5299337 Nov 02 12:51:56.356380 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-53ce4f35-6eb2-449d-8ed8-da26f1bbefb7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:56.376444 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a469a690-5b34-4263-aab6-41b4bd50296a req-e2b811ea-de30-4435-9baf-4dfd3892d82f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:56.383305 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a469a690-5b34-4263-aab6-41b4bd50296a req-e2b811ea-de30-4435-9baf-4dfd3892d82f service neutron] 10.222.0.90 "GET /v2.0/subnets?id=842a3ec7-e9a3-40a5-b477-63472d7a5707 HTTP/1.1" status: 200 len: 843 time: 0.7278614 Nov 02 12:51:56.383868 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] Publish callbacks [] for port, precommit_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:56.420594 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 8037c526-562d-44b7-8677-fa21b26add41, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=8037c526-562d-44b7-8677-fa21b26add41,segment=NetworkSegment(914624d2-b577-476c-8aac-4af5f5930ab2),segment_id=914624d2-b577-476c-8aac-4af5f5930ab2)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:51:56.449689 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': '8037c526-562d-44b7-8677-fa21b26add41', 'network_id': '41ba5328-8dc5-4a66-a20d-744b82293eda', 'port_id': '8037c526-562d-44b7-8677-fa21b26add41', 'mac_address': 'fa:16:3e:68:ea:50', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 879, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '842a3ec7-e9a3-40a5-b477-63472d7a5707', 'ip_address': '192.168.233.219'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 12:51:56.500310 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:56.536708 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-8c068392-c900-4df7-a336-5dc990bc0709 req-3f3371f4-93f6-46cb-9ee3-4288b3a117df service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:56.557875 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-53ce4f35-6eb2-449d-8ed8-da26f1bbefb7 admin admin] Releasing vlan 870 on physical network physnet1 to pool {{(pid=108543) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 02 12:51:56.558617 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-53ce4f35-6eb2-449d-8ed8-da26f1bbefb7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126393740'] for segment, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: Traceback (most recent call last): Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: timer() Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: cb(*args, **kw) Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: return func(*args, **kwargs) Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: self._notify() Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: self.callback(batched_events) Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: event.method(event) Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: aggregate_uuid = self.p_client.list_aggregates( Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: return f(self, *a, **k) Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: return self._get(url).json() Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: return self.request(url, 'GET', **kwargs) Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: base_url = self.get_endpoint(auth, allow=allow, Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 02 12:51:56.562047 dv-cinder-816324-1-iscsi neutron-server[108543]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 02 12:51:56.692685 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-553fcf9a-e3eb-4ee3-8f2c-7ab37dc09291 None None] Pushing event updated for resources: {'Port': ['ID=8cecf398-cb8a-44a0-8ac5-4fb0469dd771,revision_number=3']} {{(pid=108545) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:56.722293 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:56.757240 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8037c526-562d-44b7-8677-fa21b26add41 {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:51:56.851231 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 8037c526-562d-44b7-8677-fa21b26add41, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=8037c526-562d-44b7-8677-fa21b26add41,segment=NetworkSegment(914624d2-b577-476c-8aac-4af5f5930ab2),segment_id=914624d2-b577-476c-8aac-4af5f5930ab2)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:51:56.858933 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:56.944719 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] Attempting to bind port 8cecf398-cb8a-44a0-8ac5-4fb0469dd771 on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:51:56.945596 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:56.945934 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] Attempting to bind port 8cecf398-cb8a-44a0-8ac5-4fb0469dd771 by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': 'b7dd916f-2223-4397-bf62-f54ca54f5493', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': 'caeed602-a9f7-4485-9f47-7818b602d82c'}] {{(pid=108545) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:51:56.946788 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] Attempting to bind port 8cecf398-cb8a-44a0-8ac5-4fb0469dd771 on network caeed602-a9f7-4485-9f47-7818b602d82c {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:51:56.971568 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 51, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:51:56.973953 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] Checking segment: {'id': 'b7dd916f-2223-4397-bf62-f54ca54f5493', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': 'caeed602-a9f7-4485-9f47-7818b602d82c'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108545) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:51:56.974746 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:56.977146 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] Bound using segment: {'id': 'b7dd916f-2223-4397-bf62-f54ca54f5493', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': 'caeed602-a9f7-4485-9f47-7818b602d82c'} {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:51:56.977146 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] Bound port: 8cecf398-cb8a-44a0-8ac5-4fb0469dd771, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'b7dd916f-2223-4397-bf62-f54ca54f5493', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 855, 'network_id': 'caeed602-a9f7-4485-9f47-7818b602d82c'}}] {{(pid=108545) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:51:56.977146 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:57.086213 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a469a690-5b34-4263-aab6-41b4bd50296a req-8e884f41-5df3-4979-beca-2b6260916dbf service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:57.089482 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a469a690-5b34-4263-aab6-41b4bd50296a req-8e884f41-5df3-4979-beca-2b6260916dbf service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=41ba5328-8dc5-4a66-a20d-744b82293eda&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1178 time: 0.5695159 Nov 02 12:51:57.177041 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-53ce4f35-6eb2-449d-8ed8-da26f1bbefb7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-930976', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1594946'] for network, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:57.189576 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-53ce4f35-6eb2-449d-8ed8-da26f1bbefb7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:57.190161 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=8037c526-562d-44b7-8677-fa21b26add41,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:57.197960 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-67c1fef8-f75b-4a79-9c84-cf11b2303aaa None None] Provisioning complete for port 8cecf398-cb8a-44a0-8ac5-4fb0469dd771 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:57.198757 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-67c1fef8-f75b-4a79-9c84-cf11b2303aaa None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:57.204837 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-53ce4f35-6eb2-449d-8ed8-da26f1bbefb7 admin admin] 10.222.0.98 "DELETE /v2.0/networks/0ce930ad-1b27-46c2-80e4-87a33207655e HTTP/1.1" status: 204 len: 168 time: 3.8978946 Nov 02 12:51:57.209254 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58394) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:57.245645 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.db [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] For port 8cecf398-cb8a-44a0-8ac5-4fb0469dd771, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108545) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:51:57.257152 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.db [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] For port 8cecf398-cb8a-44a0-8ac5-4fb0469dd771, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=8cecf398-cb8a-44a0-8ac5-4fb0469dd771,segment=NetworkSegment(b7dd916f-2223-4397-bf62-f54ca54f5493),segment_id=b7dd916f-2223-4397-bf62-f54ca54f5493)] {{(pid=108545) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:51:57.311173 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['8037c526-562d-44b7-8677-fa21b26add41'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:51:57.333807 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:57.335645 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47d40ef8-f711-48ed-aa20-729dbfb9528b req-b7c5d3c4-6c87-40b0-b193-a1374b0bc2eb tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:57.337755 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-47d40ef8-f711-48ed-aa20-729dbfb9528b req-b7c5d3c4-6c87-40b0-b193-a1374b0bc2eb tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=78f23d67-5bb3-42d7-b7ea-79c832aab569 HTTP/1.1" status: 200 len: 931 time: 0.6860580 Nov 02 12:51:57.370589 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_v2 [None req-4489c438-e00e-4a2d-8c8b-002f7070e583 admin admin] Deleting subnet 79af21c7-51eb-4af2-b5ee-7b5a1e1fb617 {{(pid=108542) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 02 12:51:57.379565 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4489c438-e00e-4a2d-8c8b-002f7070e583 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:57.430083 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-67c1fef8-f75b-4a79-9c84-cf11b2303aaa None None] Port 8cecf398-cb8a-44a0-8ac5-4fb0469dd771 cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:51:57.504793 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4489c438-e00e-4a2d-8c8b-002f7070e583 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3344686'] for subnet, precommit_delete_associations {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:57.587356 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] Routers {'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:51:57.588368 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:51:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['a72e5e28-7ed6-44ee-a885-44b7d3fc15a7'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:57.606693 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53ce4f35-6eb2-449d-8ed8-da26f1bbefb7 admin admin] Pushing event deleted for resources: {'Network': ['ID=0ce930ad-1b27-46c2-80e4-87a33207655e,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:57.635584 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4489c438-e00e-4a2d-8c8b-002f7070e583 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-933154'] for subnet, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:57.688092 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0740778a-4dca-46eb-9d98-d8d34b6099e1 admin admin] Publish callbacks [] for port, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:57.855081 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-553fcf9a-e3eb-4ee3-8f2c-7ab37dc09291 None None] Pushing event updated for resources: {'Port': ['ID=8cecf398-cb8a-44a0-8ac5-4fb0469dd771,revision_number=4']} {{(pid=108545) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:57.872194 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4489c438-e00e-4a2d-8c8b-002f7070e583 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-933141', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126478215', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126185624'] for subnet, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:57.911371 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4489c438-e00e-4a2d-8c8b-002f7070e583 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:57.931146 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-4489c438-e00e-4a2d-8c8b-002f7070e583 admin admin] 10.222.0.98 "DELETE /v2.0/subnets/79af21c7-51eb-4af2-b5ee-7b5a1e1fb617 HTTP/1.1" status: 204 len: 168 time: 0.7191792 Nov 02 12:51:57.934557 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58398) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:58.066441 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a469a690-5b34-4263-aab6-41b4bd50296a req-ef498763-5c52-4374-b889-af949b5c17c0 service neutron] 10.222.0.90 "GET /v2.0/networks/41ba5328-8dc5-4a66-a20d-744b82293eda?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.9532061 Nov 02 12:51:58.115765 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-5bf132a1-c651-409b-a96f-deee114ab27c None None] Provisioning complete for port 8cecf398-cb8a-44a0-8ac5-4fb0469dd771 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:58.116737 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5bf132a1-c651-409b-a96f-deee114ab27c None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:58.138358 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4489c438-e00e-4a2d-8c8b-002f7070e583 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=79af21c7-51eb-4af2-b5ee-7b5a1e1fb617,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:58.169349 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-6b47eb96-d991-4d71-a571-a6ede9295f92 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-972735'] for network, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:58.261875 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] Set router a72e5e28-7ed6-44ee-a885-44b7d3fc15a7 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:51:58.268059 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 4767bbe8-ea52-4258-9417-d866fb33fb53 up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:51:58.401480 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [req-8c068392-c900-4df7-a336-5dc990bc0709 req-3f3371f4-93f6-46cb-9ee3-4288b3a117df service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 28651645-026f-45f9-aa05-0f14a102b65a {{(pid=108543) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:51:58.413110 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5bf132a1-c651-409b-a96f-deee114ab27c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:58.425090 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-8c068392-c900-4df7-a336-5dc990bc0709 req-3f3371f4-93f6-46cb-9ee3-4288b3a117df service neutron] Publish callbacks [] for port, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:58.432899 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:58.472677 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.provisioning_blocks [req-8c068392-c900-4df7-a336-5dc990bc0709 req-3f3371f4-93f6-46cb-9ee3-4288b3a117df service neutron] Transition to ACTIVE for port object 28651645-026f-45f9-aa05-0f14a102b65a will not be triggered until provisioned by entity L2. {{(pid=108543) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 02 12:51:58.485084 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-5bf132a1-c651-409b-a96f-deee114ab27c None None] For port 8cecf398-cb8a-44a0-8ac5-4fb0469dd771, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=8cecf398-cb8a-44a0-8ac5-4fb0469dd771,segment=NetworkSegment(b7dd916f-2223-4397-bf62-f54ca54f5493),segment_id=b7dd916f-2223-4397-bf62-f54ca54f5493)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:51:58.486352 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0740778a-4dca-46eb-9d98-d8d34b6099e1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:58.492738 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 58400) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:58.494047 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-6b47eb96-d991-4d71-a571-a6ede9295f92 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-930985', 'neutron.services.segments.db._delete_segments_for_network-8738449897966'] for network, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:58.527601 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-d9cb0558-0b56-49e2-a390-43295afb1bc9 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-1207454379', 'description': 'tempest-secgroup-smoke-1207454379 description', 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:51:58.538024 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-47d40ef8-f711-48ed-aa20-729dbfb9528b req-34807bc8-0ef0-446a-af46-1133fb5396e2 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/security-groups?id=eadb1119-2269-4956-923b-c60da15e2d12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 1.0932136 Nov 02 12:51:58.545408 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-6b47eb96-d991-4d71-a571-a6ede9295f92 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['d893837d-c57e-4d25-b162-f9b6551bd5a1']}} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:58.550490 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning for port 4767bbe8-ea52-4258-9417-d866fb33fb53 completed by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 02 12:51:58.556356 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port 4767bbe8-ea52-4258-9417-d866fb33fb53 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:58.557362 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:58.566343 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-6b47eb96-d991-4d71-a571-a6ede9295f92 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '7e37cf0e-11fc-42e8-8944-aa0ee11b5aba') {'for_net_delete': True} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:58.567818 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-6b47eb96-d991-4d71-a571-a6ede9295f92 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '7e37cf0e-11fc-42e8-8944-aa0ee11b5aba') {} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:58.583801 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-6b47eb96-d991-4d71-a571-a6ede9295f92 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738449902583', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3344697'] for segment, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:58.600106 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-6b47eb96-d991-4d71-a571-a6ede9295f92 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:58.611438 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-6b47eb96-d991-4d71-a571-a6ede9295f92 admin admin] Releasing vlan 894 on physical network physnet1 to pool {{(pid=108542) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 02 12:51:58.611854 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-6b47eb96-d991-4d71-a571-a6ede9295f92 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126476581'] for segment, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:58.664052 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5bf132a1-c651-409b-a96f-deee114ab27c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: Traceback (most recent call last): Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: timer() Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: cb(*args, **kw) Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: return func(*args, **kwargs) Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: self._notify() Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: self.callback(batched_events) Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: event.method(event) Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: aggregate_uuid = self.p_client.list_aggregates( Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: return f(self, *a, **k) Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: return self._get(url).json() Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: return self.request(url, 'GET', **kwargs) Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: base_url = self.get_endpoint(auth, allow=allow, Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 02 12:51:58.734440 dv-cinder-816324-1-iscsi neutron-server[108542]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 02 12:51:58.802405 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-8c068392-c900-4df7-a336-5dc990bc0709 req-3f3371f4-93f6-46cb-9ee3-4288b3a117df service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:58.836971 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-6b47eb96-d991-4d71-a571-a6ede9295f92 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-930976', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1594946'] for network, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:58.856552 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-6b47eb96-d991-4d71-a571-a6ede9295f92 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:58.891070 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-6b47eb96-d991-4d71-a571-a6ede9295f92 admin admin] 10.222.0.98 "DELETE /v2.0/networks/d893837d-c57e-4d25-b162-f9b6551bd5a1 HTTP/1.1" status: 204 len: 168 time: 0.8958225 Nov 02 12:51:58.911846 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5bf132a1-c651-409b-a96f-deee114ab27c None None] Pushing event updated for resources: {'Port': ['ID=8cecf398-cb8a-44a0-8ac5-4fb0469dd771,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:58.922992 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:58.939920 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6b47eb96-d991-4d71-a571-a6ede9295f92 admin admin] Pushing event deleted for resources: {'Network': ['ID=d893837d-c57e-4d25-b162-f9b6551bd5a1,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:58.985208 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0740778a-4dca-46eb-9d98-d8d34b6099e1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1649136', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1590109'] for router_interface, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:59.018362 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 4767bbe8-ea52-4258-9417-d866fb33fb53, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=4767bbe8-ea52-4258-9417-d866fb33fb53,segment=NetworkSegment(e912b2b1-808c-4d37-a99d-fcfdb9d2a5db),segment_id=e912b2b1-808c-4d37-a99d-fcfdb9d2a5db)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:51:59.020191 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0d21bc42-7392-483d-b042-8c4ffea9a7f2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4767bbe8-ea52-4258-9417-d866fb33fb53'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:51:59.024338 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a519c852-f940-479a-8235-286ceff3ac38" -d '{"events": [{"server_uuid": "0d21bc42-7392-483d-b042-8c4ffea9a7f2", "name": "network-vif-plugged", "status": "completed", "tag": "4767bbe8-ea52-4258-9417-d866fb33fb53"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:51:59.059827 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7', 'name': 'tempest-TestShelveInstance-685743967-router', 'tenant_id': '8207b92ade05471e96c3fb2b69070dc9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.246'}], 'enable_snat': True}, 'gw_port_id': '22dd88eb-dc23-4b7d-a289-a316ccafbbe0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:35Z', 'updated_at': '2021-11-02T12:51:48Z', 'revision_number': 4, 'project_id': '8207b92ade05471e96c3fb2b69070dc9', 'gw_port': {'id': '22dd88eb-dc23-4b7d-a289-a316ccafbbe0', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:79:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 407, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:37Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '8cecf398-cb8a-44a0-8ac5-4fb0469dd771', 'name': '', 'network_id': 'caeed602-a9f7-4485-9f47-7818b602d82c', 'tenant_id': '8207b92ade05471e96c3fb2b69070dc9', 'mac_address': 'fa:16:3e:45:59:a7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7', 'device_owner': 'network:router_interface', 'standard_attr_id': 414, 'fixed_ips': [{'subnet_id': '981d49eb-4000-4cb3-981b-174f2c0b159a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:45Z', 'updated_at': '2021-11-02T12:51:57Z', 'revision_number': 4, 'project_id': '8207b92ade05471e96c3fb2b69070dc9', 'subnets': [{'id': '981d49eb-4000-4cb3-981b-174f2c0b159a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:51:59.067633 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0740778a-4dca-46eb-9d98-d8d34b6099e1 admin admin] Pushing event updated for resources: {'Port': ['ID=80a55893-6272-4299-8834-e840aa37d37b,revision_number=2']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:59.072743 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d9cb0558-0b56-49e2-a390-43295afb1bc9 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:59.100726 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:59.115910 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a469a690-5b34-4263-aab6-41b4bd50296a req-45b582ec-69e6-4c8f-aa44-4a53a63a7265 service neutron] 10.222.0.90 "GET /v2.0/networks/41ba5328-8dc5-4a66-a20d-744b82293eda?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.6363788 Nov 02 12:51:59.127734 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-04fd44d4-21ce-45ea-a1a6-749411a83018 None None] The sync data for ids ['a72e5e28-7ed6-44ee-a885-44b7d3fc15a7'] in dv-cinder-816324-1-iscsi is: [{'id': 'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7', 'name': 'tempest-TestShelveInstance-685743967-router', 'tenant_id': '8207b92ade05471e96c3fb2b69070dc9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.246'}], 'enable_snat': True}, 'gw_port_id': '22dd88eb-dc23-4b7d-a289-a316ccafbbe0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:35Z', 'updated_at': '2021-11-02T12:51:48Z', 'revision_number': 4, 'project_id': '8207b92ade05471e96c3fb2b69070dc9', 'gw_port': {'id': '22dd88eb-dc23-4b7d-a289-a316ccafbbe0', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:79:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 407, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:37Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '8cecf398-cb8a-44a0-8ac5-4fb0469dd771', 'name': '', 'network_id': 'caeed602-a9f7-4485-9f47-7818b602d82c', 'tenant_id': '8207b92ade05471e96c3fb2b69070dc9', 'mac_address': 'fa:16:3e:45:59:a7', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7', 'device_owner': 'network:router_interface', 'standard_attr_id': 414, 'fixed_ips': [{'subnet_id': '981d49eb-4000-4cb3-981b-174f2c0b159a', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:45Z', 'updated_at': '2021-11-02T12:51:57Z', 'revision_number': 4, 'project_id': '8207b92ade05471e96c3fb2b69070dc9', 'subnets': [{'id': '981d49eb-4000-4cb3-981b-174f2c0b159a', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:51:59.186825 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=4767bbe8-ea52-4258-9417-d866fb33fb53,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:59.201226 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ce6415f-31b9-475d-9128-82b89c7e3d70 req-18c2d269-5a6f-4b9d-8ca0-7ef78ec84c64 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:59.213788 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0ce6415f-31b9-475d-9128-82b89c7e3d70 req-18c2d269-5a6f-4b9d-8ca0-7ef78ec84c64 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.98 "GET /v2.0/ports?device_id=8b94e21b-3dc3-4565-a6b9-bd394a3d15ee HTTP/1.1" status: 200 len: 949 time: 0.7137909 Nov 02 12:51:59.309553 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-463d87e9-c62e-42ee-a9c0-e9e4bc3ba0f8 req-9178ca49-1bed-415d-a97c-42d75f8ad794 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:51:59.311548 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-463d87e9-c62e-42ee-a9c0-e9e4bc3ba0f8 req-9178ca49-1bed-415d-a97c-42d75f8ad794 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=0d21bc42-7392-483d-b042-8c4ffea9a7f2 HTTP/1.1" status: 200 len: 944 time: 0.5595472 Nov 02 12:51:59.399500 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f3371f4-93f6-46cb-9ee3-4288b3a117df service neutron] Pushing event updated for resources: {'Port': ['ID=28651645-026f-45f9-aa05-0f14a102b65a,revision_number=2']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:51:59.702813 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0ce6415f-31b9-475d-9128-82b89c7e3d70 req-10db73fd-b731-4357-b18c-f0b488ac399e tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.98 "GET /v2.0/security-groups?id=e08e9b2e-bc35-40ca-a7bb-1d6bfbdd9ad3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4867415 Nov 02 12:51:59.818682 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 8cecf398-cb8a-44a0-8ac5-4fb0469dd771 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:51:59.846716 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-0740778a-4dca-46eb-9d98-d8d34b6099e1 admin admin] Network 89f406ae-1b9f-4be7-8881-87075d7c5aa1 is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:51:59.863999 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [None req-0740778a-4dca-46eb-9d98-d8d34b6099e1 admin admin] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:51:59.896682 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58412) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:51:59.916521 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-463d87e9-c62e-42ee-a9c0-e9e4bc3ba0f8 req-c30f7ae4-6900-47e6-9d87-48e52451d3c8 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.5445139 Nov 02 12:51:59.922452 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-8c068392-c900-4df7-a336-5dc990bc0709 req-3f3371f4-93f6-46cb-9ee3-4288b3a117df service neutron] Attempting to bind port 28651645-026f-45f9-aa05-0f14a102b65a on host hv-cinder-81632 for vnic_type normal with profile {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:51:59.931114 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-8c068392-c900-4df7-a336-5dc990bc0709 req-3f3371f4-93f6-46cb-9ee3-4288b3a117df service neutron] Attempting to bind port 28651645-026f-45f9-aa05-0f14a102b65a by drivers openvswitch,hyperv on host hv-cinder-81632 at level 0 using segments [{'id': '9918b664-73ec-4ba3-8b79-1b2dd2746c03', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 889, 'network_id': 'cf53051c-17aa-4d08-a264-6c6ed50a7a96'}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:51:59.931480 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c068392-c900-4df7-a336-5dc990bc0709 req-3f3371f4-93f6-46cb-9ee3-4288b3a117df service neutron] Attempting to bind port 28651645-026f-45f9-aa05-0f14a102b65a on network cf53051c-17aa-4d08-a264-6c6ed50a7a96 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:51:59.977712 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d9cb0558-0b56-49e2-a390-43295afb1bc9 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:59.977712 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c068392-c900-4df7-a336-5dc990bc0709 req-3f3371f4-93f6-46cb-9ee3-4288b3a117df service neutron] Port 28651645-026f-45f9-aa05-0f14a102b65a on network cf53051c-17aa-4d08-a264-6c6ed50a7a96 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81632 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 02 12:51:59.977965 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 8cecf398-cb8a-44a0-8ac5-4fb0469dd771 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:51:59.977965 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:51:59.978200 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c068392-c900-4df7-a336-5dc990bc0709 req-3f3371f4-93f6-46cb-9ee3-4288b3a117df service neutron] Attempting to bind port 28651645-026f-45f9-aa05-0f14a102b65a on network cf53051c-17aa-4d08-a264-6c6ed50a7a96 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:51:59.991201 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c068392-c900-4df7-a336-5dc990bc0709 req-3f3371f4-93f6-46cb-9ee3-4288b3a117df service neutron] Checking agent: {'id': '0d57fa42-4660-4f08-b7dc-53a872c3c01c', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81632', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'started_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 51, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:51:59.991548 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c068392-c900-4df7-a336-5dc990bc0709 req-3f3371f4-93f6-46cb-9ee3-4288b3a117df service neutron] Checking segment: {'id': '9918b664-73ec-4ba3-8b79-1b2dd2746c03', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 889, 'network_id': 'cf53051c-17aa-4d08-a264-6c6ed50a7a96'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108543) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:51:59.991943 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-8c068392-c900-4df7-a336-5dc990bc0709 req-3f3371f4-93f6-46cb-9ee3-4288b3a117df service neutron] Bound using segment: {'id': '9918b664-73ec-4ba3-8b79-1b2dd2746c03', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 889, 'network_id': 'cf53051c-17aa-4d08-a264-6c6ed50a7a96'} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:51:59.992417 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-8c068392-c900-4df7-a336-5dc990bc0709 req-3f3371f4-93f6-46cb-9ee3-4288b3a117df service neutron] Bound port: 28651645-026f-45f9-aa05-0f14a102b65a, host: hv-cinder-81632, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '9918b664-73ec-4ba3-8b79-1b2dd2746c03', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 889, 'network_id': 'cf53051c-17aa-4d08-a264-6c6ed50a7a96'}}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:51:59.992761 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-8c068392-c900-4df7-a336-5dc990bc0709 req-3f3371f4-93f6-46cb-9ee3-4288b3a117df service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:00.058448 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-0e2a0c1e-de29-470f-9dc7-d4eef65949b5 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=4a21557a001645f1909c2443ae4b691f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1602688 Nov 02 12:52:00.060980 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58414) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:00.122340 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff98f716-99f4-4930-a503-54ef6b448b64 req-5e2a0b70-ab80-42c5-956d-0f1f2dff7c38 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:00.130572 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ff98f716-99f4-4930-a503-54ef6b448b64 req-5e2a0b70-ab80-42c5-956d-0f1f2dff7c38 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.3379443 Nov 02 12:52:00.147034 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 8037c526-562d-44b7-8677-fa21b26add41 up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:52:00.182754 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5e984dbc-6975-4f1a-9f5c-7fdb9bd8348c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:00.231527 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5e984dbc-6975-4f1a-9f5c-7fdb9bd8348c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:00.349791 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ff98f716-99f4-4930-a503-54ef6b448b64 req-d0f76647-5c3f-4b97-a60b-8ce9a4efe760 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2181954 Nov 02 12:52:00.389518 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-39d3de11-0d91-4fa8-9561-784855768bf7 req-2d72176d-8e83-4247-8927-fa79df3a32de tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:00.391145 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-39d3de11-0d91-4fa8-9561-784855768bf7 req-2d72176d-8e83-4247-8927-fa79df3a32de tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.3017516 Nov 02 12:52:00.426213 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:51:59 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-32ce591b-92c9-4e01-b6ad-1063cadf0d7c x-openstack-request-id: req-32ce591b-92c9-4e01-b6ad-1063cadf0d7c {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:52:00.426983 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0d21bc42-7392-483d-b042-8c4ffea9a7f2", "name": "network-vif-plugged", "status": "completed", "tag": "4767bbe8-ea52-4258-9417-d866fb33fb53", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:52:00.430944 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-32ce591b-92c9-4e01-b6ad-1063cadf0d7c {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:52:00.431620 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0d21bc42-7392-483d-b042-8c4ffea9a7f2', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4767bbe8-ea52-4258-9417-d866fb33fb53', 'code': 200} Nov 02 12:52:00.472995 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d9cb0558-0b56-49e2-a390-43295afb1bc9 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:00.472995 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-8c068392-c900-4df7-a336-5dc990bc0709 req-3f3371f4-93f6-46cb-9ee3-4288b3a117df service neutron] For port 28651645-026f-45f9-aa05-0f14a102b65a, host hv-cinder-81632, cleared binding levels {{(pid=108543) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:52:00.495342 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5e984dbc-6975-4f1a-9f5c-7fdb9bd8348c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:00.503705 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning for port 8037c526-562d-44b7-8677-fa21b26add41 completed by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 02 12:52:00.513889 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5e984dbc-6975-4f1a-9f5c-7fdb9bd8348c admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:00.516660 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port 8037c526-562d-44b7-8677-fa21b26add41 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:52:00.517268 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:00.523743 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-5e984dbc-6975-4f1a-9f5c-7fdb9bd8348c admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/c45a1ca8-d7b9-42f3-95b6-d637ede7202d HTTP/1.1" status: 204 len: 168 time: 0.4576261 Nov 02 12:52:00.559422 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5e984dbc-6975-4f1a-9f5c-7fdb9bd8348c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c45a1ca8-d7b9-42f3-95b6-d637ede7202d,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:00.569721 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-0740778a-4dca-46eb-9d98-d8d34b6099e1 admin admin] Router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108543) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 12:52:00.592457 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-8c068392-c900-4df7-a336-5dc990bc0709 req-3f3371f4-93f6-46cb-9ee3-4288b3a117df service neutron] For port 28651645-026f-45f9-aa05-0f14a102b65a, host hv-cinder-81632, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=28651645-026f-45f9-aa05-0f14a102b65a,segment=NetworkSegment(9918b664-73ec-4ba3-8b79-1b2dd2746c03),segment_id=9918b664-73ec-4ba3-8b79-1b2dd2746c03)] {{(pid=108543) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:52:00.676240 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-39d3de11-0d91-4fa8-9561-784855768bf7 req-96f4de95-af98-41cd-9d0f-66a870e168c5 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2692451 Nov 02 12:52:00.715005 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-ffe3b37f-4789-4a58-b0ba-1f89dfd93978 None None] Provisioning complete for port 80a55893-6272-4299-8834-e840aa37d37b triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:52:00.718433 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-ffe3b37f-4789-4a58-b0ba-1f89dfd93978 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:00.747531 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d9cb0558-0b56-49e2-a390-43295afb1bc9 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:00.750026 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-d9cb0558-0b56-49e2-a390-43295afb1bc9 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1811 time: 2.2259705 Nov 02 12:52:00.753037 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58424) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:00.761835 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-30ea75b5-ac61-4768-9a58-ba141ca825b3 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Request body: {'security_group_rule': {'security_group_id': '3c1edf2a-2914-43e2-b6b9-2b238c73ff68', 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:52:00.813911 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-8c068392-c900-4df7-a336-5dc990bc0709 req-3f3371f4-93f6-46cb-9ee3-4288b3a117df service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:00.817135 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d9cb0558-0b56-49e2-a390-43295afb1bc9 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Pushing event updated for resources: {'SecurityGroup': ['ID=3c1edf2a-2914-43e2-b6b9-2b238c73ff68,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:00.901044 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:00.913003 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-efe5f244-91c4-4745-a6db-8a9c172d49b9 req-f77db524-a0fe-44af-a959-3f77c4358fab tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:00.923321 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-efe5f244-91c4-4745-a6db-8a9c172d49b9 req-f77db524-a0fe-44af-a959-3f77c4358fab tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=78f23d67-5bb3-42d7-b7ea-79c832aab569 HTTP/1.1" status: 200 len: 943 time: 0.3783698 Nov 02 12:52:00.957393 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-30ea75b5-ac61-4768-9a58-ba141ca825b3 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:01.043427 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 8037c526-562d-44b7-8677-fa21b26add41, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=8037c526-562d-44b7-8677-fa21b26add41,segment=NetworkSegment(914624d2-b577-476c-8aac-4af5f5930ab2),segment_id=914624d2-b577-476c-8aac-4af5f5930ab2)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:52:01.052390 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:01.061343 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-ffe3b37f-4789-4a58-b0ba-1f89dfd93978 None None] Port 80a55893-6272-4299-8834-e840aa37d37b cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:52:01.158438 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:01.188846 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-30ea75b5-ac61-4768-9a58-ba141ca825b3 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:01.267934 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0728c579-5c92-4a63-a825-4e8e87813649 req-a34a370e-385c-43c9-8b73-111c3b243b07 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:01.271354 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-0728c579-5c92-4a63-a825-4e8e87813649 req-a34a370e-385c-43c9-8b73-111c3b243b07 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 1099 time: 0.1562698 Nov 02 12:52:01.296662 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=8037c526-562d-44b7-8677-fa21b26add41,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:01.355426 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-30ea75b5-ac61-4768-9a58-ba141ca825b3 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:01.425770 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-30ea75b5-ac61-4768-9a58-ba141ca825b3 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=1ad501cc-15fb-4418-9c97-8b30e43388ab,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:01.437556 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-0728c579-5c92-4a63-a825-4e8e87813649 req-7f4e3b89-8f82-4039-8c9d-bdf8072e3a34 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1486778 Nov 02 12:52:01.472832 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-30ea75b5-ac61-4768-9a58-ba141ca825b3 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:01.477403 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-30ea75b5-ac61-4768-9a58-ba141ca825b3 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.7209146 Nov 02 12:52:01.479254 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58432) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:01.502836 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-82070fdc-0c67-4025-98e8-3de26bc3816e tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Request body: {'security_group_rule': {'security_group_id': '3c1edf2a-2914-43e2-b6b9-2b238c73ff68', 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:52:01.625982 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-82070fdc-0c67-4025-98e8-3de26bc3816e tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:01.674007 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0740778a-4dca-46eb-9d98-d8d34b6099e1 admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108543) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:52:01.684707 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-0740778a-4dca-46eb-9d98-d8d34b6099e1 admin admin] 10.222.0.98 "PUT /v2.0/routers/2a2f63fd-e512-4ad2-9007-46e6ab6e8134/add_router_interface HTTP/1.1" status: 200 len: 503 time: 19.9658778 Nov 02 12:52:01.698083 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] Sync routers for ids ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'] in dv-cinder-816324-1-iscsi {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:52:01.738861 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c068392-c900-4df7-a336-5dc990bc0709 req-3f3371f4-93f6-46cb-9ee3-4288b3a117df service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:01.739605 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-8c068392-c900-4df7-a336-5dc990bc0709 req-3f3371f4-93f6-46cb-9ee3-4288b3a117df service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:01.741149 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8c068392-c900-4df7-a336-5dc990bc0709 req-3f3371f4-93f6-46cb-9ee3-4288b3a117df service neutron] 10.222.0.90 "PUT /v2.0/ports/28651645-026f-45f9-aa05-0f14a102b65a HTTP/1.1" status: 200 len: 1093 time: 5.7213411 Nov 02 12:52:01.749568 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '78f23d67-5bb3-42d7-b7ea-79c832aab569', 'tag': '28651645-026f-45f9-aa05-0f14a102b65a'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:52:01.754059 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-13e816cf-2846-4242-8837-78256889ef3a" -d '{"events": [{"name": "network-changed", "server_uuid": "78f23d67-5bb3-42d7-b7ea-79c832aab569", "tag": "28651645-026f-45f9-aa05-0f14a102b65a"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:52:01.795232 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-28cc8564-1e45-46d6-b564-c54f61b8ca6a req-b90c5fc0-9f6b-48ad-916f-0e86a8a40f2f tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:01.798247 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] Routers {'2a2f63fd-e512-4ad2-9007-46e6ab6e8134'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:52:01.801804 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:51:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:52:01.803925 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-28cc8564-1e45-46d6-b564-c54f61b8ca6a req-b90c5fc0-9f6b-48ad-916f-0e86a8a40f2f tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.98 "GET /v2.0/ports?device_id=8b94e21b-3dc3-4565-a6b9-bd394a3d15ee HTTP/1.1" status: 200 len: 949 time: 0.9624376 Nov 02 12:52:01.868995 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-efe5f244-91c4-4745-a6db-8a9c172d49b9 req-18f1668c-0e0a-41be-bcfd-be22d57c2007 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/security-groups?id=eadb1119-2269-4956-923b-c60da15e2d12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.9434292 Nov 02 12:52:01.872323 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7776fd8f-0141-4246-b48c-7e71d6161254 req-124d4c8e-913e-4b7e-a5e0-f2c39c0b4529 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:01.873107 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-82070fdc-0c67-4025-98e8-3de26bc3816e tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:01.893385 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7776fd8f-0141-4246-b48c-7e71d6161254 req-124d4c8e-913e-4b7e-a5e0-f2c39c0b4529 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=0d21bc42-7392-483d-b042-8c4ffea9a7f2 HTTP/1.1" status: 200 len: 1098 time: 0.9607313 Nov 02 12:52:01.906768 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f3371f4-93f6-46cb-9ee3-4288b3a117df service neutron] Pushing event updated for resources: {'Port': ['ID=28651645-026f-45f9-aa05-0f14a102b65a,revision_number=3']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:01.957920 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-28cc8564-1e45-46d6-b564-c54f61b8ca6a req-706e47ae-5c50-41e2-94d7-94d7d3cb5319 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.98 "GET /v2.0/security-groups?id=e08e9b2e-bc35-40ca-a7bb-1d6bfbdd9ad3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1508639 Nov 02 12:52:02.012619 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-82070fdc-0c67-4025-98e8-3de26bc3816e tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:02.076800 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82070fdc-0c67-4025-98e8-3de26bc3816e tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dcaea55b-daec-4772-b13a-2d1218f37be6,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:02.131809 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-82070fdc-0c67-4025-98e8-3de26bc3816e tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:02.133460 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-82070fdc-0c67-4025-98e8-3de26bc3816e tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.6503959 Nov 02 12:52:02.136224 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58442) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:02.150604 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-71736d50-5bc7-43f2-ac83-c184665eb8e4 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Request body: {'security_group_rule': {'security_group_id': '3c1edf2a-2914-43e2-b6b9-2b238c73ff68', 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:52:02.160723 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] Set router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:52:02.244664 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7776fd8f-0141-4246-b48c-7e71d6161254 req-9bf0323e-2dfb-49cb-8c80-4da2672bd8f1 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3393679 Nov 02 12:52:02.254528 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c068392-c900-4df7-a336-5dc990bc0709 req-ac54a4f8-6d5e-4e86-b24a-17611858823d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:02.255994 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8c068392-c900-4df7-a336-5dc990bc0709 req-ac54a4f8-6d5e-4e86-b24a-17611858823d service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=eeb1cb4c2b3844da903a64e77a350dab&device_id=78f23d67-5bb3-42d7-b7ea-79c832aab569 HTTP/1.1" status: 200 len: 1096 time: 0.2970455 Nov 02 12:52:02.284154 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40d932c8-127f-4236-9e80-89d324021bd2 req-5da10c9f-aaad-4778-9dfa-d93d7f9f9f77 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:02.285577 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-40d932c8-127f-4236-9e80-89d324021bd2 req-5da10c9f-aaad-4778-9dfa-d93d7f9f9f77 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=0d21bc42-7392-483d-b042-8c4ffea9a7f2 HTTP/1.1" status: 200 len: 945 time: 0.1967833 Nov 02 12:52:02.300017 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-71736d50-5bc7-43f2-ac83-c184665eb8e4 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:02.302673 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90f21f49-1577-4cd7-86fe-814efa84dbe0 req-41321024-816b-4625-8e51-593bb61cdb5c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:02.321102 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-90f21f49-1577-4cd7-86fe-814efa84dbe0 req-41321024-816b-4625-8e51-593bb61cdb5c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.1938565 Nov 02 12:52:02.432193 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8b94e21b-3dc3-4565-a6b9-bd394a3d15ee', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8037c526-562d-44b7-8677-fa21b26add41'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:52:02.436423 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7ad8d326-6ea0-4e3a-8f20-2df499b75f83" -d '{"events": [{"server_uuid": "8b94e21b-3dc3-4565-a6b9-bd394a3d15ee", "name": "network-vif-plugged", "status": "completed", "tag": "8037c526-562d-44b7-8677-fa21b26add41"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:52:02.439972 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-40d932c8-127f-4236-9e80-89d324021bd2 req-0807a5f8-86f2-4fc6-b207-29de63ec938a tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1104259 Nov 02 12:52:02.462079 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-90f21f49-1577-4cd7-86fe-814efa84dbe0 req-366ebbdb-297b-48aa-ae53-daf5102c7fda tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1396956 Nov 02 12:52:02.527258 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58450) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:02.547519 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-71736d50-5bc7-43f2-ac83-c184665eb8e4 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:02.637559 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:52:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0acd07b3-3b07-4a0c-a1f9-fde97132d59a x-openstack-request-id: req-0acd07b3-3b07-4a0c-a1f9-fde97132d59a {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:52:02.638018 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "78f23d67-5bb3-42d7-b7ea-79c832aab569", "tag": "28651645-026f-45f9-aa05-0f14a102b65a", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:52:02.638206 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-0acd07b3-3b07-4a0c-a1f9-fde97132d59a {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:52:02.638781 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '78f23d67-5bb3-42d7-b7ea-79c832aab569', 'tag': '28651645-026f-45f9-aa05-0f14a102b65a', 'status': 'completed', 'code': 200} Nov 02 12:52:02.640466 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-71736d50-5bc7-43f2-ac83-c184665eb8e4 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:02.668532 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8c068392-c900-4df7-a336-5dc990bc0709 req-f0689a73-520e-474b-ae49-add0191df6d8 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=28651645-026f-45f9-aa05-0f14a102b65a HTTP/1.1" status: 200 len: 217 time: 0.1984599 Nov 02 12:52:02.832098 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-71736d50-5bc7-43f2-ac83-c184665eb8e4 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=24133949-e900-4e33-af17-6ba9da8d515a,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:02.881343 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c068392-c900-4df7-a336-5dc990bc0709 req-d7d1f591-0b2d-4fe5-9aaa-1f56a26ec6fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:02.883165 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8c068392-c900-4df7-a336-5dc990bc0709 req-d7d1f591-0b2d-4fe5-9aaa-1f56a26ec6fe service neutron] 10.222.0.90 "GET /v2.0/subnets?id=2d4c8b31-ca6f-4edf-b0a6-e43793692679 HTTP/1.1" status: 200 len: 849 time: 0.2072649 Nov 02 12:52:02.901591 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-994177fa-0c3d-48e2-82f1-c0258f0e992f admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=cee4aadaaa1c4bfc9eab53171c863afc&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3633556 Nov 02 12:52:02.901853 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e07b46e6-e77e-4ba2-b295-f0a828f0bac8 req-e4fa8981-7ecb-4ad7-a6e5-8d434d43d068 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:02.902952 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e07b46e6-e77e-4ba2-b295-f0a828f0bac8 req-e4fa8981-7ecb-4ad7-a6e5-8d434d43d068 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.2629807 Nov 02 12:52:02.904538 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-71736d50-5bc7-43f2-ac83-c184665eb8e4 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:02.909059 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-71736d50-5bc7-43f2-ac83-c184665eb8e4 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.7691543 Nov 02 12:52:02.909059 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58454) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:02.912370 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58456) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:02.933657 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:52:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6af7d59c-35a7-4d3c-8cfe-67e5a1cf82a2 x-openstack-request-id: req-6af7d59c-35a7-4d3c-8cfe-67e5a1cf82a2 {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:52:02.933657 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8b94e21b-3dc3-4565-a6b9-bd394a3d15ee", "name": "network-vif-plugged", "status": "completed", "tag": "8037c526-562d-44b7-8677-fa21b26add41", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:52:02.933657 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-6af7d59c-35a7-4d3c-8cfe-67e5a1cf82a2 {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:52:02.933657 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8b94e21b-3dc3-4565-a6b9-bd394a3d15ee', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8037c526-562d-44b7-8677-fa21b26add41', 'code': 200} Nov 02 12:52:02.997988 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port': {'id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:1f:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:31Z', 'updated_at': '2021-11-02T12:51:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '80a55893-6272-4299-8834-e840aa37d37b', 'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'tenant_id': '697de566c0334435b902950f6f31da45', 'mac_address': 'fa:16:3e:64:ef:b6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_interface', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:48Z', 'updated_at': '2021-11-02T12:51:55Z', 'revision_number': 2, 'project_id': '697de566c0334435b902950f6f31da45', 'subnets': [{'id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:52:02.998412 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8c068392-c900-4df7-a336-5dc990bc0709 req-364c899e-c015-43c4-8ca9-9b8ce0c49904 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=cf53051c-17aa-4d08-a264-6c6ed50a7a96&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0797131 Nov 02 12:52:03.021764 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-108a90dd-7bcd-419e-bbf4-9ff4bb90ae66 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Request body: {'security_group_rule': {'security_group_id': '3c1edf2a-2914-43e2-b6b9-2b238c73ff68', 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:52:03.069169 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] Checking router: 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 for host: dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:52:03.077359 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] Updating router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 port 80a55893-6272-4299-8834-e840aa37d37b binding host dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 02 12:52:03.093911 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c1d4407f-c9bb-4fb3-b62f-e2e9a8a35903 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:03.131371 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:03.181140 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c1d4407f-c9bb-4fb3-b62f-e2e9a8a35903 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:03.228577 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-108a90dd-7bcd-419e-bbf4-9ff4bb90ae66 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:03.307513 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8c068392-c900-4df7-a336-5dc990bc0709 req-78cf280a-1a41-4955-b822-799f5f55eeba service neutron] 10.222.0.90 "GET /v2.0/networks/cf53051c-17aa-4d08-a264-6c6ed50a7a96?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2932475 Nov 02 12:52:03.391666 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-108a90dd-7bcd-419e-bbf4-9ff4bb90ae66 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:03.472149 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:03.482405 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e07b46e6-e77e-4ba2-b295-f0a828f0bac8 req-cede65f4-af32-44bd-8629-87fb5372a38b tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5778291 Nov 02 12:52:03.523589 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-108a90dd-7bcd-419e-bbf4-9ff4bb90ae66 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:03.593504 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-213ca1ce-abbb-47aa-a52a-ed0ced74ba75 req-8f52a0e1-16bb-42a3-9087-2d4bbd006568 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:03.594442 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c1d4407f-c9bb-4fb3-b62f-e2e9a8a35903 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:03.595888 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-213ca1ce-abbb-47aa-a52a-ed0ced74ba75 req-8f52a0e1-16bb-42a3-9087-2d4bbd006568 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=8b94e21b-3dc3-4565-a6b9-bd394a3d15ee HTTP/1.1" status: 200 len: 1103 time: 0.3398521 Nov 02 12:52:03.597621 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c1d4407f-c9bb-4fb3-b62f-e2e9a8a35903 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:03.602414 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-c1d4407f-c9bb-4fb3-b62f-e2e9a8a35903 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/4a97767b-fe4f-43f9-9a53-b3da5ead75fd HTTP/1.1" status: 204 len: 168 time: 0.6854465 Nov 02 12:52:03.613791 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-028e6efe-9705-4a0d-b9f5-039151696ffb req-0d3bd494-b6b5-4762-9de6-feffbe9e8fde tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:03.616113 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-028e6efe-9705-4a0d-b9f5-039151696ffb req-0d3bd494-b6b5-4762-9de6-feffbe9e8fde tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=78f23d67-5bb3-42d7-b7ea-79c832aab569 HTTP/1.1" status: 200 len: 943 time: 0.6209576 Nov 02 12:52:03.628152 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-108a90dd-7bcd-419e-bbf4-9ff4bb90ae66 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=032faee6-b24d-48ef-804f-258d7a8e13cf,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:03.661035 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1d4407f-c9bb-4fb3-b62f-e2e9a8a35903 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4a97767b-fe4f-43f9-9a53-b3da5ead75fd,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:03.702748 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-108a90dd-7bcd-419e-bbf4-9ff4bb90ae66 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:03.706698 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-108a90dd-7bcd-419e-bbf4-9ff4bb90ae66 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.7814987 Nov 02 12:52:03.706865 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58476) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:03.721702 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-0cc082c4-5ad3-4e03-a9f3-c7b1b1552e82 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Request body: {'security_group_rule': {'security_group_id': '3c1edf2a-2914-43e2-b6b9-2b238c73ff68', 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:52:03.795001 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58478) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:03.826774 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-1e7498ec-9f72-4f5b-8d6d-fa0d8fa884dd admin admin] Request body: {'network': {'name': 'tempest-TestVolumeBootPattern-1795464367-network', 'tenant_id': 'ba62faa6d50348199fe5a7f1ef451ddf'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:52:03.884526 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8c068392-c900-4df7-a336-5dc990bc0709 req-5c38dd7d-7ac3-434e-9b53-cf2fb5f81018 service neutron] 10.222.0.90 "GET /v2.0/networks/cf53051c-17aa-4d08-a264-6c6ed50a7a96?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5640733 Nov 02 12:52:03.905632 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-028e6efe-9705-4a0d-b9f5-039151696ffb req-bd665af4-ec8e-4793-aa6c-2f65d452f6df tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/security-groups?id=eadb1119-2269-4956-923b-c60da15e2d12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2382731 Nov 02 12:52:03.909801 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-213ca1ce-abbb-47aa-a52a-ed0ced74ba75 req-d278b3e6-59d0-44ec-a253-e088dc1986ee service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=e08e9b2e-bc35-40ca-a7bb-1d6bfbdd9ad3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2921700 Nov 02 12:52:03.951705 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-570cd13f-f8e5-4a61-bc4b-7b878824fbe4 req-e8d64839-6430-44cf-ac24-81da76a1c634 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:03.963464 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-570cd13f-f8e5-4a61-bc4b-7b878824fbe4 req-e8d64839-6430-44cf-ac24-81da76a1c634 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.98 "GET /v2.0/ports?device_id=8b94e21b-3dc3-4565-a6b9-bd394a3d15ee HTTP/1.1" status: 200 len: 950 time: 0.2872293 Nov 02 12:52:03.985795 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.db.securitygroups_db [None req-0cc082c4-5ad3-4e03-a9f3-c7b1b1552e82 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Project d3bf5c9bdd7f479aa4cbc28f9a007c81 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 02 12:52:04.023466 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-0cc082c4-5ad3-4e03-a9f3-c7b1b1552e82 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:04.067007 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] Publish callbacks [] for port, precommit_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:04.097227 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-1e7498ec-9f72-4f5b-8d6d-fa0d8fa884dd admin admin] Made reservation on behalf of ba62faa6d50348199fe5a7f1ef451ddf for: {'network': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:52:04.099908 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1e7498ec-9f72-4f5b-8d6d-fa0d8fa884dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for network, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:04.120631 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1e7498ec-9f72-4f5b-8d6d-fa0d8fa884dd admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:04.125014 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-0cc082c4-5ad3-4e03-a9f3-c7b1b1552e82 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:04.178764 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:04.192007 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-570cd13f-f8e5-4a61-bc4b-7b878824fbe4 req-f86d58ff-70bf-4172-80d8-bc5e99d4fce7 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.98 "GET /v2.0/security-groups?id=e08e9b2e-bc35-40ca-a7bb-1d6bfbdd9ad3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2273993 Nov 02 12:52:04.248130 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-0cc082c4-5ad3-4e03-a9f3-c7b1b1552e82 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:04.290216 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6904f78-4e8c-493a-8523-4a606bac23fe req-11352fd4-5481-4429-8a1d-d3eebbe993d2 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:04.300243 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d6904f78-4e8c-493a-8523-4a606bac23fe req-11352fd4-5481-4429-8a1d-d3eebbe993d2 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.2506423 Nov 02 12:52:04.322773 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13e816cf-2846-4242-8837-78256889ef3a req-e4878727-1d8d-4d8e-80c9-3c7441f131dc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:04.324876 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-13e816cf-2846-4242-8837-78256889ef3a req-e4878727-1d8d-4d8e-80c9-3c7441f131dc service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=eeb1cb4c2b3844da903a64e77a350dab&device_id=78f23d67-5bb3-42d7-b7ea-79c832aab569 HTTP/1.1" status: 200 len: 1096 time: 0.1793735 Nov 02 12:52:04.330802 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3b68cb4-6ee5-44d4-90ec-fae68373b98a None None] Pushing event updated for resources: {'Port': ['ID=80a55893-6272-4299-8834-e840aa37d37b,revision_number=3']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:04.349829 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1e7498ec-9f72-4f5b-8d6d-fa0d8fa884dd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:04.358906 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cc082c4-5ad3-4e03-a9f3-c7b1b1552e82 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=e7f62ad1-069f-4e98-b510-18d61d590348,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:04.440356 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] Attempting to bind port 80a55893-6272-4299-8834-e840aa37d37b on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:52:04.441184 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] Attempting to bind port 80a55893-6272-4299-8834-e840aa37d37b by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': 'c8ecb7dc-9cc8-47a7-94e7-62f066a97c10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1'}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:52:04.441679 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] Attempting to bind port 80a55893-6272-4299-8834-e840aa37d37b on network 89f406ae-1b9f-4be7-8881-87075d7c5aa1 {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:52:04.448379 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 52, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:52:04.448936 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] Checking segment: {'id': 'c8ecb7dc-9cc8-47a7-94e7-62f066a97c10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108544) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:52:04.449982 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:04.450756 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] Bound using segment: {'id': 'c8ecb7dc-9cc8-47a7-94e7-62f066a97c10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1'} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:52:04.451452 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] Bound port: 80a55893-6272-4299-8834-e840aa37d37b, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': 'c8ecb7dc-9cc8-47a7-94e7-62f066a97c10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1'}}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:52:04.451962 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:04.483965 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d6904f78-4e8c-493a-8523-4a606bac23fe req-5cf5f645-7c9c-4017-be6d-8b26dad80371 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1653054 Nov 02 12:52:04.515456 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eef861f0-0a19-4719-9b02-10fd69e1af3f req-1a1d03f4-eda8-4efc-823f-82e671ac48ee tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:04.518964 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-eef861f0-0a19-4719-9b02-10fd69e1af3f req-1a1d03f4-eda8-4efc-823f-82e671ac48ee tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=0d21bc42-7392-483d-b042-8c4ffea9a7f2 HTTP/1.1" status: 200 len: 945 time: 0.2121530 Nov 02 12:52:04.541046 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-0cc082c4-5ad3-4e03-a9f3-c7b1b1552e82 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:04.543983 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-0cc082c4-5ad3-4e03-a9f3-c7b1b1552e82 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.8343627 Nov 02 12:52:04.554521 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58490) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:04.563584 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-d592b03a-0cc2-4ade-9f6d-07ca133c586b tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Request body: {'security_group_rule': {'security_group_id': '3c1edf2a-2914-43e2-b6b9-2b238c73ff68', 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:52:04.575265 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1e7498ec-9f72-4f5b-8d6d-fa0d8fa884dd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:04.586228 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13e816cf-2846-4242-8837-78256889ef3a req-6bb82895-cb1b-4b3e-99f5-9741290a3db7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:04.597145 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-13e816cf-2846-4242-8837-78256889ef3a req-6bb82895-cb1b-4b3e-99f5-9741290a3db7 service neutron] 10.222.0.90 "GET /v2.0/networks?id=cf53051c-17aa-4d08-a264-6c6ed50a7a96 HTTP/1.1" status: 200 len: 910 time: 0.2422707 Nov 02 12:52:04.624559 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-1e7498ec-9f72-4f5b-8d6d-fa0d8fa884dd admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 882} {{(pid=108542) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 02 12:52:04.675089 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e7498ec-9f72-4f5b-8d6d-fa0d8fa884dd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=abbbc590-a7b1-4b96-8f08-5dc2dcd24e07,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:04.696748 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1e7498ec-9f72-4f5b-8d6d-fa0d8fa884dd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:04.700305 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.db.segments_db [None req-1e7498ec-9f72-4f5b-8d6d-fa0d8fa884dd admin admin] Added segment 3e37c0fd-0450-430c-9dfb-997dc0399ff6 of type vlan for network 9db25871-3a99-486f-97da-692e55836f96 Nov 02 12:52:04.725996 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-13e816cf-2846-4242-8837-78256889ef3a req-94c4448b-7c6d-482b-bf00-c6f0ac4cdb90 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=28651645-026f-45f9-aa05-0f14a102b65a HTTP/1.1" status: 200 len: 217 time: 0.1088061 Nov 02 12:52:04.750910 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] For port 80a55893-6272-4299-8834-e840aa37d37b, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108544) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:52:04.765097 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.db.securitygroups_db [None req-d592b03a-0cc2-4ade-9f6d-07ca133c586b tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Project d3bf5c9bdd7f479aa4cbc28f9a007c81 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 02 12:52:04.820388 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] For port 80a55893-6272-4299-8834-e840aa37d37b, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=80a55893-6272-4299-8834-e840aa37d37b,segment=NetworkSegment(c8ecb7dc-9cc8-47a7-94e7-62f066a97c10),segment_id=c8ecb7dc-9cc8-47a7-94e7-62f066a97c10)] {{(pid=108544) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:52:04.844523 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-eef861f0-0a19-4719-9b02-10fd69e1af3f req-ab881336-0ab0-4b3f-a499-3f74c0034a82 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2983754 Nov 02 12:52:04.853357 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-4d517711-a9a1-4241-a28b-23d8a22fbce1 None None] Provisioning complete for port 80a55893-6272-4299-8834-e840aa37d37b triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:52:04.853658 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-4d517711-a9a1-4241-a28b-23d8a22fbce1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:04.867145 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d592b03a-0cc2-4ade-9f6d-07ca133c586b tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:04.899425 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f92e381e-8d1d-469e-a068-3b5d36bf90c6 req-e02da7e9-79ad-499d-b210-ea0702dc70f7 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.1521702 Nov 02 12:52:04.924400 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-13e816cf-2846-4242-8837-78256889ef3a req-eb280fb9-05e7-4d5b-a76e-c1aa0be8528b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:04.933267 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-13e816cf-2846-4242-8837-78256889ef3a req-eb280fb9-05e7-4d5b-a76e-c1aa0be8528b service neutron] 10.222.0.90 "GET /v2.0/subnets?id=2d4c8b31-ca6f-4edf-b0a6-e43793692679 HTTP/1.1" status: 200 len: 849 time: 0.1789463 Nov 02 12:52:04.961496 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:04.969241 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1e7498ec-9f72-4f5b-8d6d-fa0d8fa884dd admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738449409639'] for network, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:05.034402 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-13e816cf-2846-4242-8837-78256889ef3a req-22c33102-7699-4070-9abd-a7319761b663 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=cf53051c-17aa-4d08-a264-6c6ed50a7a96&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0902202 Nov 02 12:52:05.042038 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-4d517711-a9a1-4241-a28b-23d8a22fbce1 None None] Port 80a55893-6272-4299-8834-e840aa37d37b cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:52:05.089602 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.db.resource_extend [None req-1e7498ec-9f72-4f5b-8d6d-fa0d8fa884dd admin admin] It took 0.11 seconds to run function 'neutron_lib.db.resource_extend.apply_funcs' {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_utils/timeutils.py:386}} Nov 02 12:52:05.099297 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3b68cb4-6ee5-44d4-90ec-fae68373b98a None None] Pushing event updated for resources: {'Port': ['ID=80a55893-6272-4299-8834-e840aa37d37b,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:05.099297 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] Routers {'2a2f63fd-e512-4ad2-9007-46e6ab6e8134'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:52:05.099297 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:51:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:52:05.354338 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d592b03a-0cc2-4ade-9f6d-07ca133c586b tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:05.419855 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] Set router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:52:05.507255 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1e7498ec-9f72-4f5b-8d6d-fa0d8fa884dd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for network, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:05.508860 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-1e7498ec-9f72-4f5b-8d6d-fa0d8fa884dd admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:05.510338 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1e7498ec-9f72-4f5b-8d6d-fa0d8fa884dd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:05.556168 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7911ec7c-14cf-4bbe-ae40-9a0400fec966 req-37817c26-6e2f-47e9-98b0-6f0283903aa6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:05.568406 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7911ec7c-14cf-4bbe-ae40-9a0400fec966 req-37817c26-6e2f-47e9-98b0-6f0283903aa6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.4997149 Nov 02 12:52:05.573634 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f92e381e-8d1d-469e-a068-3b5d36bf90c6 req-07ac6986-1241-4d43-8e7f-dc4b48e3219f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:05.577120 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f92e381e-8d1d-469e-a068-3b5d36bf90c6 req-07ac6986-1241-4d43-8e7f-dc4b48e3219f service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=28a90b1659054909ab64ba5320160f74&device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 1099 time: 0.6104465 Nov 02 12:52:05.585261 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d592b03a-0cc2-4ade-9f6d-07ca133c586b tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:05.659296 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d592b03a-0cc2-4ade-9f6d-07ca133c586b tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=19c5bc29-68f1-4d55-ba9d-eaafc129b2d5,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:05.662619 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1e7498ec-9f72-4f5b-8d6d-fa0d8fa884dd admin admin] Pushing event updated for resources: {'Network': ['ID=9db25871-3a99-486f-97da-692e55836f96,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:05.685730 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-1e7498ec-9f72-4f5b-8d6d-fa0d8fa884dd admin admin] 10.222.0.98 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.8862298 Nov 02 12:52:05.686480 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58520) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:05.691663 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-678ff30b-903a-4291-b607-1f1b5cd5f615 admin admin] Request body: {'subnet': {'network_id': '9db25871-3a99-486f-97da-692e55836f96', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestVolumeBootPattern-1795464367-subnet', 'tenant_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'ip_version': 4}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:52:05.750646 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d592b03a-0cc2-4ade-9f6d-07ca133c586b tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:05.761364 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-d592b03a-0cc2-4ade-9f6d-07ca133c586b tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 1.1955719 Nov 02 12:52:05.767863 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Network 9db25871-3a99-486f-97da-692e55836f96 details requested by agent ovs-agent-dv-cinder-816324-1-iscsi with host dv-cinder-816324-1-iscsi {{(pid=108544) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 02 12:52:05.789691 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-13e816cf-2846-4242-8837-78256889ef3a req-86f8acc6-eabf-4cf4-b15f-797191507a7d service neutron] 10.222.0.90 "GET /v2.0/networks/cf53051c-17aa-4d08-a264-6c6ed50a7a96?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.7184775 Nov 02 12:52:05.845204 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7911ec7c-14cf-4bbe-ae40-9a0400fec966 req-64aa7d07-9b47-48dd-85d3-7b0bb33bb47b tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2663891 Nov 02 12:52:05.859640 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-678ff30b-903a-4291-b607-1f1b5cd5f615 admin admin] Made reservation on behalf of ba62faa6d50348199fe5a7f1ef451ddf for: {'subnet': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:52:05.863253 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-678ff30b-903a-4291-b607-1f1b5cd5f615 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126185635'] for subnet, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:05.977761 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dc855702-1d95-4986-95fc-3dd63be87be9 req-992b49fc-7697-4909-acde-e59f940006b2 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:05.989158 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-dc855702-1d95-4986-95fc-3dd63be87be9 req-992b49fc-7697-4909-acde-e59f940006b2 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=78f23d67-5bb3-42d7-b7ea-79c832aab569 HTTP/1.1" status: 200 len: 943 time: 0.5725460 Nov 02 12:52:06.076635 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f92e381e-8d1d-469e-a068-3b5d36bf90c6 req-e196a881-ea92-4e8d-94f0-e73be77fbf4c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:06.079592 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f92e381e-8d1d-469e-a068-3b5d36bf90c6 req-e196a881-ea92-4e8d-94f0-e73be77fbf4c service neutron] 10.222.0.90 "GET /v2.0/networks?id=c965eaf1-5fb6-4689-8b12-fa3913e4f081 HTTP/1.1" status: 200 len: 920 time: 0.4458265 Nov 02 12:52:06.112277 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-13e816cf-2846-4242-8837-78256889ef3a req-f60750dc-4566-4df3-ab68-1e66ff98118b service neutron] 10.222.0.90 "GET /v2.0/networks/cf53051c-17aa-4d08-a264-6c6ed50a7a96?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2837105 Nov 02 12:52:06.162345 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-dc855702-1d95-4986-95fc-3dd63be87be9 req-df9af914-9e90-4be9-a2f9-884786e2bdc7 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/security-groups?id=eadb1119-2269-4956-923b-c60da15e2d12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1716754 Nov 02 12:52:06.166292 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f92e381e-8d1d-469e-a068-3b5d36bf90c6 req-9fba70f5-3a66-4516-a93f-f2f1e597515c service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d32b527e-e041-40dd-b3b1-a7c080a56c87 HTTP/1.1" status: 200 len: 217 time: 0.0719137 Nov 02 12:52:06.288310 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f92e381e-8d1d-469e-a068-3b5d36bf90c6 req-7fafcd9a-d862-4d47-9555-65ea792b0c90 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:06.290999 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f92e381e-8d1d-469e-a068-3b5d36bf90c6 req-7fafcd9a-d862-4d47-9555-65ea792b0c90 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=b29075d9-9995-4f6f-8ebd-8f7d748977ef HTTP/1.1" status: 200 len: 859 time: 0.1155484 Nov 02 12:52:06.344543 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f92e381e-8d1d-469e-a068-3b5d36bf90c6 req-e6b4a948-02a5-4f12-b3bd-06c19e9b748c service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=c965eaf1-5fb6-4689-8b12-fa3913e4f081&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0331247 Nov 02 12:52:06.364998 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 28651645-026f-45f9-aa05-0f14a102b65a details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 12:52:06.386412 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-45f17237-4fb4-4a88-b772-9b895e3ad639 None None] Provisioning complete for port 80a55893-6272-4299-8834-e840aa37d37b triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:52:06.389566 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-45f17237-4fb4-4a88-b772-9b895e3ad639 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:06.440500 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c84cd611-682b-477d-9f73-446dac4373c5 req-acae79a0-4ea4-4446-8392-28cd2ebfa3ee tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:06.448796 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c84cd611-682b-477d-9f73-446dac4373c5 req-acae79a0-4ea4-4446-8392-28cd2ebfa3ee tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.98 "GET /v2.0/ports?device_id=8b94e21b-3dc3-4565-a6b9-bd394a3d15ee HTTP/1.1" status: 200 len: 950 time: 0.1804221 Nov 02 12:52:06.826401 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-678ff30b-903a-4291-b607-1f1b5cd5f615 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126478280', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126185617'] for subnet, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:06.942558 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c84cd611-682b-477d-9f73-446dac4373c5 req-89f382c6-94e8-4b29-99e7-f69657e82f5f tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.98 "GET /v2.0/security-groups?id=e08e9b2e-bc35-40ca-a7bb-1d6bfbdd9ad3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4925756 Nov 02 12:52:06.964484 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f92e381e-8d1d-469e-a068-3b5d36bf90c6 req-04b183ea-2650-4b90-a11e-e932ef75ae47 service neutron] 10.222.0.90 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.6110733 Nov 02 12:52:07.030667 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 28651645-026f-45f9-aa05-0f14a102b65a, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=28651645-026f-45f9-aa05-0f14a102b65a,segment=NetworkSegment(9918b664-73ec-4ba3-8b79-1b2dd2746c03),segment_id=9918b664-73ec-4ba3-8b79-1b2dd2746c03)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:52:07.033008 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-678ff30b-903a-4291-b607-1f1b5cd5f615 admin admin] Pushing event updated for resources: {'Subnet': ['ID=236de1ed-65f6-4f82-93a7-8c065c469c7f,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:07.060443 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-678ff30b-903a-4291-b607-1f1b5cd5f615 admin admin] Checking segment: {'id': '3e37c0fd-0450-430c-9dfb-997dc0399ff6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '9db25871-3a99-486f-97da-692e55836f96'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108542) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:52:07.065141 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-678ff30b-903a-4291-b607-1f1b5cd5f615 admin admin] Network hostable DHCP agents. Network: 9db25871-3a99-486f-97da-692e55836f96, hostable agents: ['1b947f40-f8bf-4088-a5dc-35ee29d90d78'], hosted agents: [] {{(pid=108542) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 02 12:52:07.102880 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': '28651645-026f-45f9-aa05-0f14a102b65a', 'network_id': 'cf53051c-17aa-4d08-a264-6c6ed50a7a96', 'port_id': '28651645-026f-45f9-aa05-0f14a102b65a', 'mac_address': 'fa:16:3e:28:ab:0b', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 889, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '2d4c8b31-ca6f-4edf-b0a6-e43793692679', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 12:52:07.113648 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-45f17237-4fb4-4a88-b772-9b895e3ad639 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:07.180519 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-678ff30b-903a-4291-b607-1f1b5cd5f615 admin admin] Network 9db25871-3a99-486f-97da-692e55836f96 is scheduled to be hosted by DHCP agent 1b947f40-f8bf-4088-a5dc-35ee29d90d78 with binding_index 1 {{(pid=108542) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 02 12:52:07.200165 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port': {'id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:1f:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:31Z', 'updated_at': '2021-11-02T12:51:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '80a55893-6272-4299-8834-e840aa37d37b', 'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'tenant_id': '697de566c0334435b902950f6f31da45', 'mac_address': 'fa:16:3e:64:ef:b6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_interface', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:48Z', 'updated_at': '2021-11-02T12:52:04Z', 'revision_number': 4, 'project_id': '697de566c0334435b902950f6f31da45', 'subnets': [{'id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:52:07.263906 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-678ff30b-903a-4291-b607-1f1b5cd5f615 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816324-1-iscsi, 9db25871-3a99-486f-97da-692e55836f96) {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:52:07.268875 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-678ff30b-903a-4291-b607-1f1b5cd5f615 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:07.269661 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-678ff30b-903a-4291-b607-1f1b5cd5f615 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:07.288177 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-45f17237-4fb4-4a88-b772-9b895e3ad639 None None] For port 80a55893-6272-4299-8834-e840aa37d37b, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=80a55893-6272-4299-8834-e840aa37d37b,segment=NetworkSegment(c8ecb7dc-9cc8-47a7-94e7-62f066a97c10),segment_id=c8ecb7dc-9cc8-47a7-94e7-62f066a97c10)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:52:07.297022 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-3ff29235-3c52-4083-b994-e91a00e0032c None None] Network 9db25871-3a99-486f-97da-692e55836f96 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:52:07.298080 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f114abf6-a687-4d78-9f3f-90752cbe9fea req-d0d2005b-b2b9-45fc-8b46-d615ee795e5c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:07.311488 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f114abf6-a687-4d78-9f3f-90752cbe9fea req-d0d2005b-b2b9-45fc-8b46-d615ee795e5c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.2369878 Nov 02 12:52:07.370925 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f92e381e-8d1d-469e-a068-3b5d36bf90c6 req-4c1518c3-0732-4ff1-94e3-bb061619350f service neutron] 10.222.0.90 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.3969417 Nov 02 12:52:07.417626 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-bfdd57be-34c3-4a3d-ad50-85c8520af1d9 None None] The sync data for ids ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'] in dv-cinder-816324-1-iscsi is: [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port': {'id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:1f:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:31Z', 'updated_at': '2021-11-02T12:51:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '80a55893-6272-4299-8834-e840aa37d37b', 'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'tenant_id': '697de566c0334435b902950f6f31da45', 'mac_address': 'fa:16:3e:64:ef:b6', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_interface', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:48Z', 'updated_at': '2021-11-02T12:52:04Z', 'revision_number': 4, 'project_id': '697de566c0334435b902950f6f31da45', 'subnets': [{'id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:52:07.428510 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-678ff30b-903a-4291-b607-1f1b5cd5f615 admin admin] 10.222.0.98 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 848 time: 1.7407663 Nov 02 12:52:07.437495 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58590) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:07.440274 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-9ce1eb8a-c8b4-4108-8250-b2b1241f3bdd admin admin] Request body: {'router': {'name': 'tempest-TestVolumeBootPattern-1795464367-router', 'tenant_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:52:07.555391 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-45f17237-4fb4-4a88-b772-9b895e3ad639 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:07.558822 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f114abf6-a687-4d78-9f3f-90752cbe9fea req-35a9deac-d3b0-4d4a-92eb-d622e8edced3 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2457237 Nov 02 12:52:07.566467 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:07.597200 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-9ce1eb8a-c8b4-4108-8250-b2b1241f3bdd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1593342', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-25677'] for router, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:07.598642 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-9ce1eb8a-c8b4-4108-8250-b2b1241f3bdd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1593154', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1595081', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1973616', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-25716'] for router, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:07.687176 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 28651645-026f-45f9-aa05-0f14a102b65a {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:52:07.721821 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66528eee-f51a-44f1-9aae-891db16319fe req-6f4249cb-ca10-4e67-a069-b0e2dc7d5fd6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:07.724690 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-66528eee-f51a-44f1-9aae-891db16319fe req-6f4249cb-ca10-4e67-a069-b0e2dc7d5fd6 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=28a90b1659054909ab64ba5320160f74&device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 1099 time: 0.1065788 Nov 02 12:52:07.729402 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 28651645-026f-45f9-aa05-0f14a102b65a, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=28651645-026f-45f9-aa05-0f14a102b65a,segment=NetworkSegment(9918b664-73ec-4ba3-8b79-1b2dd2746c03),segment_id=9918b664-73ec-4ba3-8b79-1b2dd2746c03)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:52:07.753258 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4e0f87e-4da1-4322-8a80-2c7012a2f498 req-b9f56ad1-2335-4c42-9ba0-c95990e1c676 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:07.757898 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f4e0f87e-4da1-4322-8a80-2c7012a2f498 req-b9f56ad1-2335-4c42-9ba0-c95990e1c676 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.3283892 Nov 02 12:52:07.771114 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-9ce1eb8a-c8b4-4108-8250-b2b1241f3bdd admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:07.862349 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-ce12e8cd-9139-42ea-b77e-b6af6be22052 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp94ac73f7-a43e-5b43-a0b7-503cbb5c76bd-9db25871-3a99-486f-97da-692e55836f96', 'network_id': '9db25871-3a99-486f-97da-692e55836f96', 'tenant_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'fixed_ips': [{'subnet_id': '236de1ed-65f6-4f82-93a7-8c065c469c7f'}]}} from dv-cinder-816324-1-iscsi. {{(pid=108544) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 02 12:52:07.864261 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-ce12e8cd-9139-42ea-b77e-b6af6be22052 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:07.883058 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:07.920135 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45f17237-4fb4-4a88-b772-9b895e3ad639 None None] Pushing event updated for resources: {'Port': ['ID=80a55893-6272-4299-8834-e840aa37d37b,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:07.961803 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66528eee-f51a-44f1-9aae-891db16319fe req-28d6d9d7-06de-47c3-99a6-7c829a42ffab service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:07.966935 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-66528eee-f51a-44f1-9aae-891db16319fe req-28d6d9d7-06de-47c3-99a6-7c829a42ffab service neutron] 10.222.0.90 "GET /v2.0/networks?id=c965eaf1-5fb6-4689-8b12-fa3913e4f081 HTTP/1.1" status: 200 len: 920 time: 0.2052336 Nov 02 12:52:08.242003 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-66528eee-f51a-44f1-9aae-891db16319fe req-2bc1b7cf-6380-4b99-9191-01e0e1ffe3ba service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.11&port_id=d32b527e-e041-40dd-b3b1-a7c080a56c87 HTTP/1.1" status: 200 len: 217 time: 0.2684472 Nov 02 12:52:08.339332 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-9ce1eb8a-c8b4-4108-8250-b2b1241f3bdd admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:08.552782 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f4e0f87e-4da1-4322-8a80-2c7012a2f498 req-56f6216e-52aa-4505-b612-8b51227525f4 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.5778220 Nov 02 12:52:08.572181 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66528eee-f51a-44f1-9aae-891db16319fe req-1aed25ff-2186-43a2-b44d-63bdd8c4774b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:08.579608 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-66528eee-f51a-44f1-9aae-891db16319fe req-1aed25ff-2186-43a2-b44d-63bdd8c4774b service neutron] 10.222.0.90 "GET /v2.0/subnets?id=b29075d9-9995-4f6f-8ebd-8f7d748977ef HTTP/1.1" status: 200 len: 859 time: 0.3279016 Nov 02 12:52:08.660887 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 80a55893-6272-4299-8834-e840aa37d37b up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:52:08.682704 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-66528eee-f51a-44f1-9aae-891db16319fe req-a60d6ada-0749-4ffa-bacb-855712bd3eaa service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=c965eaf1-5fb6-4689-8b12-fa3913e4f081&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0941763 Nov 02 12:52:08.860525 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['28651645-026f-45f9-aa05-0f14a102b65a'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:52:08.907228 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-66528eee-f51a-44f1-9aae-891db16319fe req-fe8dd083-b9b5-4102-b21c-578253f21212 service neutron] 10.222.0.90 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2164435 Nov 02 12:52:09.073837 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=28651645-026f-45f9-aa05-0f14a102b65a,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:09.147523 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.db_base_plugin_common [None req-ce12e8cd-9139-42ea-b77e-b6af6be22052 None None] Allocated IP 172.20.0.2 (9db25871-3a99-486f-97da-692e55836f96/236de1ed-65f6-4f82-93a7-8c065c469c7f/00f385af-6f0c-44fb-969a-cdf46435a745) {{(pid=108544) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:52:09.171585 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 80a55893-6272-4299-8834-e840aa37d37b triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:52:09.177348 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:09.221428 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-66528eee-f51a-44f1-9aae-891db16319fe req-bc4467d9-0dde-483c-86b0-508feabdfcc6 service neutron] 10.222.0.90 "GET /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2875237 Nov 02 12:52:09.301932 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-9ce1eb8a-c8b4-4108-8250-b2b1241f3bdd admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:09.360806 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-9ce1eb8a-c8b4-4108-8250-b2b1241f3bdd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:09.369177 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a350789-fe8d-4337-8400-5f34a6130cdb req-9699ba33-90bb-4035-82da-817e6e91a0a8 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:09.377907 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3a350789-fe8d-4337-8400-5f34a6130cdb req-9699ba33-90bb-4035-82da-817e6e91a0a8 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=78f23d67-5bb3-42d7-b7ea-79c832aab569 HTTP/1.1" status: 200 len: 944 time: 0.4692526 Nov 02 12:52:09.607741 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3a350789-fe8d-4337-8400-5f34a6130cdb req-533073f0-e1f1-426d-a4ec-ea4451ee5389 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/security-groups?id=eadb1119-2269-4956-923b-c60da15e2d12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2265625 Nov 02 12:52:09.753436 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_common [None req-9ce1eb8a-c8b4-4108-8250-b2b1241f3bdd admin admin] Allocated IP 172.27.0.101 (43464fa8-eb00-46fb-9ca0-be7342f9ddbf/44a807bc-f2b6-41f0-b765-e5d3393fe305/3248239a-54d8-4ba4-81f9-a3fa983dd829) {{(pid=108542) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:52:09.772474 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c12f18be-8498-495e-8b2e-5f8e07c26b73 req-3f79aa33-70b1-4beb-a0a1-e9e82ef56d2e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:09.785531 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c12f18be-8498-495e-8b2e-5f8e07c26b73 req-3f79aa33-70b1-4beb-a0a1-e9e82ef56d2e tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.5265524 Nov 02 12:52:09.905752 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-ce12e8cd-9139-42ea-b77e-b6af6be22052 None None] Publish callbacks [] for port, precommit_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:09.985836 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-9ce1eb8a-c8b4-4108-8250-b2b1241f3bdd admin admin] Publish callbacks [] for port, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:10.014860 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-ce12e8cd-9139-42ea-b77e-b6af6be22052 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669'] for port, after_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:10.062437 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ce12e8cd-9139-42ea-b77e-b6af6be22052 None None] Network 9db25871-3a99-486f-97da-692e55836f96 is already hosted by enough agents. {{(pid=108544) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:52:10.065972 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.scheduler.base_scheduler [None req-ce12e8cd-9139-42ea-b77e-b6af6be22052 None None] Resources bound (agent type, host, resource id): {{(pid=108544) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:52:10.073286 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ce12e8cd-9139-42ea-b77e-b6af6be22052 None None] Received port after_create {{(pid=108544) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:52:10.117483 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-9ce1eb8a-c8b4-4108-8250-b2b1241f3bdd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:10.144468 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce12e8cd-9139-42ea-b77e-b6af6be22052 None None] Pushing event updated for resources: {'Port': ['ID=00f385af-6f0c-44fb-969a-cdf46435a745,revision_number=1']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:10.169998 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-9ce1eb8a-c8b4-4108-8250-b2b1241f3bdd admin admin] Network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:52:10.186610 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-ce12e8cd-9139-42ea-b77e-b6af6be22052 None None] Attempting to bind port 00f385af-6f0c-44fb-969a-cdf46435a745 on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:52:10.205788 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-ce12e8cd-9139-42ea-b77e-b6af6be22052 None None] Attempting to bind port 00f385af-6f0c-44fb-969a-cdf46435a745 by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': '3e37c0fd-0450-430c-9dfb-997dc0399ff6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '9db25871-3a99-486f-97da-692e55836f96'}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:52:10.205788 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce12e8cd-9139-42ea-b77e-b6af6be22052 None None] Attempting to bind port 00f385af-6f0c-44fb-969a-cdf46435a745 on network 9db25871-3a99-486f-97da-692e55836f96 {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:52:10.207474 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-9ce1eb8a-c8b4-4108-8250-b2b1241f3bdd admin admin] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:52:10.207474 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9ce1eb8a-c8b4-4108-8250-b2b1241f3bdd admin admin] Received port after_create {{(pid=108542) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:52:10.207735 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce12e8cd-9139-42ea-b77e-b6af6be22052 None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 52, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:52:10.207735 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce12e8cd-9139-42ea-b77e-b6af6be22052 None None] Checking segment: {'id': '3e37c0fd-0450-430c-9dfb-997dc0399ff6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '9db25871-3a99-486f-97da-692e55836f96'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108544) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:52:10.207735 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-ce12e8cd-9139-42ea-b77e-b6af6be22052 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:10.207735 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-ce12e8cd-9139-42ea-b77e-b6af6be22052 None None] Bound using segment: {'id': '3e37c0fd-0450-430c-9dfb-997dc0399ff6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '9db25871-3a99-486f-97da-692e55836f96'} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:52:10.207735 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-ce12e8cd-9139-42ea-b77e-b6af6be22052 None None] Bound port: 00f385af-6f0c-44fb-969a-cdf46435a745, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3e37c0fd-0450-430c-9dfb-997dc0399ff6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '9db25871-3a99-486f-97da-692e55836f96'}}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:52:10.207735 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-ce12e8cd-9139-42ea-b77e-b6af6be22052 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:10.232698 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ce1eb8a-c8b4-4108-8250-b2b1241f3bdd admin admin] Pushing event updated for resources: {'Port': ['ID=3248239a-54d8-4ba4-81f9-a3fa983dd829,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:10.262480 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c12f18be-8498-495e-8b2e-5f8e07c26b73 req-2a2d6413-67c9-4d0a-b7f9-d5dfd1244422 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.4677918 Nov 02 12:52:10.283644 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-ce12e8cd-9139-42ea-b77e-b6af6be22052 None None] For port 00f385af-6f0c-44fb-969a-cdf46435a745, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108544) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:52:10.288976 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-ce12e8cd-9139-42ea-b77e-b6af6be22052 None None] For port 00f385af-6f0c-44fb-969a-cdf46435a745, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=00f385af-6f0c-44fb-969a-cdf46435a745,segment=NetworkSegment(3e37c0fd-0450-430c-9dfb-997dc0399ff6),segment_id=3e37c0fd-0450-430c-9dfb-997dc0399ff6)] {{(pid=108544) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:52:10.302313 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4cd2930-25aa-403a-b833-1d34a21241ca req-557b6a15-b9d7-46b3-8b42-49e323e7a812 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:10.306995 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c4cd2930-25aa-403a-b833-1d34a21241ca req-557b6a15-b9d7-46b3-8b42-49e323e7a812 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.98 "GET /v2.0/ports?device_id=8b94e21b-3dc3-4565-a6b9-bd394a3d15ee HTTP/1.1" status: 200 len: 950 time: 0.1183114 Nov 02 12:52:10.460257 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c4cd2930-25aa-403a-b833-1d34a21241ca req-55ddf7bd-0f4f-4e9d-99c3-3851d60d6351 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.98 "GET /v2.0/security-groups?id=e08e9b2e-bc35-40ca-a7bb-1d6bfbdd9ad3&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1392219 Nov 02 12:52:10.473793 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-188bbc70-e299-424f-87bd-cf0643a7e3b3 req-c3f2eaac-9552-4296-b06a-f11a8bb537d9 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:10.484328 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-188bbc70-e299-424f-87bd-cf0643a7e3b3 req-c3f2eaac-9552-4296-b06a-f11a8bb537d9 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.90 "GET /v2.0/ports?device_id=8b94e21b-3dc3-4565-a6b9-bd394a3d15ee HTTP/1.1" status: 200 len: 950 time: 0.1676764 Nov 02 12:52:10.498507 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-49cc9e89-d3e3-420b-8103-5e4d6895068a req-093ca7a1-5abe-4230-954a-93efad802760 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:10.500185 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-49cc9e89-d3e3-420b-8103-5e4d6895068a req-093ca7a1-5abe-4230-954a-93efad802760 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.1425297 Nov 02 12:52:10.637813 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-49cc9e89-d3e3-420b-8103-5e4d6895068a req-0371b2d6-02c9-4d27-b013-93c894347e14 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1287723 Nov 02 12:52:10.667104 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-188bbc70-e299-424f-87bd-cf0643a7e3b3 req-faf50f13-3639-488a-81a5-dc10fc492db4 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Deleting port 8037c526-562d-44b7-8677-fa21b26add41 {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:52:10.667488 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-188bbc70-e299-424f-87bd-cf0643a7e3b3 req-faf50f13-3639-488a-81a5-dc10fc492db4 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:10.671373 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-ce12e8cd-9139-42ea-b77e-b6af6be22052 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:10.742596 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ce12e8cd-9139-42ea-b77e-b6af6be22052 None None] Pushing event updated for resources: {'Port': ['ID=00f385af-6f0c-44fb-969a-cdf46435a745,revision_number=2']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:10.876977 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-188bbc70-e299-424f-87bd-cf0643a7e3b3 req-faf50f13-3639-488a-81a5-dc10fc492db4 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] For port 8037c526-562d-44b7-8677-fa21b26add41, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=8037c526-562d-44b7-8677-fa21b26add41,segment=NetworkSegment(914624d2-b577-476c-8aac-4af5f5930ab2),segment_id=914624d2-b577-476c-8aac-4af5f5930ab2)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:52:10.877418 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-188bbc70-e299-424f-87bd-cf0643a7e3b3 req-faf50f13-3639-488a-81a5-dc10fc492db4 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:11.009497 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-188bbc70-e299-424f-87bd-cf0643a7e3b3 req-faf50f13-3639-488a-81a5-dc10fc492db4 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Calling delete_port for 8037c526-562d-44b7-8677-fa21b26add41 owned by compute:nova {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:52:11.059224 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-9ce1eb8a-c8b4-4108-8250-b2b1241f3bdd admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:11.189696 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f77a4c0-ed28-4c44-90d6-481ab9aea9a5 req-5858743d-6150-413b-98e0-d3b6772cbea6 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:11.196123 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6f77a4c0-ed28-4c44-90d6-481ab9aea9a5 req-5858743d-6150-413b-98e0-d3b6772cbea6 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=78f23d67-5bb3-42d7-b7ea-79c832aab569 HTTP/1.1" status: 200 len: 944 time: 0.2978921 Nov 02 12:52:11.373885 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6f77a4c0-ed28-4c44-90d6-481ab9aea9a5 req-4dec255c-b5f4-4a23-b28e-98e735b60f06 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/security-groups?id=eadb1119-2269-4956-923b-c60da15e2d12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1621680 Nov 02 12:52:11.546497 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-9ce1eb8a-c8b4-4108-8250-b2b1241f3bdd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1593163', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1595034'] for router, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:11.585588 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ade35174-4ba0-45ba-bfff-6133ec969ebf req-cc98944f-c7ae-478d-9b93-262f07577b87 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:11.591099 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ade35174-4ba0-45ba-bfff-6133ec969ebf req-cc98944f-c7ae-478d-9b93-262f07577b87 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.0708475 Nov 02 12:52:11.617709 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-188bbc70-e299-424f-87bd-cf0643a7e3b3 req-faf50f13-3639-488a-81a5-dc10fc492db4 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:11.633751 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['8037c526-562d-44b7-8677-fa21b26add41'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:52:11.717981 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-faf50f13-3639-488a-81a5-dc10fc492db4 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Pushing event deleted for resources: {'Port': ['ID=8037c526-562d-44b7-8677-fa21b26add41,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:11.755782 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-faf50f13-3639-488a-81a5-dc10fc492db4 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:52:11.755782 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-faf50f13-3639-488a-81a5-dc10fc492db4 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:52:11.760364 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-faf50f13-3639-488a-81a5-dc10fc492db4 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:52:11.760818 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-faf50f13-3639-488a-81a5-dc10fc492db4 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:52:11.761579 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-faf50f13-3639-488a-81a5-dc10fc492db4 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:52:11.761711 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-faf50f13-3639-488a-81a5-dc10fc492db4 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:52:11.764820 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-faf50f13-3639-488a-81a5-dc10fc492db4 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:52:11.765763 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-faf50f13-3639-488a-81a5-dc10fc492db4 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:52:11.766113 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-faf50f13-3639-488a-81a5-dc10fc492db4 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:52:11.766474 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-faf50f13-3639-488a-81a5-dc10fc492db4 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:52:11.766808 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-faf50f13-3639-488a-81a5-dc10fc492db4 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:52:11.767133 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-faf50f13-3639-488a-81a5-dc10fc492db4 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:52:11.836331 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9ce1eb8a-c8b4-4108-8250-b2b1241f3bdd admin admin] Router 7136daee-e271-4adc-ae87-6a06dffa51dd is scheduled to L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc with binding_index 1 {{(pid=108542) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 02 12:52:11.846084 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-188bbc70-e299-424f-87bd-cf0643a7e3b3 req-faf50f13-3639-488a-81a5-dc10fc492db4 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] No DVR routers for this DVR port 8037c526-562d-44b7-8677-fa21b26add41 on host hv-cinder-81632 {{(pid=108543) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 12:52:11.849199 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-188bbc70-e299-424f-87bd-cf0643a7e3b3 req-faf50f13-3639-488a-81a5-dc10fc492db4 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:11.853548 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-188bbc70-e299-424f-87bd-cf0643a7e3b3 req-faf50f13-3639-488a-81a5-dc10fc492db4 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.90 "DELETE /v2.0/ports/8037c526-562d-44b7-8677-fa21b26add41 HTTP/1.1" status: 204 len: 173 time: 1.3515985 Nov 02 12:52:11.855221 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '8b94e21b-3dc3-4565-a6b9-bd394a3d15ee', 'name': 'network-vif-deleted', 'tag': '8037c526-562d-44b7-8677-fa21b26add41'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:52:11.859648 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fa010ab4-9594-4845-8a2d-bf8756a29629" -d '{"events": [{"server_uuid": "8b94e21b-3dc3-4565-a6b9-bd394a3d15ee", "name": "network-vif-deleted", "tag": "8037c526-562d-44b7-8677-fa21b26add41"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:52:11.883988 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ade35174-4ba0-45ba-bfff-6133ec969ebf req-f5c84fbc-d0a0-4772-912e-ab80aeb54123 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2800174 Nov 02 12:52:12.090736 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-158b2d0a-d87b-4bc6-b74a-0e7b131993f6 req-c4a54b71-bd94-4242-8865-47c325a37bb5 tempest-VolumesNegativeTest-1864120975 tempest-VolumesNegativeTest-1864120975-project] 10.222.0.98 "GET /v2.0/ports?device_id=8b94e21b-3dc3-4565-a6b9-bd394a3d15ee HTTP/1.1" status: 200 len: 210 time: 0.0843301 Nov 02 12:52:12.103013 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9ce1eb8a-c8b4-4108-8250-b2b1241f3bdd admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108542) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:52:12.114656 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] Sync routers for ids ['7136daee-e271-4adc-ae87-6a06dffa51dd'] in dv-cinder-816324-1-iscsi {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:52:12.156112 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] Routers {'7136daee-e271-4adc-ae87-6a06dffa51dd'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:52:12.157116 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:51:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['7136daee-e271-4adc-ae87-6a06dffa51dd'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:52:12.172660 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 28651645-026f-45f9-aa05-0f14a102b65a up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:52:12.308404 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-9ce1eb8a-c8b4-4108-8250-b2b1241f3bdd admin admin] Publish callbacks [] for router, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:12.312519 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-9ce1eb8a-c8b4-4108-8250-b2b1241f3bdd admin admin] 10.222.0.98 "POST /v2.0/routers HTTP/1.1" status: 201 len: 924 time: 4.8796043 Nov 02 12:52:12.328490 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58668) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:12.347639 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] Set router 7136daee-e271-4adc-ae87-6a06dffa51dd gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:52:12.399000 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 00f385af-6f0c-44fb-969a-cdf46435a745 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:52:12.449362 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-470f881c-ada3-4bca-8b62-3730782c9128 req-f27000d8-86cd-467c-8222-80c7f8038b0d tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:12.462200 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-470f881c-ada3-4bca-8b62-3730782c9128 req-f27000d8-86cd-467c-8222-80c7f8038b0d tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.2229543 Nov 02 12:52:12.480544 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 00f385af-6f0c-44fb-969a-cdf46435a745 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:52:12.483901 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:12.565366 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-470f881c-ada3-4bca-8b62-3730782c9128 req-8d640ec5-a8fc-4a8e-bc51-0260cf9912d8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1018794 Nov 02 12:52:12.577703 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning for port 28651645-026f-45f9-aa05-0f14a102b65a completed by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 02 12:52:12.584196 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port 28651645-026f-45f9-aa05-0f14a102b65a triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:52:12.584784 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:12.635742 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7136daee-e271-4adc-ae87-6a06dffa51dd', 'name': 'tempest-TestVolumeBootPattern-1795464367-router', 'tenant_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.101'}], 'enable_snat': True}, 'gw_port_id': '3248239a-54d8-4ba4-81f9-a3fa983dd829', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:52:07Z', 'updated_at': '2021-11-02T12:52:10Z', 'revision_number': 3, 'project_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'gw_port': {'id': '3248239a-54d8-4ba4-81f9-a3fa983dd829', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:d8:39', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7136daee-e271-4adc-ae87-6a06dffa51dd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 436, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:52:09Z', 'updated_at': '2021-11-02T12:52:09Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:52:12.638946 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-d7292315-2dda-4575-9a3d-451db6b2346e None None] Network 9db25871-3a99-486f-97da-692e55836f96 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:52:12.665923 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] Checking router: 7136daee-e271-4adc-ae87-6a06dffa51dd for host: dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:52:12.666354 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] Updating router 7136daee-e271-4adc-ae87-6a06dffa51dd port 3248239a-54d8-4ba4-81f9-a3fa983dd829 binding host dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 02 12:52:12.700814 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:52:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1e153bdf-0b98-4e6f-adea-34c4dfb4d883 x-openstack-request-id: req-1e153bdf-0b98-4e6f-adea-34c4dfb4d883 {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:52:12.701126 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "8b94e21b-3dc3-4565-a6b9-bd394a3d15ee", "name": "network-vif-deleted", "tag": "8037c526-562d-44b7-8677-fa21b26add41", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:52:12.701380 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-1e153bdf-0b98-4e6f-adea-34c4dfb4d883 {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:52:12.701828 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '8b94e21b-3dc3-4565-a6b9-bd394a3d15ee', 'name': 'network-vif-deleted', 'tag': '8037c526-562d-44b7-8677-fa21b26add41', 'status': 'completed', 'code': 200} Nov 02 12:52:12.702462 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:12.703416 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-4cf557c8-b48e-4d19-9127-2876c4437542 None None] Provisioning complete for port 00f385af-6f0c-44fb-969a-cdf46435a745 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:52:12.704002 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-4cf557c8-b48e-4d19-9127-2876c4437542 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:12.797224 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:12.887714 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:12.916412 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] For port 00f385af-6f0c-44fb-969a-cdf46435a745, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=00f385af-6f0c-44fb-969a-cdf46435a745,segment=NetworkSegment(3e37c0fd-0450-430c-9dfb-997dc0399ff6),segment_id=3e37c0fd-0450-430c-9dfb-997dc0399ff6)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:52:12.955376 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 28651645-026f-45f9-aa05-0f14a102b65a, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=28651645-026f-45f9-aa05-0f14a102b65a,segment=NetworkSegment(9918b664-73ec-4ba3-8b79-1b2dd2746c03),segment_id=9918b664-73ec-4ba3-8b79-1b2dd2746c03)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:52:12.960014 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '78f23d67-5bb3-42d7-b7ea-79c832aab569', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '28651645-026f-45f9-aa05-0f14a102b65a'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:52:12.962502 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c3e46be0-8440-4860-82dc-267dabb38e98" -d '{"events": [{"server_uuid": "78f23d67-5bb3-42d7-b7ea-79c832aab569", "name": "network-vif-plugged", "status": "completed", "tag": "28651645-026f-45f9-aa05-0f14a102b65a"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:52:13.045429 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:13.091783 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:13.107547 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-4cf557c8-b48e-4d19-9127-2876c4437542 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:13.112034 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:13.187054 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] Publish callbacks [] for port, precommit_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:13.188820 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Pushing event updated for resources: {'Port': ['ID=00f385af-6f0c-44fb-969a-cdf46435a745,revision_number=3']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:13.311111 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:13.319530 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.db.api [None req-4cf557c8-b48e-4d19-9127-2876c4437542 None None] Retry wrapper got retriable exception: UPDATE statement on table 'standardattributes' expected to update 1 row(s); 0 were matched. {{(pid=108544) wrapped /usr/local/lib/python3.8/dist-packages/neutron_lib/db/api.py:183}} Nov 02 12:52:13.320015 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG oslo_db.api [None req-4cf557c8-b48e-4d19-9127-2876c4437542 None None] Performing DB retry for function neutron.plugins.ml2.plugin.Ml2Plugin.update_port_statuses {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_db/api.py:155}} Nov 02 12:52:13.328761 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=28651645-026f-45f9-aa05-0f14a102b65a,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:13.354595 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-01c2da09-6e1a-4ee7-b63f-225b26af7564 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:13.358149 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-01c2da09-6e1a-4ee7-b63f-225b26af7564 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/networks?id=bfe7dfe3-4b23-4454-b60a-4955be8d2d31 HTTP/1.1" status: 200 len: 815 time: 0.2087581 Nov 02 12:52:13.384361 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-4dcfa712-30ec-4ebb-a937-c51156938ed8 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/quotas/dfe80527be524672a94a38908e154182 HTTP/1.1" status: 200 len: 375 time: 0.0180323 Nov 02 12:52:13.394451 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] Attempting to bind port 3248239a-54d8-4ba4-81f9-a3fa983dd829 on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:52:13.394794 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] Attempting to bind port 3248239a-54d8-4ba4-81f9-a3fa983dd829 by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}] {{(pid=108545) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:52:13.395219 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] Attempting to bind port 3248239a-54d8-4ba4-81f9-a3fa983dd829 on network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:52:13.409942 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 52, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:52:13.410702 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] Checking segment: {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108545) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:52:13.411310 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:13.411851 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] Bound using segment: {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'} {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:52:13.412537 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] Bound port: 3248239a-54d8-4ba4-81f9-a3fa983dd829, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}}] {{(pid=108545) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:52:13.413162 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:13.470475 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-a214fcc5-8004-40e3-83f5-0f1b34906b33 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?tenant_id=dfe80527be524672a94a38908e154182&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0796525 Nov 02 12:52:13.482002 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f15a4c11-79d0-4503-a68f-2ff46a394ad0 None None] Pushing event updated for resources: {'Port': ['ID=3248239a-54d8-4ba4-81f9-a3fa983dd829,revision_number=2']} {{(pid=108545) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:13.547062 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.db [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] For port 3248239a-54d8-4ba4-81f9-a3fa983dd829, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108545) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:52:13.550245 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.db [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] For port 3248239a-54d8-4ba4-81f9-a3fa983dd829, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=3248239a-54d8-4ba4-81f9-a3fa983dd829,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108545) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:52:13.645320 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_common [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Allocated IP 172.20.0.1 (9db25871-3a99-486f-97da-692e55836f96/236de1ed-65f6-4f82-93a7-8c065c469c7f/b65f9b1f-06b2-4ae0-8e61-2d41782bdb81) {{(pid=108542) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:52:13.648226 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f76a4d4d-7e5c-4968-b789-0e39da40dc94 req-e8198f9f-4ba6-4de6-bc92-462ac20e7640 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:13.649838 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f76a4d4d-7e5c-4968-b789-0e39da40dc94 req-e8198f9f-4ba6-4de6-bc92-462ac20e7640 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=78f23d67-5bb3-42d7-b7ea-79c832aab569 HTTP/1.1" status: 200 len: 945 time: 0.0889027 Nov 02 12:52:13.652283 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-ddafa1a0-a981-418e-afd1-bf048ad9ff39 service neutron] 10.222.0.98 "GET /v2.0/networks/bfe7dfe3-4b23-4454-b60a-4955be8d2d31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1736579 Nov 02 12:52:13.694318 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:13.786579 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f15a4c11-79d0-4503-a68f-2ff46a394ad0 None None] Pushing event updated for resources: {'Port': ['ID=3248239a-54d8-4ba4-81f9-a3fa983dd829,revision_number=3']} {{(pid=108545) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:13.789084 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Publish callbacks [] for port, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:13.796761 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f76a4d4d-7e5c-4968-b789-0e39da40dc94 req-2590e215-613e-4c30-8ed5-b5600b08282a tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/security-groups?id=eadb1119-2269-4956-923b-c60da15e2d12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1227272 Nov 02 12:52:13.804133 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] Routers {'7136daee-e271-4adc-ae87-6a06dffa51dd'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:52:13.804525 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:51:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['7136daee-e271-4adc-ae87-6a06dffa51dd'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:52:13.807343 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-1b16ffed-f1a8-4896-9d4b-2e045cdd09e5 service neutron] 10.222.0.98 "GET /v2.0/networks/bfe7dfe3-4b23-4454-b60a-4955be8d2d31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1429136 Nov 02 12:52:13.905920 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:52:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-177005ea-e3fa-4d19-b3ef-cc98fadb6cef x-openstack-request-id: req-177005ea-e3fa-4d19-b3ef-cc98fadb6cef {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:52:13.906531 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "78f23d67-5bb3-42d7-b7ea-79c832aab569", "name": "network-vif-plugged", "status": "completed", "tag": "28651645-026f-45f9-aa05-0f14a102b65a", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:52:13.907025 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-177005ea-e3fa-4d19-b3ef-cc98fadb6cef {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:52:13.907491 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '78f23d67-5bb3-42d7-b7ea-79c832aab569', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '28651645-026f-45f9-aa05-0f14a102b65a', 'code': 200} Nov 02 12:52:13.910962 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:13.978873 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Network 9db25871-3a99-486f-97da-692e55836f96 is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:52:13.983860 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:52:13.988336 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Received port after_create {{(pid=108542) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:52:14.017175 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-033eca60-afca-4a29-9d9e-16b94909087e req-51b929b0-aecd-4b59-ba6f-495a140db3f8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:14.021243 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-033eca60-afca-4a29-9d9e-16b94909087e req-51b929b0-aecd-4b59-ba6f-495a140db3f8 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=aaddc046689441b8ab3641f2afd07c0e&device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 1098 time: 0.0965056 Nov 02 12:52:14.039442 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-72d95483-8e67-447f-8fd8-1795b9bde906 None None] Provisioning complete for port 00f385af-6f0c-44fb-969a-cdf46435a745 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:52:14.044697 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-72d95483-8e67-447f-8fd8-1795b9bde906 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:14.063297 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Pushing event updated for resources: {'Port': ['ID=b65f9b1f-06b2-4ae0-8e61-2d41782bdb81,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:14.081194 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:52:14.082245 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:52:14.082902 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:52:14.087842 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:52:14.088477 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:52:14.088917 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:52:14.089374 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:52:14.089805 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:52:14.091067 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:52:14.091520 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:52:14.091950 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:52:14.092404 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:52:14.106596 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] Set router 7136daee-e271-4adc-ae87-6a06dffa51dd gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:52:14.114149 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1590217'] for router_interface, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:14.226015 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device bf7c4605-4045-4117-af22-08d75129b835 no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:52:14.317114 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 00f385af-6f0c-44fb-969a-cdf46435a745 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:52:14.509709 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:14.515737 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0957f19f-e0ed-4fcf-93f7-351e6b9d4f71 req-6a2fc5b2-3111-4a3e-a9c7-aca584f388d3 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=c09c5da0-2ee0-40c1-b5fb-f06550d58ee4 HTTP/1.1" status: 200 len: 210 time: 0.1026070 Nov 02 12:52:14.570264 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:14.571036 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port bf7c4605-4045-4117-af22-08d75129b835, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=bf7c4605-4045-4117-af22-08d75129b835,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:52:14.599560 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 00f385af-6f0c-44fb-969a-cdf46435a745 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:52:14.600154 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:14.618223 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d58b29ba-e781-4273-abd2-a7de22625567 req-f8bc6317-ca10-4bb6-a151-2b1d75527e99 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:14.625951 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d58b29ba-e781-4273-abd2-a7de22625567 req-f8bc6317-ca10-4bb6-a151-2b1d75527e99 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 945 time: 0.3409605 Nov 02 12:52:14.634227 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-033eca60-afca-4a29-9d9e-16b94909087e req-c7133907-135a-433b-b115-0546fd333b99 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:14.635593 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-033eca60-afca-4a29-9d9e-16b94909087e req-c7133907-135a-433b-b115-0546fd333b99 service neutron] 10.222.0.90 "GET /v2.0/networks?id=c468f0e1-3636-49b9-90c6-b90c643ed7d1 HTTP/1.1" status: 200 len: 917 time: 0.6049535 Nov 02 12:52:14.638224 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-18b17eaf-42f3-447f-93b1-a31eecfe68eb None None] Provisioning complete for port b65f9b1f-06b2-4ae0-8e61-2d41782bdb81 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:52:14.639336 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-18b17eaf-42f3-447f-93b1-a31eecfe68eb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:14.659198 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a74995b8-d6d6-439e-a2b5-9663c91e7556 req-c9ef0095-e2e0-4d73-bf9f-7d4625d0a53b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:14.663234 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a74995b8-d6d6-439e-a2b5-9663c91e7556 req-c9ef0095-e2e0-4d73-bf9f-7d4625d0a53b service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=78f23d67-5bb3-42d7-b7ea-79c832aab569 HTTP/1.1" status: 200 len: 1098 time: 0.1383371 Nov 02 12:52:14.736211 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-18b17eaf-42f3-447f-93b1-a31eecfe68eb None None] Port b65f9b1f-06b2-4ae0-8e61-2d41782bdb81 cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:52:14.741084 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:14.742118 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 8037c526-562d-44b7-8677-fa21b26add41 no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:52:14.945458 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7136daee-e271-4adc-ae87-6a06dffa51dd', 'name': 'tempest-TestVolumeBootPattern-1795464367-router', 'tenant_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.101'}], 'enable_snat': True}, 'gw_port_id': '3248239a-54d8-4ba4-81f9-a3fa983dd829', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:52:07Z', 'updated_at': '2021-11-02T12:52:10Z', 'revision_number': 3, 'project_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'gw_port': {'id': '3248239a-54d8-4ba4-81f9-a3fa983dd829', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:d8:39', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7136daee-e271-4adc-ae87-6a06dffa51dd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 436, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:52:09Z', 'updated_at': '2021-11-02T12:52:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:52:14.972841 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58738) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:15.025897 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Publish callbacks [] for port, precommit_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:15.030485 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d7537a5c-7667-4019-bc46-ea64192f7d02 None None] The sync data for ids ['7136daee-e271-4adc-ae87-6a06dffa51dd'] in dv-cinder-816324-1-iscsi is: [{'id': '7136daee-e271-4adc-ae87-6a06dffa51dd', 'name': 'tempest-TestVolumeBootPattern-1795464367-router', 'tenant_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.101'}], 'enable_snat': True}, 'gw_port_id': '3248239a-54d8-4ba4-81f9-a3fa983dd829', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:52:07Z', 'updated_at': '2021-11-02T12:52:10Z', 'revision_number': 3, 'project_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'gw_port': {'id': '3248239a-54d8-4ba4-81f9-a3fa983dd829', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:d8:39', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7136daee-e271-4adc-ae87-6a06dffa51dd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 436, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:52:09Z', 'updated_at': '2021-11-02T12:52:13Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}] {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:52:15.101401 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] No Port match for: 8037c526-562d-44b7-8677-fa21b26add41 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:52:15.101989 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 8037c526-562d-44b7-8677-fa21b26add41 not bound to the agent host hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:52:15.112286 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d58b29ba-e781-4273-abd2-a7de22625567 req-85568a84-20f6-4c35-9fc5-32adac82cae8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4852271 Nov 02 12:52:15.116356 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126476609'] for port, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:15.128978 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a74995b8-d6d6-439e-a2b5-9663c91e7556 req-cc686082-5097-4c55-93a0-ee526dd8f011 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=eadb1119-2269-4956-923b-c60da15e2d12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3804145 Nov 02 12:52:15.143962 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-033eca60-afca-4a29-9d9e-16b94909087e req-f8be3c51-3746-4a53-a9c4-8c6657df6dd0 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=bf7c4605-4045-4117-af22-08d75129b835 HTTP/1.1" status: 200 len: 1001 time: 0.4958084 Nov 02 12:52:15.180968 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=bf7c4605-4045-4117-af22-08d75129b835,revision_number=8']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:15.187144 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-079b451d-033a-4c8e-8d55-6482de192110 req-e874138a-d81e-4c99-b8b2-209a1d82f6f3 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:15.194960 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-079b451d-033a-4c8e-8d55-6482de192110 req-e874138a-d81e-4c99-b8b2-209a1d82f6f3 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=78f23d67-5bb3-42d7-b7ea-79c832aab569 HTTP/1.1" status: 200 len: 945 time: 0.2349730 Nov 02 12:52:15.268815 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Pushing event updated for resources: {'Port': ['ID=b65f9b1f-06b2-4ae0-8e61-2d41782bdb81,revision_number=2']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:15.275951 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b34feb11-1dc1-4045-b8ce-ac11dc201edf admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:15.285630 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-079b451d-033a-4c8e-8d55-6482de192110 req-c667aaa7-7596-48cc-b2ec-9f592547650b tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/security-groups?id=eadb1119-2269-4956-923b-c60da15e2d12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0896239 Nov 02 12:52:15.315718 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1649136', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1590109'] for router_interface, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:15.414111 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-033eca60-afca-4a29-9d9e-16b94909087e req-d82a112c-915d-41bf-9c52-a39ba7630bcd service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:15.415690 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-033eca60-afca-4a29-9d9e-16b94909087e req-d82a112c-915d-41bf-9c52-a39ba7630bcd service neutron] 10.222.0.90 "GET /v2.0/subnets?id=ec48fe57-a1cd-4e7c-874f-073624f71f4b HTTP/1.1" status: 200 len: 855 time: 0.0973775 Nov 02 12:52:15.500414 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Network 9db25871-3a99-486f-97da-692e55836f96 is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:52:15.506111 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b34feb11-1dc1-4045-b8ce-ac11dc201edf admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:15.507308 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:52:15.516715 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-033eca60-afca-4a29-9d9e-16b94909087e req-b6819956-124c-4efa-b4ae-655f76d35da3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:15.518346 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-033eca60-afca-4a29-9d9e-16b94909087e req-b6819956-124c-4efa-b4ae-655f76d35da3 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=c468f0e1-3636-49b9-90c6-b90c643ed7d1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0949888 Nov 02 12:52:15.650414 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b34feb11-1dc1-4045-b8ce-ac11dc201edf admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:15.658474 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-20e73b97-acc9-49ac-b0d4-ff39810df02e req-93fe308f-9b32-4e16-8db4-71ed46bf1ee9 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=c09c5da0-2ee0-40c1-b5fb-f06550d58ee4 HTTP/1.1" status: 200 len: 210 time: 0.0301590 Nov 02 12:52:15.724885 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-b34feb11-1dc1-4045-b8ce-ac11dc201edf admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=b6ba33d7ab6242fe940781e768d48795&name=default HTTP/1.1" status: 200 len: 2996 time: 0.7507856 Nov 02 12:52:15.727517 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b34feb11-1dc1-4045-b8ce-ac11dc201edf admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=0852e085-94a7-4fdf-ae8e-8314b1eb5bac,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:15.730338 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58754) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:15.741263 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-033eca60-afca-4a29-9d9e-16b94909087e req-43229775-4fc3-442c-80eb-775e5579fc36 service neutron] 10.222.0.90 "GET /v2.0/networks/c468f0e1-3636-49b9-90c6-b90c643ed7d1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1983263 Nov 02 12:52:15.752326 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Router 7136daee-e271-4adc-ae87-6a06dffa51dd has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108542) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 12:52:15.893709 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-c813e149-ae43-4ee3-936f-5138a9f44d1e None None] Provisioning complete for port b65f9b1f-06b2-4ae0-8e61-2d41782bdb81 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:52:15.894671 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c813e149-ae43-4ee3-936f-5138a9f44d1e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:15.897787 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-033eca60-afca-4a29-9d9e-16b94909087e req-f3b4f2dd-9cbe-4f35-a964-f11b0bb746cd service neutron] 10.222.0.90 "GET /v2.0/networks/c468f0e1-3636-49b9-90c6-b90c643ed7d1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1491995 Nov 02 12:52:15.911394 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7cc2c649-db32-4af2-b17b-1b744ef40a5f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'bf7c4605-4045-4117-af22-08d75129b835'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:52:15.914108 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-cd2149df-6e18-419d-81dc-e55f75d2b857" -d '{"events": [{"server_uuid": "7cc2c649-db32-4af2-b17b-1b744ef40a5f", "name": "network-vif-unplugged", "status": "completed", "tag": "bf7c4605-4045-4117-af22-08d75129b835"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:52:15.939246 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-7452f156-8442-4e96-9266-a346e3942fb1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:15.958093 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-c813e149-ae43-4ee3-936f-5138a9f44d1e None None] Port b65f9b1f-06b2-4ae0-8e61-2d41782bdb81 cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:52:15.966263 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 02 Nov 2021 12:52:15 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-28e43f42-cf27-4f46-842a-be062ab586f2 x-openstack-request-id: req-28e43f42-cf27-4f46-842a-be062ab586f2 {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:52:15.966872 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7cc2c649-db32-4af2-b17b-1b744ef40a5f", "name": "network-vif-unplugged", "status": "completed", "tag": "bf7c4605-4045-4117-af22-08d75129b835", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:52:15.967134 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-28e43f42-cf27-4f46-842a-be062ab586f2 {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:52:15.967600 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7cc2c649-db32-4af2-b17b-1b744ef40a5f', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'bf7c4605-4045-4117-af22-08d75129b835', 'code': 200} Nov 02 12:52:16.031521 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-7452f156-8442-4e96-9266-a346e3942fb1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:16.093236 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108542) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:52:16.104450 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-d1d3d1b6-55a7-49c6-aea8-202d8d7451dc admin admin] 10.222.0.98 "PUT /v2.0/routers/7136daee-e271-4adc-ae87-6a06dffa51dd/add_router_interface HTTP/1.1" status: 200 len: 503 time: 3.7747467 Nov 02 12:52:16.253467 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-7452f156-8442-4e96-9266-a346e3942fb1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:16.256613 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-7452f156-8442-4e96-9266-a346e3942fb1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:16.257934 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-7452f156-8442-4e96-9266-a346e3942fb1 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/0852e085-94a7-4fdf-ae8e-8314b1eb5bac HTTP/1.1" status: 204 len: 168 time: 0.5237651 Nov 02 12:52:16.279140 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7452f156-8442-4e96-9266-a346e3942fb1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=0852e085-94a7-4fdf-ae8e-8314b1eb5bac,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:16.440455 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43199832-46c4-4914-a960-98c83cfaaf4f req-87373997-562f-49dc-ba38-71bd69575f99 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:16.452739 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-43199832-46c4-4914-a960-98c83cfaaf4f req-87373997-562f-49dc-ba38-71bd69575f99 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.1893468 Nov 02 12:52:16.469978 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 3248239a-54d8-4ba4-81f9-a3fa983dd829 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:52:16.613741 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-43199832-46c4-4914-a960-98c83cfaaf4f req-0c2ce7e2-a46f-4f97-b5aa-69d252393e9e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1599855 Nov 02 12:52:16.624634 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 3248239a-54d8-4ba4-81f9-a3fa983dd829 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:52:16.625297 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:16.626210 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f84dd7f-4695-43b7-bda4-98e746188e6e req-d8bc77b0-7c9a-407c-8059-0468974246ef tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:16.628909 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1f84dd7f-4695-43b7-bda4-98e746188e6e req-d8bc77b0-7c9a-407c-8059-0468974246ef tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=78f23d67-5bb3-42d7-b7ea-79c832aab569 HTTP/1.1" status: 200 len: 945 time: 0.1519318 Nov 02 12:52:16.745282 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1f84dd7f-4695-43b7-bda4-98e746188e6e req-8abca784-3f95-4b75-bc0b-6b72043373a2 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/security-groups?id=eadb1119-2269-4956-923b-c60da15e2d12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1075542 Nov 02 12:52:16.860105 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:16.905412 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] For port 3248239a-54d8-4ba4-81f9-a3fa983dd829, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=3248239a-54d8-4ba4-81f9-a3fa983dd829,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:52:16.948224 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9ba05f92-00a5-4888-ba12-818aa41b2edf req-75d08f37-4bd3-43a0-ac9a-b78cb7a9de03 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=c09c5da0-2ee0-40c1-b5fb-f06550d58ee4 HTTP/1.1" status: 200 len: 210 time: 0.0551367 Nov 02 12:52:17.007858 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:17.075111 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Pushing event updated for resources: {'Port': ['ID=3248239a-54d8-4ba4-81f9-a3fa983dd829,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:17.460166 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 58850) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:17.480612 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-20e15dd2-ba11-493b-ab93-da79be3d58cd admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:17.608514 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-20e15dd2-ba11-493b-ab93-da79be3d58cd admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:17.615395 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] Sync routers for ids ['7136daee-e271-4adc-ae87-6a06dffa51dd'] in dv-cinder-816324-1-iscsi {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:52:17.630514 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] Routers {'7136daee-e271-4adc-ae87-6a06dffa51dd'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:52:17.631489 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:51:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['7136daee-e271-4adc-ae87-6a06dffa51dd'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:52:17.711173 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58860) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:17.718641 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-d7973f45-672e-42a6-97ed-adc762646d6a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-167174139', 'description': 'tempest-secgroup-smoke-167174139 description', 'project_id': '697de566c0334435b902950f6f31da45'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:52:17.720888 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-5eec0fe5-1c16-47e3-9e6e-8da0a98eb3ac tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:17.722674 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-5eec0fe5-1c16-47e3-9e6e-8da0a98eb3ac tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.90 "GET /v2.0/networks?id=bfe7dfe3-4b23-4454-b60a-4955be8d2d31 HTTP/1.1" status: 200 len: 815 time: 0.1573019 Nov 02 12:52:17.774220 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-00858937-f332-4033-8ad0-df138dc452b1 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Request body: {'port': {'device_id': 'c09c5da0-2ee0-40c1-b5fb-f06550d58ee4', 'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31', 'admin_state_up': True, 'tenant_id': 'dfe80527be524672a94a38908e154182'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:52:17.777366 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-20e15dd2-ba11-493b-ab93-da79be3d58cd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:17.782638 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] Set router 7136daee-e271-4adc-ae87-6a06dffa51dd gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:52:17.822895 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d7973f45-672e-42a6-97ed-adc762646d6a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:17.855373 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-20e15dd2-ba11-493b-ab93-da79be3d58cd admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=838696d09bb64678bad81231e33ca2dd&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3940575 Nov 02 12:52:17.914342 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 58868) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:17.950017 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d7973f45-672e-42a6-97ed-adc762646d6a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:18.008987 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-20e15dd2-ba11-493b-ab93-da79be3d58cd admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=304774f0-39c4-4d76-9fdb-42f48b437479,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:18.021290 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4512ff1c-675b-4d36-a766-c5b4b29bfb63 req-4b5c6356-ba4a-4628-ad74-e7984dc91456 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:18.030954 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4512ff1c-675b-4d36-a766-c5b4b29bfb63 req-4b5c6356-ba4a-4628-ad74-e7984dc91456 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.3070719 Nov 02 12:52:18.031663 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d7973f45-672e-42a6-97ed-adc762646d6a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:18.102873 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d7973f45-672e-42a6-97ed-adc762646d6a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Pushing event updated for resources: {'SecurityGroup': ['ID=9bcd6e2d-4fff-4ee2-aaee-41104c05def3,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:18.195234 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0304b2da-82d2-455c-bfc1-2daab702ada7 req-6cd96261-017e-4b5f-b4c2-19c3e686a757 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:18.203661 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0304b2da-82d2-455c-bfc1-2daab702ada7 req-6cd96261-017e-4b5f-b4c2-19c3e686a757 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=78f23d67-5bb3-42d7-b7ea-79c832aab569 HTTP/1.1" status: 200 len: 945 time: 0.2711456 Nov 02 12:52:18.213078 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4512ff1c-675b-4d36-a766-c5b4b29bfb63 req-2395331f-6bdf-4448-bcb5-4230f489aed5 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1761239 Nov 02 12:52:18.213380 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7136daee-e271-4adc-ae87-6a06dffa51dd', 'name': 'tempest-TestVolumeBootPattern-1795464367-router', 'tenant_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.101'}], 'enable_snat': True}, 'gw_port_id': '3248239a-54d8-4ba4-81f9-a3fa983dd829', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:52:07Z', 'updated_at': '2021-11-02T12:52:14Z', 'revision_number': 4, 'project_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'gw_port': {'id': '3248239a-54d8-4ba4-81f9-a3fa983dd829', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:d8:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7136daee-e271-4adc-ae87-6a06dffa51dd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 436, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:52:09Z', 'updated_at': '2021-11-02T12:52:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': 'b65f9b1f-06b2-4ae0-8e61-2d41782bdb81', 'name': '', 'network_id': '9db25871-3a99-486f-97da-692e55836f96', 'tenant_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'mac_address': 'fa:16:3e:75:3d:31', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7136daee-e271-4adc-ae87-6a06dffa51dd', 'device_owner': 'network:router_interface', 'standard_attr_id': 437, 'fixed_ips': [{'subnet_id': '236de1ed-65f6-4f82-93a7-8c065c469c7f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:52:13Z', 'updated_at': '2021-11-02T12:52:14Z', 'revision_number': 2, 'project_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'subnets': [{'id': '236de1ed-65f6-4f82-93a7-8c065c469c7f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:52:18.248155 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-15117853-d604-4d59-beac-f29e69809725 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:18.258851 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d7973f45-672e-42a6-97ed-adc762646d6a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:18.258851 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-d7973f45-672e-42a6-97ed-adc762646d6a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.5461297 Nov 02 12:52:18.278148 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58878) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:18.283750 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-49a5d9e8-8b1d-4068-b8d9-a3085fb4413e tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Request body: {'security_group_rule': {'security_group_id': '9bcd6e2d-4fff-4ee2-aaee-41104c05def3', 'project_id': '697de566c0334435b902950f6f31da45', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:52:18.298887 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 3248239a-54d8-4ba4-81f9-a3fa983dd829 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:52:18.303788 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] Checking router: 7136daee-e271-4adc-ae87-6a06dffa51dd for host: dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:52:18.304368 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] Updating router 7136daee-e271-4adc-ae87-6a06dffa51dd port b65f9b1f-06b2-4ae0-8e61-2d41782bdb81 binding host dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 02 12:52:18.323450 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-15117853-d604-4d59-beac-f29e69809725 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:18.367486 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:18.406598 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-828bf818-3d6a-4a18-9030-cffa0bc4ace6 req-01477ff5-877e-40b7-ab28-5d03e2889726 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=c09c5da0-2ee0-40c1-b5fb-f06550d58ee4 HTTP/1.1" status: 200 len: 210 time: 0.0864613 Nov 02 12:52:18.414916 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0304b2da-82d2-455c-bfc1-2daab702ada7 req-f8114897-7622-4a90-948d-f8317c2f965e tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/security-groups?id=eadb1119-2269-4956-923b-c60da15e2d12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2108903 Nov 02 12:52:18.422653 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-00858937-f332-4033-8ad0-df138dc452b1 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Made reservation on behalf of dfe80527be524672a94a38908e154182 for: {'port': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:52:18.428921 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-00858937-f332-4033-8ad0-df138dc452b1 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:18.490861 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 3248239a-54d8-4ba4-81f9-a3fa983dd829 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:52:18.498126 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:18.586930 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-00858937-f332-4033-8ad0-df138dc452b1 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Allocated IP 172.20.0.13 (bfe7dfe3-4b23-4454-b60a-4955be8d2d31/8f42833a-0a0e-4198-a7cf-e79133593615/f173e8db-9c28-4415-be12-b2f898eb931e) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:52:18.633801 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-15117853-d604-4d59-beac-f29e69809725 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:18.636585 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-49a5d9e8-8b1d-4068-b8d9-a3085fb4413e tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:18.637106 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-15117853-d604-4d59-beac-f29e69809725 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:18.642557 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-15117853-d604-4d59-beac-f29e69809725 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/304774f0-39c4-4d76-9fdb-42f48b437479 HTTP/1.1" status: 204 len: 168 time: 0.7036176 Nov 02 12:52:18.682453 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15117853-d604-4d59-beac-f29e69809725 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=304774f0-39c4-4d76-9fdb-42f48b437479,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:18.791190 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-49a5d9e8-8b1d-4068-b8d9-a3085fb4413e tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:18.852121 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-00858937-f332-4033-8ad0-df138dc452b1 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:18.866992 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] Publish callbacks [] for port, precommit_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:18.927373 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-49a5d9e8-8b1d-4068-b8d9-a3085fb4413e tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:18.960464 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-49a5d9e8-8b1d-4068-b8d9-a3085fb4413e tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=7b1c84a8-f30e-497c-86ee-6980715b53ed,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:18.962758 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:19.026475 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-00858937-f332-4033-8ad0-df138dc452b1 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:19.072989 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['4c597805-3835-4f59-b320-5614de6b4ec6', '4767bbe8-ea52-4258-9417-d866fb33fb53'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:52:19.081471 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-49a5d9e8-8b1d-4068-b8d9-a3085fb4413e tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:19.084139 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-49a5d9e8-8b1d-4068-b8d9-a3085fb4413e tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.8073888 Nov 02 12:52:19.085623 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58934) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:19.091610 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-00858937-f332-4033-8ad0-df138dc452b1 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Network bfe7dfe3-4b23-4454-b60a-4955be8d2d31 is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:52:19.093693 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-e368e7a8-d1ae-4bb1-8242-25f36f52f025 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Request body: {'security_group_rule': {'security_group_id': '9bcd6e2d-4fff-4ee2-aaee-41104c05def3', 'project_id': '697de566c0334435b902950f6f31da45', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:52:19.094996 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-00858937-f332-4033-8ad0-df138dc452b1 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:52:19.099844 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-00858937-f332-4033-8ad0-df138dc452b1 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:52:19.131878 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82896e5f-a902-4604-b567-b04889a04c5b None None] Pushing event updated for resources: {'Port': ['ID=b65f9b1f-06b2-4ae0-8e61-2d41782bdb81,revision_number=3']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:19.201610 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] Attempting to bind port b65f9b1f-06b2-4ae0-8e61-2d41782bdb81 on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:52:19.202004 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] Attempting to bind port b65f9b1f-06b2-4ae0-8e61-2d41782bdb81 by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': '3e37c0fd-0450-430c-9dfb-997dc0399ff6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '9db25871-3a99-486f-97da-692e55836f96'}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:52:19.202350 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] Attempting to bind port b65f9b1f-06b2-4ae0-8e61-2d41782bdb81 on network 9db25871-3a99-486f-97da-692e55836f96 {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:52:19.271425 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00858937-f332-4033-8ad0-df138dc452b1 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Pushing event updated for resources: {'Port': ['ID=f173e8db-9c28-4415-be12-b2f898eb931e,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:19.278809 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 52, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:52:19.279492 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] Checking segment: {'id': '3e37c0fd-0450-430c-9dfb-997dc0399ff6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '9db25871-3a99-486f-97da-692e55836f96'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108544) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:52:19.280069 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:19.290580 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e368e7a8-d1ae-4bb1-8242-25f36f52f025 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:19.294978 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] Bound using segment: {'id': '3e37c0fd-0450-430c-9dfb-997dc0399ff6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '9db25871-3a99-486f-97da-692e55836f96'} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:52:19.296819 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] Bound port: b65f9b1f-06b2-4ae0-8e61-2d41782bdb81, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '3e37c0fd-0450-430c-9dfb-997dc0399ff6', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 882, 'network_id': '9db25871-3a99-486f-97da-692e55836f96'}}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:52:19.298415 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:19.427468 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e368e7a8-d1ae-4bb1-8242-25f36f52f025 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:19.443133 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-00858937-f332-4033-8ad0-df138dc452b1 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:19.447095 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-00858937-f332-4033-8ad0-df138dc452b1 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:19.499215 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a92a76c5-9914-463b-bfc6-7e75478ed5df req-2e9604af-980f-47fa-99ed-124989ce2006 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:19.510553 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a92a76c5-9914-463b-bfc6-7e75478ed5df req-2e9604af-980f-47fa-99ed-124989ce2006 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.2685816 Nov 02 12:52:19.522929 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e368e7a8-d1ae-4bb1-8242-25f36f52f025 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:19.564593 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e368e7a8-d1ae-4bb1-8242-25f36f52f025 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c365e5af-d1e9-445c-9860-7b07a6335440,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:19.574134 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-daa9e12b-0345-40c8-a81d-446d9eb01f8f None None] Provisioning complete for port b65f9b1f-06b2-4ae0-8e61-2d41782bdb81 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:52:19.574569 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-daa9e12b-0345-40c8-a81d-446d9eb01f8f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:19.610894 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a92a76c5-9914-463b-bfc6-7e75478ed5df req-ac5e8e6a-a01e-4070-97cf-21668cb8dbbb tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0980923 Nov 02 12:52:19.625697 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-00858937-f332-4033-8ad0-df138dc452b1 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 1.8656759 Nov 02 12:52:19.631067 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] For port b65f9b1f-06b2-4ae0-8e61-2d41782bdb81, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108544) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:52:19.657658 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a54735c5-fbe3-438b-9c39-2bad222f9f56 req-098f12d9-b632-4800-a297-b998f7cfeae2 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:19.658428 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] For port b65f9b1f-06b2-4ae0-8e61-2d41782bdb81, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=b65f9b1f-06b2-4ae0-8e61-2d41782bdb81,segment=NetworkSegment(3e37c0fd-0450-430c-9dfb-997dc0399ff6),segment_id=3e37c0fd-0450-430c-9dfb-997dc0399ff6)] {{(pid=108544) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:52:19.659576 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a54735c5-fbe3-438b-9c39-2bad222f9f56 req-098f12d9-b632-4800-a297-b998f7cfeae2 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.2799587 Nov 02 12:52:19.664555 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-180c4706-206a-4b16-9a53-06ae2f348642 service neutron] Request body: {'port': {'device_id': 'c09c5da0-2ee0-40c1-b5fb-f06550d58ee4', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81632'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:52:19.681194 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e368e7a8-d1ae-4bb1-8242-25f36f52f025 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:19.681639 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-daa9e12b-0345-40c8-a81d-446d9eb01f8f None None] Port b65f9b1f-06b2-4ae0-8e61-2d41782bdb81 cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:52:19.682664 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-e368e7a8-d1ae-4bb1-8242-25f36f52f025 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.5957997 Nov 02 12:52:19.688744 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58970) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:19.698604 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-4da44431-804f-4665-aca0-46c2da5b86da tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Request body: {'security_group_rule': {'security_group_id': '9bcd6e2d-4fff-4ee2-aaee-41104c05def3', 'project_id': '697de566c0334435b902950f6f31da45', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:52:19.806710 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:19.815637 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a54735c5-fbe3-438b-9c39-2bad222f9f56 req-f7b54ae7-cddd-408e-89a5-3ffcb02ea88c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1456444 Nov 02 12:52:19.817160 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-180c4706-206a-4b16-9a53-06ae2f348642 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:19.825458 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4da44431-804f-4665-aca0-46c2da5b86da tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:19.842029 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-393e7034-dfd2-47ab-8ba5-4be4329d6669 req-0b80fda8-21a4-4e75-8a6e-629b1a98dcec tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:19.862542 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-393e7034-dfd2-47ab-8ba5-4be4329d6669 req-0b80fda8-21a4-4e75-8a6e-629b1a98dcec tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=c09c5da0-2ee0-40c1-b5fb-f06550d58ee4 HTTP/1.1" status: 200 len: 932 time: 0.1582549 Nov 02 12:52:19.908041 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] Routers {'7136daee-e271-4adc-ae87-6a06dffa51dd'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:52:19.909039 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:51:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['7136daee-e271-4adc-ae87-6a06dffa51dd'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:52:19.987911 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4da44431-804f-4665-aca0-46c2da5b86da tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:20.051710 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-82896e5f-a902-4604-b567-b04889a04c5b None None] Pushing event updated for resources: {'Port': ['ID=b65f9b1f-06b2-4ae0-8e61-2d41782bdb81,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:20.079375 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-393e7034-dfd2-47ab-8ba5-4be4329d6669 req-21d8d717-df6e-46e3-a1a4-cd7461aaf2d1 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2159483 Nov 02 12:52:20.082264 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4da44431-804f-4665-aca0-46c2da5b86da tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:20.137181 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4da44431-804f-4665-aca0-46c2da5b86da tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=35ee6508-c7ea-4c94-a2c3-cb10a661a45c,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:20.185299 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] Set router 7136daee-e271-4adc-ae87-6a06dffa51dd gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:52:20.189680 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4da44431-804f-4665-aca0-46c2da5b86da tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:20.190127 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-4da44431-804f-4665-aca0-46c2da5b86da tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4996068 Nov 02 12:52:20.195073 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 58988) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:20.201453 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-1cbbedea-e0fb-4f8a-906e-6e305468794b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Request body: {'security_group_rule': {'security_group_id': '9bcd6e2d-4fff-4ee2-aaee-41104c05def3', 'project_id': '697de566c0334435b902950f6f31da45', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:52:20.230324 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device bf7c4605-4045-4117-af22-08d75129b835 no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:52:20.363353 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1cbbedea-e0fb-4f8a-906e-6e305468794b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:20.401657 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-180c4706-206a-4b16-9a53-06ae2f348642 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id f173e8db-9c28-4415-be12-b2f898eb931e {{(pid=108543) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:52:20.412353 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-180c4706-206a-4b16-9a53-06ae2f348642 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:20.428540 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.provisioning_blocks [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-180c4706-206a-4b16-9a53-06ae2f348642 service neutron] Transition to ACTIVE for port object f173e8db-9c28-4415-be12-b2f898eb931e will not be triggered until provisioned by entity L2. {{(pid=108543) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 02 12:52:20.439267 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1cbbedea-e0fb-4f8a-906e-6e305468794b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:20.500743 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-3fed9707-dfc9-47ab-9b1f-6fc1544310dd None None] Provisioning complete for port b65f9b1f-06b2-4ae0-8e61-2d41782bdb81 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:52:20.501270 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-3fed9707-dfc9-47ab-9b1f-6fc1544310dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:20.691339 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1cbbedea-e0fb-4f8a-906e-6e305468794b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:20.691470 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-180c4706-206a-4b16-9a53-06ae2f348642 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:20.735204 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1cbbedea-e0fb-4f8a-906e-6e305468794b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=896e82ab-9e77-4065-b26a-1c5039c7ade0,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:20.781796 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-180c4706-206a-4b16-9a53-06ae2f348642 service neutron] Pushing event updated for resources: {'Port': ['ID=f173e8db-9c28-4415-be12-b2f898eb931e,revision_number=2']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:20.814183 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-3fed9707-dfc9-47ab-9b1f-6fc1544310dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:20.815830 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1cbbedea-e0fb-4f8a-906e-6e305468794b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:20.818594 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-1cbbedea-e0fb-4f8a-906e-6e305468794b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.6224086 Nov 02 12:52:20.824108 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 59018) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:20.829023 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-c369e968-0938-42ed-90d1-adcbec4b4243 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Request body: {'security_group_rule': {'security_group_id': '9bcd6e2d-4fff-4ee2-aaee-41104c05def3', 'project_id': '697de566c0334435b902950f6f31da45', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:52:20.879358 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-3fed9707-dfc9-47ab-9b1f-6fc1544310dd None None] For port b65f9b1f-06b2-4ae0-8e61-2d41782bdb81, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=b65f9b1f-06b2-4ae0-8e61-2d41782bdb81,segment=NetworkSegment(3e37c0fd-0450-430c-9dfb-997dc0399ff6),segment_id=3e37c0fd-0450-430c-9dfb-997dc0399ff6)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:52:20.891446 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7136daee-e271-4adc-ae87-6a06dffa51dd', 'name': 'tempest-TestVolumeBootPattern-1795464367-router', 'tenant_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.101'}], 'enable_snat': True}, 'gw_port_id': '3248239a-54d8-4ba4-81f9-a3fa983dd829', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:52:07Z', 'updated_at': '2021-11-02T12:52:14Z', 'revision_number': 4, 'project_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'gw_port': {'id': '3248239a-54d8-4ba4-81f9-a3fa983dd829', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:d8:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7136daee-e271-4adc-ae87-6a06dffa51dd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 436, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:52:09Z', 'updated_at': '2021-11-02T12:52:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': 'b65f9b1f-06b2-4ae0-8e61-2d41782bdb81', 'name': '', 'network_id': '9db25871-3a99-486f-97da-692e55836f96', 'tenant_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'mac_address': 'fa:16:3e:75:3d:31', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7136daee-e271-4adc-ae87-6a06dffa51dd', 'device_owner': 'network:router_interface', 'standard_attr_id': 437, 'fixed_ips': [{'subnet_id': '236de1ed-65f6-4f82-93a7-8c065c469c7f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:52:13Z', 'updated_at': '2021-11-02T12:52:19Z', 'revision_number': 4, 'project_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'subnets': [{'id': '236de1ed-65f6-4f82-93a7-8c065c469c7f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:52:20.927047 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-af7ca8f3-3d09-4c73-b9b5-8e19c3df69d5 None None] The sync data for ids ['7136daee-e271-4adc-ae87-6a06dffa51dd'] in dv-cinder-816324-1-iscsi is: [{'id': '7136daee-e271-4adc-ae87-6a06dffa51dd', 'name': 'tempest-TestVolumeBootPattern-1795464367-router', 'tenant_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.101'}], 'enable_snat': True}, 'gw_port_id': '3248239a-54d8-4ba4-81f9-a3fa983dd829', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:52:07Z', 'updated_at': '2021-11-02T12:52:14Z', 'revision_number': 4, 'project_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'gw_port': {'id': '3248239a-54d8-4ba4-81f9-a3fa983dd829', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:d8:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7136daee-e271-4adc-ae87-6a06dffa51dd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 436, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:52:09Z', 'updated_at': '2021-11-02T12:52:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': 'b65f9b1f-06b2-4ae0-8e61-2d41782bdb81', 'name': '', 'network_id': '9db25871-3a99-486f-97da-692e55836f96', 'tenant_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'mac_address': 'fa:16:3e:75:3d:31', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '7136daee-e271-4adc-ae87-6a06dffa51dd', 'device_owner': 'network:router_interface', 'standard_attr_id': 437, 'fixed_ips': [{'subnet_id': '236de1ed-65f6-4f82-93a7-8c065c469c7f', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:52:13Z', 'updated_at': '2021-11-02T12:52:19Z', 'revision_number': 4, 'project_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'subnets': [{'id': '236de1ed-65f6-4f82-93a7-8c065c469c7f', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:52:20.979749 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-3fed9707-dfc9-47ab-9b1f-6fc1544310dd None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:20.981058 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.db.securitygroups_db [None req-c369e968-0938-42ed-90d1-adcbec4b4243 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Project 697de566c0334435b902950f6f31da45 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 02 12:52:21.017713 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c369e968-0938-42ed-90d1-adcbec4b4243 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:21.071256 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fed9707-dfc9-47ab-9b1f-6fc1544310dd None None] Pushing event updated for resources: {'Port': ['ID=b65f9b1f-06b2-4ae0-8e61-2d41782bdb81,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:21.134304 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c369e968-0938-42ed-90d1-adcbec4b4243 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:21.242493 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c369e968-0938-42ed-90d1-adcbec4b4243 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:21.277897 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c369e968-0938-42ed-90d1-adcbec4b4243 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=5a18d15c-bfed-48bd-b469-f7960dc19ac4,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:21.301570 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0bed4459-5a02-4e85-bbe8-e7ca53c1ba32 req-0204c932-aac0-4414-b78e-8f27befb1514 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:21.310005 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0bed4459-5a02-4e85-bbe8-e7ca53c1ba32 req-0204c932-aac0-4414-b78e-8f27befb1514 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.5466981 Nov 02 12:52:21.383632 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c369e968-0938-42ed-90d1-adcbec4b4243 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:21.385947 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-c369e968-0938-42ed-90d1-adcbec4b4243 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.5600412 Nov 02 12:52:21.393176 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0bed4459-5a02-4e85-bbe8-e7ca53c1ba32 req-71dbb116-54e5-476f-8c5b-404405d6d576 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0799816 Nov 02 12:52:21.394019 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 59046) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:21.402413 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-d5a37053-18af-464f-b209-962927a45f26 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Request body: {'security_group_rule': {'security_group_id': '9bcd6e2d-4fff-4ee2-aaee-41104c05def3', 'project_id': '697de566c0334435b902950f6f31da45', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:52:21.404540 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-180c4706-206a-4b16-9a53-06ae2f348642 service neutron] Attempting to bind port f173e8db-9c28-4415-be12-b2f898eb931e on host hv-cinder-81632 for vnic_type normal with profile {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:52:21.406700 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-180c4706-206a-4b16-9a53-06ae2f348642 service neutron] Attempting to bind port f173e8db-9c28-4415-be12-b2f898eb931e by drivers openvswitch,hyperv on host hv-cinder-81632 at level 0 using segments [{'id': 'e912b2b1-808c-4d37-a99d-fcfdb9d2a5db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31'}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:52:21.407154 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-180c4706-206a-4b16-9a53-06ae2f348642 service neutron] Attempting to bind port f173e8db-9c28-4415-be12-b2f898eb931e on network bfe7dfe3-4b23-4454-b60a-4955be8d2d31 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:52:21.423078 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-180c4706-206a-4b16-9a53-06ae2f348642 service neutron] Port f173e8db-9c28-4415-be12-b2f898eb931e on network bfe7dfe3-4b23-4454-b60a-4955be8d2d31 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81632 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 02 12:52:21.424967 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-180c4706-206a-4b16-9a53-06ae2f348642 service neutron] Attempting to bind port f173e8db-9c28-4415-be12-b2f898eb931e on network bfe7dfe3-4b23-4454-b60a-4955be8d2d31 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:52:21.454109 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-180c4706-206a-4b16-9a53-06ae2f348642 service neutron] Checking agent: {'id': '0d57fa42-4660-4f08-b7dc-53a872c3c01c', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81632', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'started_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 52, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:52:21.454559 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-180c4706-206a-4b16-9a53-06ae2f348642 service neutron] Checking segment: {'id': 'e912b2b1-808c-4d37-a99d-fcfdb9d2a5db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108543) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:52:21.454966 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-180c4706-206a-4b16-9a53-06ae2f348642 service neutron] Bound using segment: {'id': 'e912b2b1-808c-4d37-a99d-fcfdb9d2a5db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31'} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:52:21.455423 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-180c4706-206a-4b16-9a53-06ae2f348642 service neutron] Bound port: f173e8db-9c28-4415-be12-b2f898eb931e, host: hv-cinder-81632, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e912b2b1-808c-4d37-a99d-fcfdb9d2a5db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31'}}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:52:21.459578 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-180c4706-206a-4b16-9a53-06ae2f348642 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:21.593816 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-180c4706-206a-4b16-9a53-06ae2f348642 service neutron] For port f173e8db-9c28-4415-be12-b2f898eb931e, host hv-cinder-81632, cleared binding levels {{(pid=108543) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:52:21.601097 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-180c4706-206a-4b16-9a53-06ae2f348642 service neutron] For port f173e8db-9c28-4415-be12-b2f898eb931e, host hv-cinder-81632, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=f173e8db-9c28-4415-be12-b2f898eb931e,segment=NetworkSegment(e912b2b1-808c-4d37-a99d-fcfdb9d2a5db),segment_id=e912b2b1-808c-4d37-a99d-fcfdb9d2a5db)] {{(pid=108543) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:52:21.604392 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.db.securitygroups_db [None req-d5a37053-18af-464f-b209-962927a45f26 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Project 697de566c0334435b902950f6f31da45 added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 02 12:52:21.615444 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-55234f98-e853-4609-94d3-665d9e6d7e21 req-b69b1590-3e64-4f61-8418-60ac29eaf05b tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:21.619678 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d5a37053-18af-464f-b209-962927a45f26 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:21.625884 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-55234f98-e853-4609-94d3-665d9e6d7e21 req-b69b1590-3e64-4f61-8418-60ac29eaf05b tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=78f23d67-5bb3-42d7-b7ea-79c832aab569 HTTP/1.1" status: 200 len: 945 time: 0.1162565 Nov 02 12:52:21.699387 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-55234f98-e853-4609-94d3-665d9e6d7e21 req-024cff3d-b482-4fd2-8604-c8204f189218 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/security-groups?id=eadb1119-2269-4956-923b-c60da15e2d12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0724704 Nov 02 12:52:21.711673 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-180c4706-206a-4b16-9a53-06ae2f348642 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:21.742305 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d5a37053-18af-464f-b209-962927a45f26 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:21.848914 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-180c4706-206a-4b16-9a53-06ae2f348642 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:21.850710 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-180c4706-206a-4b16-9a53-06ae2f348642 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:21.856008 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-180c4706-206a-4b16-9a53-06ae2f348642 service neutron] 10.222.0.90 "PUT /v2.0/ports/f173e8db-9c28-4415-be12-b2f898eb931e HTTP/1.1" status: 200 len: 1094 time: 2.1925080 Nov 02 12:52:21.856008 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c09c5da0-2ee0-40c1-b5fb-f06550d58ee4', 'tag': 'f173e8db-9c28-4415-be12-b2f898eb931e'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:52:21.858138 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d5a37053-18af-464f-b209-962927a45f26 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:21.863008 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a162c9cc-3e77-4f60-bacf-da8fd1e1b478" -d '{"events": [{"name": "network-changed", "server_uuid": "c09c5da0-2ee0-40c1-b5fb-f06550d58ee4", "tag": "f173e8db-9c28-4415-be12-b2f898eb931e"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:52:21.882199 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-180c4706-206a-4b16-9a53-06ae2f348642 service neutron] Pushing event updated for resources: {'Port': ['ID=f173e8db-9c28-4415-be12-b2f898eb931e,revision_number=3']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:21.894860 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d5a37053-18af-464f-b209-962927a45f26 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=81550c4f-0b01-430b-ba15-d1b1080e583b,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:21.940000 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38e8003d-3c8c-4037-9c65-18a0070f2ff3 req-1853de68-9fd3-483c-9d0b-3845130b0bdb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:21.941646 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-38e8003d-3c8c-4037-9c65-18a0070f2ff3 req-1853de68-9fd3-483c-9d0b-3845130b0bdb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=c09c5da0-2ee0-40c1-b5fb-f06550d58ee4 HTTP/1.1" status: 200 len: 944 time: 0.1300263 Nov 02 12:52:21.955005 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ab60ff8-a7a9-44cb-b634-35a052ced496 req-28075212-f3c6-43e0-b7d4-7be5a868f28a tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:21.956481 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0ab60ff8-a7a9-44cb-b634-35a052ced496 req-28075212-f3c6-43e0-b7d4-7be5a868f28a tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.90 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.1500583 Nov 02 12:52:22.022499 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d5a37053-18af-464f-b209-962927a45f26 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:22.025086 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-d5a37053-18af-464f-b209-962927a45f26 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.6297262 Nov 02 12:52:22.128943 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-38e8003d-3c8c-4037-9c65-18a0070f2ff3 req-a968bd98-197d-4e2d-b45b-284515c51bda tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1713581 Nov 02 12:52:22.152970 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-99719934-5388-4dc6-a25b-641d177897c3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:22.160183 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-99719934-5388-4dc6-a25b-641d177897c3 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=dfe80527be524672a94a38908e154182&device_id=c09c5da0-2ee0-40c1-b5fb-f06550d58ee4 HTTP/1.1" status: 200 len: 1097 time: 0.0971913 Nov 02 12:52:22.199580 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:52:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-74a50ff4-aa0e-4bce-b11c-8255218de883 x-openstack-request-id: req-74a50ff4-aa0e-4bce-b11c-8255218de883 {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:52:22.199580 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c09c5da0-2ee0-40c1-b5fb-f06550d58ee4", "tag": "f173e8db-9c28-4415-be12-b2f898eb931e", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:52:22.199580 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-74a50ff4-aa0e-4bce-b11c-8255218de883 {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:52:22.199580 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c09c5da0-2ee0-40c1-b5fb-f06550d58ee4', 'tag': 'f173e8db-9c28-4415-be12-b2f898eb931e', 'status': 'completed', 'code': 200} Nov 02 12:52:22.250011 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-3cdb1d1f-9238-410a-99b3-02a1983d5330 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=f173e8db-9c28-4415-be12-b2f898eb931e HTTP/1.1" status: 200 len: 217 time: 0.0623496 Nov 02 12:52:22.259398 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-0ab60ff8-a7a9-44cb-b634-35a052ced496 req-3fc58bc3-32d9-4849-af7b-938c7ed1aea3 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Deleting port 2cf235b6-e4c1-4b00-8971-dbd528d6ad92 {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:52:22.259614 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-0ab60ff8-a7a9-44cb-b634-35a052ced496 req-3fc58bc3-32d9-4849-af7b-938c7ed1aea3 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:22.341569 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device b65f9b1f-06b2-4ae0-8e61-2d41782bdb81 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:52:22.399915 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-7c0261bb-4156-433e-b616-59de373dcf5a service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:22.399915 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-7c0261bb-4156-433e-b616-59de373dcf5a service neutron] 10.222.0.90 "GET /v2.0/subnets?id=8f42833a-0a0e-4198-a7cf-e79133593615 HTTP/1.1" status: 200 len: 855 time: 0.1197808 Nov 02 12:52:22.460159 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-aef3017b-c9ea-4557-a6cf-624b3a6204d6 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=bfe7dfe3-4b23-4454-b60a-4955be8d2d31&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0478735 Nov 02 12:52:22.514395 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f4157e6d-f9fc-46d0-8b31-d4c5ed2eb102 req-6aefbb08-3479-47cb-86f1-227923658e26 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:22.516981 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-f4157e6d-f9fc-46d0-8b31-d4c5ed2eb102 req-6aefbb08-3479-47cb-86f1-227923658e26 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.90 "GET /v2.0/ports?device_id=78f23d67-5bb3-42d7-b7ea-79c832aab569 HTTP/1.1" status: 200 len: 945 time: 0.2529280 Nov 02 12:52:22.530758 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port b65f9b1f-06b2-4ae0-8e61-2d41782bdb81 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:52:22.531146 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:22.716117 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-0ab60ff8-a7a9-44cb-b634-35a052ced496 req-3fc58bc3-32d9-4849-af7b-938c7ed1aea3 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] For port 2cf235b6-e4c1-4b00-8971-dbd528d6ad92, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=2cf235b6-e4c1-4b00-8971-dbd528d6ad92,segment=NetworkSegment(db93b928-f362-4483-9a9d-ce7880e2d162),segment_id=db93b928-f362-4483-9a9d-ce7880e2d162)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:52:22.716495 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-0ab60ff8-a7a9-44cb-b634-35a052ced496 req-3fc58bc3-32d9-4849-af7b-938c7ed1aea3 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:22.725520 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [req-185eb808-6b32-49db-9278-4df7574a082c req-58e53ddc-ff76-4f3c-a86e-a20ed14b17d3 service neutron] http://10.222.0.98:9696/v2.0/extensions returned with HTTP 200 {{(pid=108543) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 02 12:52:22.736027 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-185eb808-6b32-49db-9278-4df7574a082c req-58e53ddc-ff76-4f3c-a86e-a20ed14b17d3 service neutron] 10.222.0.98 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13869 time: 0.0245762 Nov 02 12:52:22.800707 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-0ab60ff8-a7a9-44cb-b634-35a052ced496 req-3fc58bc3-32d9-4849-af7b-938c7ed1aea3 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Calling delete_port for 2cf235b6-e4c1-4b00-8971-dbd528d6ad92 owned by compute:nova {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:52:22.825561 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [req-f4157e6d-f9fc-46d0-8b31-d4c5ed2eb102 req-4dfc0ea1-d753-4067-a6d8-b407fbdb2c65 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Deleting port 28651645-026f-45f9-aa05-0f14a102b65a {{(pid=108542) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:52:22.826214 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-f4157e6d-f9fc-46d0-8b31-d4c5ed2eb102 req-4dfc0ea1-d753-4067-a6d8-b407fbdb2c65 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:22.843027 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cbfce34-3f0c-4033-bdc4-9cd1930ce218 req-e34eec64-57fb-40d5-a39a-092813cdfea2 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:22.850724 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3cbfce34-3f0c-4033-bdc4-9cd1930ce218 req-e34eec64-57fb-40d5-a39a-092813cdfea2 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 946 time: 0.2672758 Nov 02 12:52:22.948651 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-78174ace-60ad-4c98-9c93-3f2e93a753ce service neutron] 10.222.0.90 "GET /v2.0/networks/bfe7dfe3-4b23-4454-b60a-4955be8d2d31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4786987 Nov 02 12:52:22.950202 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [req-f4157e6d-f9fc-46d0-8b31-d4c5ed2eb102 req-4dfc0ea1-d753-4067-a6d8-b407fbdb2c65 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] For port 28651645-026f-45f9-aa05-0f14a102b65a, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=28651645-026f-45f9-aa05-0f14a102b65a,segment=NetworkSegment(9918b664-73ec-4ba3-8b79-1b2dd2746c03),segment_id=9918b664-73ec-4ba3-8b79-1b2dd2746c03)] {{(pid=108542) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:52:22.950729 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-f4157e6d-f9fc-46d0-8b31-d4c5ed2eb102 req-4dfc0ea1-d753-4067-a6d8-b407fbdb2c65 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:23.000274 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [req-f4157e6d-f9fc-46d0-8b31-d4c5ed2eb102 req-4dfc0ea1-d753-4067-a6d8-b407fbdb2c65 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Calling delete_port for 28651645-026f-45f9-aa05-0f14a102b65a owned by compute:nova {{(pid=108542) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:52:23.097311 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3cbfce34-3f0c-4033-bdc4-9cd1930ce218 req-a25821c8-b15e-4d37-b695-4b79159f474a tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2433116 Nov 02 12:52:23.124111 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9c9bb37d-8f7a-4086-864f-d1f63b9afe46 req-4fda29e7-c2f8-4b74-baea-ce2267d48bed service neutron] 10.222.0.90 "GET /v2.0/networks/bfe7dfe3-4b23-4454-b60a-4955be8d2d31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1659009 Nov 02 12:52:23.260144 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4acc43e0-c1f3-4bf2-b7d8-0d2c7e2522e7 req-2c202fe4-c472-4944-9b78-29669f42048d tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:23.262540 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4acc43e0-c1f3-4bf2-b7d8-0d2c7e2522e7 req-2c202fe4-c472-4944-9b78-29669f42048d tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=78f23d67-5bb3-42d7-b7ea-79c832aab569 HTTP/1.1" status: 200 len: 945 time: 0.1313736 Nov 02 12:52:23.295558 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-965db432-f645-45b1-8ed5-89b387573f83 req-24090649-79f8-4bb9-a021-5bd2c24953c0 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:23.298529 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-965db432-f645-45b1-8ed5-89b387573f83 req-24090649-79f8-4bb9-a021-5bd2c24953c0 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.0889766 Nov 02 12:52:23.374954 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-0ab60ff8-a7a9-44cb-b634-35a052ced496 req-3fc58bc3-32d9-4849-af7b-938c7ed1aea3 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:23.387709 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['d32b527e-e041-40dd-b3b1-a7c080a56c87'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:52:23.456562 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4acc43e0-c1f3-4bf2-b7d8-0d2c7e2522e7 req-9605f4e8-e40a-4286-9d5a-b5a948506ac5 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/security-groups?id=eadb1119-2269-4956-923b-c60da15e2d12&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1772504 Nov 02 12:52:23.465077 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-f4157e6d-f9fc-46d0-8b31-d4c5ed2eb102 req-4dfc0ea1-d753-4067-a6d8-b407fbdb2c65 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:23.473114 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3fc58bc3-32d9-4849-af7b-938c7ed1aea3 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Pushing event deleted for resources: {'Port': ['ID=2cf235b6-e4c1-4b00-8971-dbd528d6ad92,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:23.506013 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-965db432-f645-45b1-8ed5-89b387573f83 req-7699c753-e95e-4303-b55d-c39c564eea6f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1910534 Nov 02 12:52:23.534023 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a162c9cc-3e77-4f60-bacf-da8fd1e1b478 req-87d148a8-0a47-4001-938c-5b1483d24607 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:23.536596 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a162c9cc-3e77-4f60-bacf-da8fd1e1b478 req-87d148a8-0a47-4001-938c-5b1483d24607 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=dfe80527be524672a94a38908e154182&device_id=c09c5da0-2ee0-40c1-b5fb-f06550d58ee4 HTTP/1.1" status: 200 len: 1097 time: 0.2229097 Nov 02 12:52:23.583786 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-0ab60ff8-a7a9-44cb-b634-35a052ced496 req-3fc58bc3-32d9-4849-af7b-938c7ed1aea3 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] No DVR routers for this DVR port 2cf235b6-e4c1-4b00-8971-dbd528d6ad92 on host hv-cinder-81632 {{(pid=108543) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 12:52:23.603052 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-0ab60ff8-a7a9-44cb-b634-35a052ced496 req-3fc58bc3-32d9-4849-af7b-938c7ed1aea3 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:23.615686 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0ab60ff8-a7a9-44cb-b634-35a052ced496 req-3fc58bc3-32d9-4849-af7b-938c7ed1aea3 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.90 "DELETE /v2.0/ports/2cf235b6-e4c1-4b00-8971-dbd528d6ad92 HTTP/1.1" status: 204 len: 173 time: 1.6427279 Nov 02 12:52:23.681259 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c154b8b0-3a34-45a1-ae74-e1ff9ad8f783 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:23.776102 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a162c9cc-3e77-4f60-bacf-da8fd1e1b478 req-4db3f25b-b3b9-43dd-8f4e-94a1347af4b9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:23.778040 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a162c9cc-3e77-4f60-bacf-da8fd1e1b478 req-4db3f25b-b3b9-43dd-8f4e-94a1347af4b9 service neutron] 10.222.0.90 "GET /v2.0/networks?id=bfe7dfe3-4b23-4454-b60a-4955be8d2d31 HTTP/1.1" status: 200 len: 916 time: 0.2332976 Nov 02 12:52:23.792598 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-23bceae5-66b1-4b8b-aee5-c4a4c76a69fb req-3b48ef52-1055-47b3-bdae-90df697cd1b2 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:23.796925 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-23bceae5-66b1-4b8b-aee5-c4a4c76a69fb req-3b48ef52-1055-47b3-bdae-90df697cd1b2 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=c09c5da0-2ee0-40c1-b5fb-f06550d58ee4 HTTP/1.1" status: 200 len: 944 time: 0.1030898 Nov 02 12:52:23.815355 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4dfc0ea1-d753-4067-a6d8-b407fbdb2c65 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Pushing event deleted for resources: {'Port': ['ID=28651645-026f-45f9-aa05-0f14a102b65a,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:23.818060 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [req-f4157e6d-f9fc-46d0-8b31-d4c5ed2eb102 req-4dfc0ea1-d753-4067-a6d8-b407fbdb2c65 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] No DVR routers for this DVR port 28651645-026f-45f9-aa05-0f14a102b65a on host hv-cinder-81632 {{(pid=108542) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 12:52:23.822082 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-f4157e6d-f9fc-46d0-8b31-d4c5ed2eb102 req-4dfc0ea1-d753-4067-a6d8-b407fbdb2c65 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:23.826468 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-f4157e6d-f9fc-46d0-8b31-d4c5ed2eb102 req-4dfc0ea1-d753-4067-a6d8-b407fbdb2c65 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.90 "DELETE /v2.0/ports/28651645-026f-45f9-aa05-0f14a102b65a HTTP/1.1" status: 204 len: 173 time: 1.2995410 Nov 02 12:52:23.827241 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '78f23d67-5bb3-42d7-b7ea-79c832aab569', 'name': 'network-vif-deleted', 'tag': '28651645-026f-45f9-aa05-0f14a102b65a'}] {{(pid=108542) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:52:23.830070 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8fdc2194739644bb754d6b187539f80d2eba7dc5c5d5392f1a2d22d03c0a316c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a90aad6c-7628-443a-b702-ba5f4bb6cc53" -d '{"events": [{"server_uuid": "78f23d67-5bb3-42d7-b7ea-79c832aab569", "name": "network-vif-deleted", "tag": "28651645-026f-45f9-aa05-0f14a102b65a"}]}' {{(pid=108542) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:52:23.907960 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:52:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-b5c98649-597c-4f9c-8c65-cff925d00b61 x-openstack-request-id: req-b5c98649-597c-4f9c-8c65-cff925d00b61 {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:52:23.908256 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "78f23d67-5bb3-42d7-b7ea-79c832aab569", "name": "network-vif-deleted", "tag": "28651645-026f-45f9-aa05-0f14a102b65a", "status": "completed", "code": 200}]} {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:52:23.908513 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-b5c98649-597c-4f9c-8c65-cff925d00b61 {{(pid=108542) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:52:23.909152 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '78f23d67-5bb3-42d7-b7ea-79c832aab569', 'name': 'network-vif-deleted', 'tag': '28651645-026f-45f9-aa05-0f14a102b65a', 'status': 'completed', 'code': 200} Nov 02 12:52:23.955580 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a162c9cc-3e77-4f60-bacf-da8fd1e1b478 req-bc6ebd47-5957-4285-9931-ceca6ff3ef43 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=f173e8db-9c28-4415-be12-b2f898eb931e HTTP/1.1" status: 200 len: 217 time: 0.1544585 Nov 02 12:52:24.034304 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-23bceae5-66b1-4b8b-aee5-c4a4c76a69fb req-7f609661-4cd2-4df4-944d-7cd2f3dc3ec8 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1912925 Nov 02 12:52:24.038014 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a162c9cc-3e77-4f60-bacf-da8fd1e1b478 req-5d0c75b8-58fd-45d5-a39b-a767d8b22200 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:24.039533 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a162c9cc-3e77-4f60-bacf-da8fd1e1b478 req-5d0c75b8-58fd-45d5-a39b-a767d8b22200 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=8f42833a-0a0e-4198-a7cf-e79133593615 HTTP/1.1" status: 200 len: 855 time: 0.0752554 Nov 02 12:52:24.087973 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a162c9cc-3e77-4f60-bacf-da8fd1e1b478 req-d72d305d-fb35-419b-b688-e110c01b0489 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=bfe7dfe3-4b23-4454-b60a-4955be8d2d31&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0279276 Nov 02 12:52:24.140961 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['28651645-026f-45f9-aa05-0f14a102b65a'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:52:24.203750 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '96a98d45-ba9a-48b2-a608-9596dc5a2988', 'name': 'network-vif-deleted', 'tag': '2cf235b6-e4c1-4b00-8971-dbd528d6ad92'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:52:24.209072 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-60697f16-829f-4c3d-b442-e63c25705a48" -d '{"events": [{"server_uuid": "96a98d45-ba9a-48b2-a608-9596dc5a2988", "name": "network-vif-deleted", "tag": "2cf235b6-e4c1-4b00-8971-dbd528d6ad92"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:52:24.213176 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 2cf235b6-e4c1-4b00-8971-dbd528d6ad92 no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:52:24.248262 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a162c9cc-3e77-4f60-bacf-da8fd1e1b478 req-3cbea867-975b-42ff-ac51-9e6344db909a service neutron] 10.222.0.90 "GET /v2.0/networks/bfe7dfe3-4b23-4454-b60a-4955be8d2d31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1445162 Nov 02 12:52:24.249909 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] No Port match for: 2cf235b6-e4c1-4b00-8971-dbd528d6ad92 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:52:24.250254 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 2cf235b6-e4c1-4b00-8971-dbd528d6ad92 not bound to the agent host hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:52:24.250687 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 28651645-026f-45f9-aa05-0f14a102b65a no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:52:24.272923 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] No Port match for: 28651645-026f-45f9-aa05-0f14a102b65a {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:52:24.273305 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 28651645-026f-45f9-aa05-0f14a102b65a not bound to the agent host hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:52:24.304332 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:52:24 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8200ac49-5e90-4ba4-80af-c95689511311 x-openstack-request-id: req-8200ac49-5e90-4ba4-80af-c95689511311 {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:52:24.304667 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "96a98d45-ba9a-48b2-a608-9596dc5a2988", "name": "network-vif-deleted", "tag": "2cf235b6-e4c1-4b00-8971-dbd528d6ad92", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:52:24.304893 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-8200ac49-5e90-4ba4-80af-c95689511311 {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:52:24.305306 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '96a98d45-ba9a-48b2-a608-9596dc5a2988', 'name': 'network-vif-deleted', 'tag': '2cf235b6-e4c1-4b00-8971-dbd528d6ad92', 'status': 'completed', 'code': 200} Nov 02 12:52:24.313418 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a89cd00f-0b13-426b-831d-339d7da2ef34 req-83b97e5f-4ec3-4f1f-bc56-c902469f4d18 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=96a98d45-ba9a-48b2-a608-9596dc5a2988 HTTP/1.1" status: 200 len: 210 time: 0.0603333 Nov 02 12:52:24.336742 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 59210) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:24.398530 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a162c9cc-3e77-4f60-bacf-da8fd1e1b478 req-f3c19e08-ed68-46bd-a535-2816735c42d5 service neutron] 10.222.0.90 "GET /v2.0/networks/bfe7dfe3-4b23-4454-b60a-4955be8d2d31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1371341 Nov 02 12:52:24.447374 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-f97adaca-894d-4244-8e8b-dc43708966fe req-b4483e2d-5719-4522-9ee3-2945d22e2e60 service neutron] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.1087339 Nov 02 12:52:24.455929 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [req-f97adaca-894d-4244-8e8b-dc43708966fe req-fac5081a-ee35-4ec0-9ac2-7be9fb52f020 service neutron] http://10.222.0.98:9696/v2.0/extensions returned with HTTP 200 {{(pid=108542) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 02 12:52:24.457092 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-f97adaca-894d-4244-8e8b-dc43708966fe req-fac5081a-ee35-4ec0-9ac2-7be9fb52f020 service neutron] 10.222.0.98 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13869 time: 0.0059321 Nov 02 12:52:24.788743 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-93503207-205a-4374-80ec-3ddad4c61c06 req-3fd19f62-ab93-4867-85aa-163681594af1 tempest-VolumesActionsTest-1125425012 tempest-VolumesActionsTest-1125425012-project] 10.222.0.98 "GET /v2.0/ports?device_id=78f23d67-5bb3-42d7-b7ea-79c832aab569 HTTP/1.1" status: 200 len: 210 time: 0.0523205 Nov 02 12:52:24.819434 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7c817cc-8fb1-4398-892e-491b3551df36 req-88d616d8-cf3c-488a-b312-178a6d9ba678 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:24.819979 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c7c817cc-8fb1-4398-892e-491b3551df36 req-88d616d8-cf3c-488a-b312-178a6d9ba678 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.1204245 Nov 02 12:52:24.877995 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c7c817cc-8fb1-4398-892e-491b3551df36 req-53dc500b-c1d9-44b1-a139-15e57a4ec75f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0515966 Nov 02 12:52:25.170635 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2d75e52-b826-4abe-b3fa-c65e94acfe8a req-4111cf4a-3577-408a-bb15-0a3e682f545c tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:25.172332 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e2d75e52-b826-4abe-b3fa-c65e94acfe8a req-4111cf4a-3577-408a-bb15-0a3e682f545c tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=c09c5da0-2ee0-40c1-b5fb-f06550d58ee4 HTTP/1.1" status: 200 len: 944 time: 0.0607226 Nov 02 12:52:25.227999 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e2d75e52-b826-4abe-b3fa-c65e94acfe8a req-79474694-4c10-4284-9e02-dcf8f724843b tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0460684 Nov 02 12:52:25.244735 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 59240) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:25.402406 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-64535155-14a5-4206-8326-73bd2f78839d admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=f8553176e5c84edb8b82d01321b30b1c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1558664 Nov 02 12:52:25.405149 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 59248) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:25.462169 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-9f328b55-f499-422a-a014-c385780c0f52 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:25.486574 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-9f328b55-f499-422a-a014-c385780c0f52 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:25.625811 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-9f328b55-f499-422a-a014-c385780c0f52 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:25.631861 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-9f328b55-f499-422a-a014-c385780c0f52 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:25.631861 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-9f328b55-f499-422a-a014-c385780c0f52 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/e08e9b2e-bc35-40ca-a7bb-1d6bfbdd9ad3 HTTP/1.1" status: 204 len: 168 time: 0.2243156 Nov 02 12:52:25.640007 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f328b55-f499-422a-a014-c385780c0f52 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e08e9b2e-bc35-40ca-a7bb-1d6bfbdd9ad3,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:25.682583 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fe5cc83-1611-4cc5-a4b5-e77f73808d76 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:25.995942 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-094f7935-825a-4ffc-b77d-6b4ab828e8b0 req-dbd30d04-c7c8-4e66-b9d1-4961d41d9c02 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:25.997799 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-094f7935-825a-4ffc-b77d-6b4ab828e8b0 req-dbd30d04-c7c8-4e66-b9d1-4961d41d9c02 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.0898812 Nov 02 12:52:26.090801 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-88ef7534-131d-4777-b895-efdb6193947a req-985205c4-06b0-4379-99fd-52d3f481c71b tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:26.098570 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-88ef7534-131d-4777-b895-efdb6193947a req-985205c4-06b0-4379-99fd-52d3f481c71b tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.1256869 Nov 02 12:52:26.163390 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-094f7935-825a-4ffc-b77d-6b4ab828e8b0 req-ac3e730e-6c20-45ab-af96-8db3c8b55fff tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1315236 Nov 02 12:52:26.197418 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-88ef7534-131d-4777-b895-efdb6193947a req-b3839bd8-7ddf-4753-a479-e925fd79034c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0975819 Nov 02 12:52:26.221266 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device f173e8db-9c28-4415-be12-b2f898eb931e details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 12:52:26.326716 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port f173e8db-9c28-4415-be12-b2f898eb931e, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=f173e8db-9c28-4415-be12-b2f898eb931e,segment=NetworkSegment(e912b2b1-808c-4d37-a99d-fcfdb9d2a5db),segment_id=e912b2b1-808c-4d37-a99d-fcfdb9d2a5db)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:52:26.339854 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': 'f173e8db-9c28-4415-be12-b2f898eb931e', 'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31', 'port_id': 'f173e8db-9c28-4415-be12-b2f898eb931e', 'mac_address': 'fa:16:3e:9c:8d:29', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 862, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8f42833a-0a0e-4198-a7cf-e79133593615', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 12:52:26.367210 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ed4fe22-f3ee-4bb4-af8f-f129b1aefbd5 req-97493252-c8e7-4313-bb8e-08c29b5e583a tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:26.368933 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0ed4fe22-f3ee-4bb4-af8f-f129b1aefbd5 req-97493252-c8e7-4313-bb8e-08c29b5e583a tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=c09c5da0-2ee0-40c1-b5fb-f06550d58ee4 HTTP/1.1" status: 200 len: 944 time: 0.0610003 Nov 02 12:52:26.383941 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:26.400248 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id f173e8db-9c28-4415-be12-b2f898eb931e {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:52:26.425253 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port f173e8db-9c28-4415-be12-b2f898eb931e, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=f173e8db-9c28-4415-be12-b2f898eb931e,segment=NetworkSegment(e912b2b1-808c-4d37-a99d-fcfdb9d2a5db),segment_id=e912b2b1-808c-4d37-a99d-fcfdb9d2a5db)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:52:26.432087 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0ed4fe22-f3ee-4bb4-af8f-f129b1aefbd5 req-8aab824e-1b74-4b08-b345-f632b25b30cb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0494440 Nov 02 12:52:26.550963 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:26.608796 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=f173e8db-9c28-4415-be12-b2f898eb931e,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:26.839753 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['f173e8db-9c28-4415-be12-b2f898eb931e'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:52:26.910710 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:27.299142 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab15373e-f97f-4902-b382-03733df2165e req-6b010a38-7706-4b30-9bd6-05f83145d879 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:27.300754 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ab15373e-f97f-4902-b382-03733df2165e req-6b010a38-7706-4b30-9bd6-05f83145d879 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.0578458 Nov 02 12:52:27.394564 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e97f1b26-9d29-435e-9519-3010a12576d0 req-cf71a493-f8f8-4f5d-aa99-3bf5154098ce tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:27.396132 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e97f1b26-9d29-435e-9519-3010a12576d0 req-cf71a493-f8f8-4f5d-aa99-3bf5154098ce tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.0944276 Nov 02 12:52:27.399905 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ab15373e-f97f-4902-b382-03733df2165e req-b57cabac-8249-49ce-814e-764461bc8c27 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0895634 Nov 02 12:52:27.448762 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e97f1b26-9d29-435e-9519-3010a12576d0 req-5f636a9a-a6e2-4166-93a4-4584763bf202 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443728 Nov 02 12:52:27.480433 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:52:27.567589 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6da819a-3212-4977-9575-dcfa8a5e3f2f req-4685336a-3941-49de-a359-c18937e7c7ac tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:27.569248 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c6da819a-3212-4977-9575-dcfa8a5e3f2f req-4685336a-3941-49de-a359-c18937e7c7ac tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=c09c5da0-2ee0-40c1-b5fb-f06550d58ee4 HTTP/1.1" status: 200 len: 945 time: 0.0633371 Nov 02 12:52:27.631660 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c6da819a-3212-4977-9575-dcfa8a5e3f2f req-18256593-af05-411c-bd83-ecbeefe49ed0 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0552638 Nov 02 12:52:28.230806 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device f173e8db-9c28-4415-be12-b2f898eb931e up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:52:28.297989 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f97adaca-894d-4244-8e8b-dc43708966fe req-76c9ff82-bfd8-41bd-a310-26908a152fd0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:28.301060 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f97adaca-894d-4244-8e8b-dc43708966fe req-76c9ff82-bfd8-41bd-a310-26908a152fd0 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f&tenant_id=aaddc046689441b8ab3641f2afd07c0e HTTP/1.1" status: 200 len: 1096 time: 0.1097834 Nov 02 12:52:28.396791 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:28.419474 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f97adaca-894d-4244-8e8b-dc43708966fe req-597db9cb-b170-4564-b388-33bc3f4a0ced service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:28.421364 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f97adaca-894d-4244-8e8b-dc43708966fe req-597db9cb-b170-4564-b388-33bc3f4a0ced service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=aaddc046689441b8ab3641f2afd07c0e&device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 1096 time: 0.0828848 Nov 02 12:52:28.453265 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning for port f173e8db-9c28-4415-be12-b2f898eb931e completed by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 02 12:52:28.458695 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port f173e8db-9c28-4415-be12-b2f898eb931e triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:52:28.459366 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:28.572535 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:28.600099 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c09c5da0-2ee0-40c1-b5fb-f06550d58ee4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f173e8db-9c28-4415-be12-b2f898eb931e'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:52:28.602758 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f736d141-cb1f-419d-b1f5-c8bb2bdda2e1" -d '{"events": [{"server_uuid": "c09c5da0-2ee0-40c1-b5fb-f06550d58ee4", "name": "network-vif-plugged", "status": "completed", "tag": "f173e8db-9c28-4415-be12-b2f898eb931e"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:52:28.621682 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port f173e8db-9c28-4415-be12-b2f898eb931e, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=f173e8db-9c28-4415-be12-b2f898eb931e,segment=NetworkSegment(e912b2b1-808c-4d37-a99d-fcfdb9d2a5db),segment_id=e912b2b1-808c-4d37-a99d-fcfdb9d2a5db)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:52:28.629080 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f97adaca-894d-4244-8e8b-dc43708966fe req-37f02275-352e-4acf-b3f3-99ce7f9b5a14 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:28.632481 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f97adaca-894d-4244-8e8b-dc43708966fe req-37f02275-352e-4acf-b3f3-99ce7f9b5a14 service neutron] 10.222.0.90 "GET /v2.0/networks?id=c468f0e1-3636-49b9-90c6-b90c643ed7d1 HTTP/1.1" status: 200 len: 917 time: 0.1939340 Nov 02 12:52:28.673785 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40d28fe7-f549-4b76-9d4a-3febeb46e5b7 req-1dcf99f6-3b6c-4785-abe2-e2ed1b5534fe tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:28.676401 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-40d28fe7-f549-4b76-9d4a-3febeb46e5b7 req-1dcf99f6-3b6c-4785-abe2-e2ed1b5534fe tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.1566713 Nov 02 12:52:28.689738 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-ce2d8d03-5b4a-4a4e-bf7d-45bd998385f6 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-1207454379&fields=id&tenant_id=d3bf5c9bdd7f479aa4cbc28f9a007c81 HTTP/1.1" status: 200 len: 267 time: 0.1688073 Nov 02 12:52:29.128592 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:29.131089 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-40d28fe7-f549-4b76-9d4a-3febeb46e5b7 req-a7629dac-0061-493a-a71c-0ff18755a8f0 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1578462 Nov 02 12:52:29.132766 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=f173e8db-9c28-4415-be12-b2f898eb931e,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:29.135114 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-1d81985d-310c-49d3-86b8-bc34f0a5076f tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:29.135114 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-1d81985d-310c-49d3-86b8-bc34f0a5076f tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/networks?id=adffa68a-25de-4006-9dcc-006cbedf32e3 HTTP/1.1" status: 200 len: 809 time: 0.2084069 Nov 02 12:52:29.135114 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-7cfc07c5-8929-4c16-ae2d-73f0be85528e tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/quotas/d3bf5c9bdd7f479aa4cbc28f9a007c81 HTTP/1.1" status: 200 len: 375 time: 0.0117552 Nov 02 12:52:29.135114 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-6bfe151a-13de-4568-911b-b4e3f0778bce tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?tenant_id=d3bf5c9bdd7f479aa4cbc28f9a007c81&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0841949 Nov 02 12:52:29.135114 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-66e500d3-ae7d-4770-baf0-0f2cdd3f719d req-8a7d1d63-fdab-4569-8ce0-008fda3798c2 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:29.135114 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-66e500d3-ae7d-4770-baf0-0f2cdd3f719d req-8a7d1d63-fdab-4569-8ce0-008fda3798c2 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.0881822 Nov 02 12:52:29.167273 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-66e500d3-ae7d-4770-baf0-0f2cdd3f719d req-6c154f64-2b87-4e2f-92d6-06509d7799a7 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1220796 Nov 02 12:52:29.197700 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-92e7cfa6-f731-411c-b41c-0bfd8c6f2da0 service neutron] 10.222.0.98 "GET /v2.0/networks/adffa68a-25de-4006-9dcc-006cbedf32e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1455016 Nov 02 12:52:29.261154 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:52:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7dd68f9e-6f3c-4aac-9f29-fe51309bc8ab x-openstack-request-id: req-7dd68f9e-6f3c-4aac-9f29-fe51309bc8ab {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:52:29.261154 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c09c5da0-2ee0-40c1-b5fb-f06550d58ee4", "name": "network-vif-plugged", "status": "completed", "tag": "f173e8db-9c28-4415-be12-b2f898eb931e", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:52:29.261154 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-7dd68f9e-6f3c-4aac-9f29-fe51309bc8ab {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:52:29.261154 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c09c5da0-2ee0-40c1-b5fb-f06550d58ee4', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'f173e8db-9c28-4415-be12-b2f898eb931e', 'code': 200} Nov 02 12:52:29.336619 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-2f524ef5-3788-4637-8e11-f612c54d083d service neutron] 10.222.0.98 "GET /v2.0/networks/adffa68a-25de-4006-9dcc-006cbedf32e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1281097 Nov 02 12:52:29.373343 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a03c254-b013-4a60-9c3d-702aaaeab67a req-abc6d720-a980-4c71-87fe-20198cf4bc7c tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:29.375482 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a03c254-b013-4a60-9c3d-702aaaeab67a req-abc6d720-a980-4c71-87fe-20198cf4bc7c tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=c09c5da0-2ee0-40c1-b5fb-f06550d58ee4 HTTP/1.1" status: 200 len: 946 time: 0.0755177 Nov 02 12:52:29.435784 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a03c254-b013-4a60-9c3d-702aaaeab67a req-ae57358b-4f39-4ab4-8887-dfd7d0ddcea3 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0525486 Nov 02 12:52:30.025577 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a4e5a6fc-9949-4e33-bff6-457bb11a4c11 req-d2fba93d-b875-456e-a769-96db1718cb7a tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:30.035956 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a4e5a6fc-9949-4e33-bff6-457bb11a4c11 req-d2fba93d-b875-456e-a769-96db1718cb7a tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.0815794 Nov 02 12:52:30.105964 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e323ce5a-bd29-4b43-8f0f-2aa80a19f612 req-e082d471-9e87-4495-9313-88cd292bfb9a tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 210 time: 0.0500774 Nov 02 12:52:30.138825 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a4e5a6fc-9949-4e33-bff6-457bb11a4c11 req-8d4f4f33-dce3-466c-9d49-daacc0deb56c tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0993011 Nov 02 12:52:30.307681 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d08a062-03ce-4b57-adae-27a206469c4b req-7316cc65-fc42-4580-9991-33962f70e430 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:30.310055 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2d08a062-03ce-4b57-adae-27a206469c4b req-7316cc65-fc42-4580-9991-33962f70e430 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.0578995 Nov 02 12:52:30.369760 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2d08a062-03ce-4b57-adae-27a206469c4b req-6d8c0aed-092e-42a8-9f61-518583b51a9b tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0532477 Nov 02 12:52:30.567533 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-132ab52e-aba7-4eb5-8222-23868c4820f5 req-6170ed2b-2b45-4246-8103-ee944d111a93 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:30.569039 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-132ab52e-aba7-4eb5-8222-23868c4820f5 req-6170ed2b-2b45-4246-8103-ee944d111a93 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=c09c5da0-2ee0-40c1-b5fb-f06550d58ee4 HTTP/1.1" status: 200 len: 946 time: 0.0546362 Nov 02 12:52:30.628348 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-132ab52e-aba7-4eb5-8222-23868c4820f5 req-dff97638-e762-4cb6-99b5-118ce8bec923 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0524564 Nov 02 12:52:30.806652 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:31.178883 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-46033e3d-4007-49f9-a1c8-349967ca5fe2 req-c58d5833-f36f-4a19-ba45-2f1bcf1f7195 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 210 time: 0.0268245 Nov 02 12:52:31.276508 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-878f802d-5581-4ff4-9b9f-b7eaf760df95 req-fe4a16be-ff5a-4ed1-8f1b-f6cc5ced6135 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:31.279254 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-878f802d-5581-4ff4-9b9f-b7eaf760df95 req-fe4a16be-ff5a-4ed1-8f1b-f6cc5ced6135 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.0502989 Nov 02 12:52:31.330838 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-878f802d-5581-4ff4-9b9f-b7eaf760df95 req-9ec1c4b7-6745-4dd7-b3fe-f9460e979e81 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453970 Nov 02 12:52:31.520035 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-830d1358-e514-44b2-89f7-d55783766cc9 req-5d3223bc-d62c-47a9-8c80-82ebfdf09dc9 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:31.520035 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-830d1358-e514-44b2-89f7-d55783766cc9 req-5d3223bc-d62c-47a9-8c80-82ebfdf09dc9 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.0497108 Nov 02 12:52:31.570728 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-830d1358-e514-44b2-89f7-d55783766cc9 req-46bc3d7b-5a2f-437e-a03e-114f7dd4bb79 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0485768 Nov 02 12:52:31.697565 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f97adaca-894d-4244-8e8b-dc43708966fe req-7cbbc20f-67c7-4424-b281-572e38b47fd4 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=bf7c4605-4045-4117-af22-08d75129b835 HTTP/1.1" status: 200 len: 999 time: 0.0680397 Nov 02 12:52:32.041075 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f97adaca-894d-4244-8e8b-dc43708966fe req-69c1778c-4788-4fe5-9c9a-128069f10174 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:32.042627 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f97adaca-894d-4244-8e8b-dc43708966fe req-69c1778c-4788-4fe5-9c9a-128069f10174 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=ec48fe57-a1cd-4e7c-874f-073624f71f4b HTTP/1.1" status: 200 len: 855 time: 0.3372347 Nov 02 12:52:32.049862 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d664b51-103d-4522-902b-6e6f4855ce33 req-b6b019c3-c4e3-48d4-a8df-67711abd0def service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:32.051833 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-4d664b51-103d-4522-902b-6e6f4855ce33 req-b6b019c3-c4e3-48d4-a8df-67711abd0def service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=c09c5da0-2ee0-40c1-b5fb-f06550d58ee4 HTTP/1.1" status: 200 len: 1099 time: 0.0592949 Nov 02 12:52:32.052544 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-123d8c8e-6355-4fe4-99e5-ee7c4e6f495a req-5d9bd44b-0d42-4a6c-90c3-57c2127589fc tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:32.054150 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-123d8c8e-6355-4fe4-99e5-ee7c4e6f495a req-5d9bd44b-0d42-4a6c-90c3-57c2127589fc tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=c09c5da0-2ee0-40c1-b5fb-f06550d58ee4 HTTP/1.1" status: 200 len: 946 time: 0.3408623 Nov 02 12:52:32.117479 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-4d664b51-103d-4522-902b-6e6f4855ce33 req-3c7e1454-a810-437a-9746-07c8780f9568 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0465345 Nov 02 12:52:32.130416 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f97adaca-894d-4244-8e8b-dc43708966fe req-20744a44-04ee-493a-b1f6-2f72d3562fa5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:32.131930 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f97adaca-894d-4244-8e8b-dc43708966fe req-20744a44-04ee-493a-b1f6-2f72d3562fa5 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=c468f0e1-3636-49b9-90c6-b90c643ed7d1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0768001 Nov 02 12:52:32.135719 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-123d8c8e-6355-4fe4-99e5-ee7c4e6f495a req-538f9dcf-86f4-4ce0-adbd-6be9e72bedf4 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0718029 Nov 02 12:52:32.277829 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ea520818-c964-46cc-9644-bd4f7f4f80cd req-66164ba0-6b3c-47d9-90ff-afc4abbbf5a7 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 210 time: 0.0267100 Nov 02 12:52:32.483039 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f97adaca-894d-4244-8e8b-dc43708966fe req-080749e8-562c-464e-8ea4-88223a872cc7 service neutron] 10.222.0.90 "GET /v2.0/networks/c468f0e1-3636-49b9-90c6-b90c643ed7d1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1604369 Nov 02 12:52:32.515822 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a522c822-4a82-4754-8e0d-6b2f102bf0d6 req-e4d2cafa-7534-4157-9d3a-161236011189 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:32.517357 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a522c822-4a82-4754-8e0d-6b2f102bf0d6 req-e4d2cafa-7534-4157-9d3a-161236011189 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.1003785 Nov 02 12:52:32.626180 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a522c822-4a82-4754-8e0d-6b2f102bf0d6 req-53a15899-db60-43e1-918b-29c96dc0a481 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0986192 Nov 02 12:52:32.639491 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f97adaca-894d-4244-8e8b-dc43708966fe req-c9d03098-3cdb-4681-8c10-4296cee154b4 service neutron] 10.222.0.90 "GET /v2.0/networks/c468f0e1-3636-49b9-90c6-b90c643ed7d1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1405752 Nov 02 12:52:32.718420 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ce445e85-5a59-4043-9b8f-29e3a7f6769b req-d57f61ab-d621-47cd-9aa9-6c5200bbcac9 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:32.720446 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ce445e85-5a59-4043-9b8f-29e3a7f6769b req-d57f61ab-d621-47cd-9aa9-6c5200bbcac9 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.0670357 Nov 02 12:52:32.791947 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ce445e85-5a59-4043-9b8f-29e3a7f6769b req-8690f445-5a06-4c20-8e7b-d280e01ae736 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0634928 Nov 02 12:52:33.225570 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-0e8d5d69-0748-49c1-863b-6f620fa6a353 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:33.227148 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-0e8d5d69-0748-49c1-863b-6f620fa6a353 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.90 "GET /v2.0/networks?id=adffa68a-25de-4006-9dcc-006cbedf32e3 HTTP/1.1" status: 200 len: 809 time: 0.1345978 Nov 02 12:52:33.315564 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:33.333101 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d61cd287-090c-4c41-b9e7-c88bf3bc812a req-32cc1208-351d-4039-91d3-1f59ce989b4c tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:33.342093 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d61cd287-090c-4c41-b9e7-c88bf3bc812a req-32cc1208-351d-4039-91d3-1f59ce989b4c tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=c09c5da0-2ee0-40c1-b5fb-f06550d58ee4 HTTP/1.1" status: 200 len: 946 time: 0.1137214 Nov 02 12:52:33.453912 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-d21e03f4-7dad-4bc6-9517-23f48b3f18b8 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.90 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=d3bf5c9bdd7f479aa4cbc28f9a007c81 HTTP/1.1" status: 200 len: 380 time: 0.2095101 Nov 02 12:52:33.458675 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e8927d27-b229-4b23-9b7a-6a81139944bb req-54ed683c-8d72-406a-b806-3a3bd21507a8 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 210 time: 0.0786324 Nov 02 12:52:33.473667 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-29f940f2-c0ea-49d4-af67-66383b777350 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Request body: {'port': {'device_id': 'd9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8', 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3', 'admin_state_up': True, 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'security_groups': ['3c1edf2a-2914-43e2-b6b9-2b238c73ff68']}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:52:33.602696 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d61cd287-090c-4c41-b9e7-c88bf3bc812a req-d74e45a8-aa08-4099-905f-afe8d794799a tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.2594132 Nov 02 12:52:33.786077 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-29f940f2-c0ea-49d4-af67-66383b777350 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Made reservation on behalf of d3bf5c9bdd7f479aa4cbc28f9a007c81 for: {'port': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:52:33.789575 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-29f940f2-c0ea-49d4-af67-66383b777350 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:33.805999 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7aa72eab-9430-4075-8edf-0c64f48bc365 req-c3a8254a-6fca-49ec-8daa-62b9a3d82ac0 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:33.807716 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7aa72eab-9430-4075-8edf-0c64f48bc365 req-c3a8254a-6fca-49ec-8daa-62b9a3d82ac0 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.0800765 Nov 02 12:52:33.946891 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7aa72eab-9430-4075-8edf-0c64f48bc365 req-f0982a35-6da2-4acc-88b1-59eb773631c4 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1312971 Nov 02 12:52:34.024778 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eb00473c-81cf-48a4-a123-e8c3eeb9df42 req-6728b9a1-a40a-43c9-8528-143956db1fe2 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:34.026341 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-eb00473c-81cf-48a4-a123-e8c3eeb9df42 req-6728b9a1-a40a-43c9-8528-143956db1fe2 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.1226540 Nov 02 12:52:34.063824 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-29f940f2-c0ea-49d4-af67-66383b777350 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Allocated IP 172.20.0.7 (adffa68a-25de-4006-9dcc-006cbedf32e3/9a20b259-01c2-4b3f-8f92-0797a18ff7f7/af83efde-b4cd-446b-9f74-15c631e4c45a) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:52:34.126621 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-eb00473c-81cf-48a4-a123-e8c3eeb9df42 req-ece52899-8430-433b-8587-67d3476124be tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0855498 Nov 02 12:52:34.277811 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-29f940f2-c0ea-49d4-af67-66383b777350 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:34.403756 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-29f940f2-c0ea-49d4-af67-66383b777350 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:34.453232 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-29f940f2-c0ea-49d4-af67-66383b777350 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Network adffa68a-25de-4006-9dcc-006cbedf32e3 is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:52:34.459179 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-29f940f2-c0ea-49d4-af67-66383b777350 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:52:34.463532 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-29f940f2-c0ea-49d4-af67-66383b777350 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:52:34.515091 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-29f940f2-c0ea-49d4-af67-66383b777350 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Pushing event updated for resources: {'Port': ['ID=af83efde-b4cd-446b-9f74-15c631e4c45a,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:34.541301 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-29f940f2-c0ea-49d4-af67-66383b777350 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:34.542001 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-29f940f2-c0ea-49d4-af67-66383b777350 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:34.670519 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-29f940f2-c0ea-49d4-af67-66383b777350 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2055943 Nov 02 12:52:34.694552 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2f5e5412-0713-406e-936c-5a0abe5edc66 req-12892db7-5a98-418b-8f0e-9cb4d765a179 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:34.697828 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2f5e5412-0713-406e-936c-5a0abe5edc66 req-12892db7-5a98-418b-8f0e-9cb4d765a179 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 931 time: 0.1282756 Nov 02 12:52:34.704163 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-1ed114e5-d2ce-433a-a88d-e797094014fb service neutron] Request body: {'port': {'device_id': 'd9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81632'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:52:34.885744 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-9d6ce005-f414-4d75-b246-95f08b6dfe00 None None] Provisioning complete for port af83efde-b4cd-446b-9f74-15c631e4c45a triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:52:34.887076 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-9d6ce005-f414-4d75-b246-95f08b6dfe00 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:34.907618 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2f5e5412-0713-406e-936c-5a0abe5edc66 req-acc8ec63-73c9-44d5-a6fb-610bede9865a tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1655700 Nov 02 12:52:34.907618 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-1ed114e5-d2ce-433a-a88d-e797094014fb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:34.931213 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4577f2f-58ea-4bfe-aac7-80c81a698de3 req-f79081ac-763f-4cb7-9f93-4038c37cb2b0 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:34.934243 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b4577f2f-58ea-4bfe-aac7-80c81a698de3 req-f79081ac-763f-4cb7-9f93-4038c37cb2b0 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=c09c5da0-2ee0-40c1-b5fb-f06550d58ee4 HTTP/1.1" status: 200 len: 946 time: 0.1768470 Nov 02 12:52:35.007837 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-9d6ce005-f414-4d75-b246-95f08b6dfe00 None None] Port af83efde-b4cd-446b-9f74-15c631e4c45a cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:52:35.265369 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b4577f2f-58ea-4bfe-aac7-80c81a698de3 req-115667fe-7df9-4988-af45-cbc2f1c19b5a tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1824493 Nov 02 12:52:35.281526 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1a8303b2-3730-4462-b325-5a1e5c313b7c req-e9977fcb-8160-4b18-8dc1-31f2ffccdedb tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:35.291161 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1a8303b2-3730-4462-b325-5a1e5c313b7c req-e9977fcb-8160-4b18-8dc1-31f2ffccdedb tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.2094271 Nov 02 12:52:35.472453 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1a8303b2-3730-4462-b325-5a1e5c313b7c req-1609ef7f-e5e7-4b82-a51c-0f810af244ce tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1803229 Nov 02 12:52:35.489330 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3f486da6-1056-4fdd-9b9e-58a7122a7f5e req-60b360a3-a1af-4c75-846b-281f3c7b6f82 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:35.497031 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3f486da6-1056-4fdd-9b9e-58a7122a7f5e req-60b360a3-a1af-4c75-846b-281f3c7b6f82 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.1495395 Nov 02 12:52:35.544994 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-92cf19a8-8eed-48d8-8160-04b6233a74be req-d8c79c25-21e2-4e67-b134-5cb4ff0a16b4 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:35.547605 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-92cf19a8-8eed-48d8-8160-04b6233a74be req-d8c79c25-21e2-4e67-b134-5cb4ff0a16b4 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.90 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 946 time: 0.0767808 Nov 02 12:52:35.619059 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3f486da6-1056-4fdd-9b9e-58a7122a7f5e req-77b9e64b-cd45-4e66-bed5-3cec87fbcb32 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1119113 Nov 02 12:52:35.708952 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-1ed114e5-d2ce-433a-a88d-e797094014fb service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id af83efde-b4cd-446b-9f74-15c631e4c45a {{(pid=108543) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:52:35.722996 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-1ed114e5-d2ce-433a-a88d-e797094014fb service neutron] Publish callbacks [] for port, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:35.738478 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [req-92cf19a8-8eed-48d8-8160-04b6233a74be req-b0f3a9b9-cd15-41a3-b681-d05521585413 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Deleting port d32b527e-e041-40dd-b3b1-a7c080a56c87 {{(pid=108542) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:52:35.739149 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-92cf19a8-8eed-48d8-8160-04b6233a74be req-b0f3a9b9-cd15-41a3-b681-d05521585413 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:35.743267 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.provisioning_blocks [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-1ed114e5-d2ce-433a-a88d-e797094014fb service neutron] Transition to ACTIVE for port object af83efde-b4cd-446b-9f74-15c631e4c45a will not be triggered until provisioned by entity L2. {{(pid=108543) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 02 12:52:35.849034 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-1ed114e5-d2ce-433a-a88d-e797094014fb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:35.987849 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ed114e5-d2ce-433a-a88d-e797094014fb service neutron] Pushing event updated for resources: {'Port': ['ID=af83efde-b4cd-446b-9f74-15c631e4c45a,revision_number=2']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:36.025383 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [req-92cf19a8-8eed-48d8-8160-04b6233a74be req-b0f3a9b9-cd15-41a3-b681-d05521585413 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] For port d32b527e-e041-40dd-b3b1-a7c080a56c87, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=d32b527e-e041-40dd-b3b1-a7c080a56c87,segment=NetworkSegment(db93b928-f362-4483-9a9d-ce7880e2d162),segment_id=db93b928-f362-4483-9a9d-ce7880e2d162)] {{(pid=108542) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:52:36.026312 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-92cf19a8-8eed-48d8-8160-04b6233a74be req-b0f3a9b9-cd15-41a3-b681-d05521585413 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:36.102719 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [req-92cf19a8-8eed-48d8-8160-04b6233a74be req-b0f3a9b9-cd15-41a3-b681-d05521585413 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Calling delete_port for d32b527e-e041-40dd-b3b1-a7c080a56c87 owned by compute:nova {{(pid=108542) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:52:36.308056 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-1ed114e5-d2ce-433a-a88d-e797094014fb service neutron] Attempting to bind port af83efde-b4cd-446b-9f74-15c631e4c45a on host hv-cinder-81632 for vnic_type normal with profile {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:52:36.308912 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-1ed114e5-d2ce-433a-a88d-e797094014fb service neutron] Attempting to bind port af83efde-b4cd-446b-9f74-15c631e4c45a by drivers openvswitch,hyperv on host hv-cinder-81632 at level 0 using segments [{'id': 'e206345e-67db-4144-84ee-50b4e5db5d75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3'}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:52:36.309379 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-1ed114e5-d2ce-433a-a88d-e797094014fb service neutron] Attempting to bind port af83efde-b4cd-446b-9f74-15c631e4c45a on network adffa68a-25de-4006-9dcc-006cbedf32e3 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:52:36.322247 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03138246-9b9f-427c-8943-e6169677affc req-16e317ff-e9a6-4173-8452-137a00c73860 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:36.324414 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-03138246-9b9f-427c-8943-e6169677affc req-16e317ff-e9a6-4173-8452-137a00c73860 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.2992747 Nov 02 12:52:36.327311 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-1ed114e5-d2ce-433a-a88d-e797094014fb service neutron] Port af83efde-b4cd-446b-9f74-15c631e4c45a on network adffa68a-25de-4006-9dcc-006cbedf32e3 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81632 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 02 12:52:36.327641 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-1ed114e5-d2ce-433a-a88d-e797094014fb service neutron] Attempting to bind port af83efde-b4cd-446b-9f74-15c631e4c45a on network adffa68a-25de-4006-9dcc-006cbedf32e3 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:52:36.349372 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-1ed114e5-d2ce-433a-a88d-e797094014fb service neutron] Checking agent: {'id': '0d57fa42-4660-4f08-b7dc-53a872c3c01c', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81632', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'started_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 52, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:52:36.350573 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-1ed114e5-d2ce-433a-a88d-e797094014fb service neutron] Checking segment: {'id': 'e206345e-67db-4144-84ee-50b4e5db5d75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108543) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:52:36.350573 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-1ed114e5-d2ce-433a-a88d-e797094014fb service neutron] Bound using segment: {'id': 'e206345e-67db-4144-84ee-50b4e5db5d75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3'} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:52:36.350926 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-1ed114e5-d2ce-433a-a88d-e797094014fb service neutron] Bound port: af83efde-b4cd-446b-9f74-15c631e4c45a, host: hv-cinder-81632, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e206345e-67db-4144-84ee-50b4e5db5d75', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 874, 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3'}}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:52:36.351099 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-1ed114e5-d2ce-433a-a88d-e797094014fb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:36.478460 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-03138246-9b9f-427c-8943-e6169677affc req-c67c74fc-dacc-4a98-938b-95d96d5232a4 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1447396 Nov 02 12:52:36.498848 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-1ed114e5-d2ce-433a-a88d-e797094014fb service neutron] For port af83efde-b4cd-446b-9f74-15c631e4c45a, host hv-cinder-81632, cleared binding levels {{(pid=108543) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:52:36.513263 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-1ed114e5-d2ce-433a-a88d-e797094014fb service neutron] For port af83efde-b4cd-446b-9f74-15c631e4c45a, host hv-cinder-81632, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=af83efde-b4cd-446b-9f74-15c631e4c45a,segment=NetworkSegment(e206345e-67db-4144-84ee-50b4e5db5d75),segment_id=e206345e-67db-4144-84ee-50b4e5db5d75)] {{(pid=108543) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:52:36.604789 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-92cf19a8-8eed-48d8-8160-04b6233a74be req-b0f3a9b9-cd15-41a3-b681-d05521585413 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:36.627909 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-1ed114e5-d2ce-433a-a88d-e797094014fb service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:36.661646 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b0f3a9b9-cd15-41a3-b681-d05521585413 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Pushing event deleted for resources: {'Port': ['ID=d32b527e-e041-40dd-b3b1-a7c080a56c87,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:36.719036 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [req-92cf19a8-8eed-48d8-8160-04b6233a74be req-b0f3a9b9-cd15-41a3-b681-d05521585413 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] No DVR routers for this DVR port d32b527e-e041-40dd-b3b1-a7c080a56c87 on host hv-cinder-81632 {{(pid=108542) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 12:52:36.738239 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-92cf19a8-8eed-48d8-8160-04b6233a74be req-b0f3a9b9-cd15-41a3-b681-d05521585413 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:36.748775 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-92cf19a8-8eed-48d8-8160-04b6233a74be req-b0f3a9b9-cd15-41a3-b681-d05521585413 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.90 "DELETE /v2.0/ports/d32b527e-e041-40dd-b3b1-a7c080a56c87 HTTP/1.1" status: 204 len: 173 time: 1.1936939 Nov 02 12:52:36.749595 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '14192166-ce34-4302-a48d-e8543bb6aebd', 'name': 'network-vif-deleted', 'tag': 'd32b527e-e041-40dd-b3b1-a7c080a56c87'}] {{(pid=108542) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:52:36.752470 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8fdc2194739644bb754d6b187539f80d2eba7dc5c5d5392f1a2d22d03c0a316c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-94ef1a47-a2fb-4493-adf3-d796e1e714ab" -d '{"events": [{"server_uuid": "14192166-ce34-4302-a48d-e8543bb6aebd", "name": "network-vif-deleted", "tag": "d32b527e-e041-40dd-b3b1-a7c080a56c87"}]}' {{(pid=108542) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:52:36.760625 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-1ed114e5-d2ce-433a-a88d-e797094014fb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:36.761293 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-1ed114e5-d2ce-433a-a88d-e797094014fb service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:36.763182 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-1ed114e5-d2ce-433a-a88d-e797094014fb service neutron] 10.222.0.90 "PUT /v2.0/ports/af83efde-b4cd-446b-9f74-15c631e4c45a HTTP/1.1" status: 200 len: 1093 time: 2.0637369 Nov 02 12:52:36.783634 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8', 'tag': 'af83efde-b4cd-446b-9f74-15c631e4c45a'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:52:36.798672 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0e200cde-7ebd-4c5e-ba1d-4795b7164d18" -d '{"events": [{"name": "network-changed", "server_uuid": "d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8", "tag": "af83efde-b4cd-446b-9f74-15c631e4c45a"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:52:36.798672 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ed114e5-d2ce-433a-a88d-e797094014fb service neutron] Pushing event updated for resources: {'Port': ['ID=af83efde-b4cd-446b-9f74-15c631e4c45a,revision_number=3']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:36.828768 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-723440e3-ac39-4722-a8ed-52c227725ed9 req-09dae3f3-5875-4ef1-99a9-f460724b8bd7 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:36.830668 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-723440e3-ac39-4722-a8ed-52c227725ed9 req-09dae3f3-5875-4ef1-99a9-f460724b8bd7 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 867 time: 0.2492721 Nov 02 12:52:36.906875 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-723440e3-ac39-4722-a8ed-52c227725ed9 req-0a9ef374-7719-41ae-b001-b5801da58d37 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/security-groups?id=19d9438a-e04a-457d-9eb4-d4547a94b10f&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0537946 Nov 02 12:52:36.997202 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-27156be5-1301-4325-818d-49e1d31814a6 req-9cf11cbf-26e5-4fe2-a590-1e3c7e3fed01 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:37.015320 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-27156be5-1301-4325-818d-49e1d31814a6 req-9cf11cbf-26e5-4fe2-a590-1e3c7e3fed01 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.2022276 Nov 02 12:52:37.063468 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:52:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e402b16d-3a52-4fcf-b60f-e8bc1dc7ef55 x-openstack-request-id: req-e402b16d-3a52-4fcf-b60f-e8bc1dc7ef55 {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:52:37.063468 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "14192166-ce34-4302-a48d-e8543bb6aebd", "name": "network-vif-deleted", "tag": "d32b527e-e041-40dd-b3b1-a7c080a56c87", "status": "completed", "code": 200}]} {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:52:37.063468 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-e402b16d-3a52-4fcf-b60f-e8bc1dc7ef55 {{(pid=108542) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:52:37.063468 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '14192166-ce34-4302-a48d-e8543bb6aebd', 'name': 'network-vif-deleted', 'tag': 'd32b527e-e041-40dd-b3b1-a7c080a56c87', 'status': 'completed', 'code': 200} Nov 02 12:52:37.112894 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-8bfd7d0d-91b0-442c-8cb6-9711dc02624c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:37.114452 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-8bfd7d0d-91b0-442c-8cb6-9711dc02624c service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=d3bf5c9bdd7f479aa4cbc28f9a007c81&device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 1096 time: 0.1848657 Nov 02 12:52:37.142992 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-27156be5-1301-4325-818d-49e1d31814a6 req-2cfe7d9d-60b4-4c7a-b795-94b87c016466 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1266990 Nov 02 12:52:37.158491 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:52:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9d5caf46-4b61-4863-8cf3-ab7b2dfc6a71 x-openstack-request-id: req-9d5caf46-4b61-4863-8cf3-ab7b2dfc6a71 {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:52:37.158703 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8", "tag": "af83efde-b4cd-446b-9f74-15c631e4c45a", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:52:37.158955 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-9d5caf46-4b61-4863-8cf3-ab7b2dfc6a71 {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:52:37.159392 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8', 'tag': 'af83efde-b4cd-446b-9f74-15c631e4c45a', 'status': 'completed', 'code': 200} Nov 02 12:52:37.202565 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-34234b7d-05ee-4517-9cd0-e7a521177995 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=af83efde-b4cd-446b-9f74-15c631e4c45a HTTP/1.1" status: 200 len: 217 time: 0.0583811 Nov 02 12:52:37.313817 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-e45d4f84-320b-4f0e-b073-b2a837a3cfa2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:37.316898 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-e45d4f84-320b-4f0e-b073-b2a837a3cfa2 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=9a20b259-01c2-4b3f-8f92-0797a18ff7f7 HTTP/1.1" status: 200 len: 848 time: 0.1000726 Nov 02 12:52:37.361240 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 59546) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:37.453857 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-f3c885bb-2d76-4cad-95e6-4d13901ece4d service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:37.456130 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-f3c885bb-2d76-4cad-95e6-4d13901ece4d service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=adffa68a-25de-4006-9dcc-006cbedf32e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.1298435 Nov 02 12:52:37.620384 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-45b4e830-0c97-4081-94b1-61ad08e18238 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:37.685631 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-12394788-4516-49bc-99b6-86a56843ca72 service neutron] 10.222.0.90 "GET /v2.0/networks/adffa68a-25de-4006-9dcc-006cbedf32e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2179220 Nov 02 12:52:37.796511 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-48a8841d-f28e-42f8-832e-5ecf88f38075 req-6c53c267-0670-4d02-bd95-16ff9bc79f53 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:37.798076 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-48a8841d-f28e-42f8-832e-5ecf88f38075 req-6c53c267-0670-4d02-bd95-16ff9bc79f53 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.1599226 Nov 02 12:52:37.819348 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a4f85e3-7e8f-418b-879d-ccaa3bfaf9e9 req-671e9100-28cc-47ac-a46f-0de3aad605bb service neutron] 10.222.0.90 "GET /v2.0/networks/adffa68a-25de-4006-9dcc-006cbedf32e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1263621 Nov 02 12:52:37.844449 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-45b4e830-0c97-4081-94b1-61ad08e18238 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:37.922667 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-48a8841d-f28e-42f8-832e-5ecf88f38075 req-be741ec9-382c-4c7e-a7b7-aa9aa06de98b tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1008723 Nov 02 12:52:37.934098 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-45b4e830-0c97-4081-94b1-61ad08e18238 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:37.987331 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-45b4e830-0c97-4081-94b1-61ad08e18238 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=bddeaeca-4db9-4a98-8610-c320bff54f91,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:37.993000 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-45b4e830-0c97-4081-94b1-61ad08e18238 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=9e377b35eacf46e49099347419e28138&name=default HTTP/1.1" status: 200 len: 2996 time: 0.6406162 Nov 02 12:52:37.995728 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 59566) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:38.108651 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bc3095e4-b01c-4e4c-a65d-01f14c7db481 req-1b2e6a22-e262-4dad-9967-6ffe6a85ecb3 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] 10.222.0.98 "GET /v2.0/ports?device_id=14192166-ce34-4302-a48d-e8543bb6aebd HTTP/1.1" status: 200 len: 210 time: 0.0316467 Nov 02 12:52:38.115352 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e200cde-7ebd-4c5e-ba1d-4795b7164d18 req-1d109e60-ca77-4999-b46d-d8de1f4a67e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:38.117019 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0e200cde-7ebd-4c5e-ba1d-4795b7164d18 req-1d109e60-ca77-4999-b46d-d8de1f4a67e0 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=d3bf5c9bdd7f479aa4cbc28f9a007c81&device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 1096 time: 0.1083701 Nov 02 12:52:38.126879 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-6ad5cef6-e34b-417e-bbaf-e9beaf7a8fb4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:38.182225 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-6ad5cef6-e34b-417e-bbaf-e9beaf7a8fb4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:38.248007 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device d32b527e-e041-40dd-b3b1-a7c080a56c87 no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:52:38.279159 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] No Port match for: d32b527e-e041-40dd-b3b1-a7c080a56c87 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:52:38.279753 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device d32b527e-e041-40dd-b3b1-a7c080a56c87 not bound to the agent host hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:52:38.333697 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-6ad5cef6-e34b-417e-bbaf-e9beaf7a8fb4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:38.336623 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-6ad5cef6-e34b-417e-bbaf-e9beaf7a8fb4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:38.341545 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-6ad5cef6-e34b-417e-bbaf-e9beaf7a8fb4 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/bddeaeca-4db9-4a98-8610-c320bff54f91 HTTP/1.1" status: 204 len: 168 time: 0.3444238 Nov 02 12:52:38.356289 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6ad5cef6-e34b-417e-bbaf-e9beaf7a8fb4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bddeaeca-4db9-4a98-8610-c320bff54f91,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:38.361683 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e200cde-7ebd-4c5e-ba1d-4795b7164d18 req-d4d01165-832a-45aa-b703-1b6cdf239e88 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:38.363434 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0e200cde-7ebd-4c5e-ba1d-4795b7164d18 req-d4d01165-832a-45aa-b703-1b6cdf239e88 service neutron] 10.222.0.90 "GET /v2.0/networks?id=adffa68a-25de-4006-9dcc-006cbedf32e3 HTTP/1.1" status: 200 len: 910 time: 0.2312500 Nov 02 12:52:38.373315 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-623cb131-0509-4f34-8a51-eb743e8e1f26 req-288da6ff-7a07-4003-8836-273c04a172be tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:38.381144 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-623cb131-0509-4f34-8a51-eb743e8e1f26 req-288da6ff-7a07-4003-8836-273c04a172be tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.1122658 Nov 02 12:52:38.454459 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0e200cde-7ebd-4c5e-ba1d-4795b7164d18 req-6858b391-c24e-422a-b98b-a4531e96903d service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=af83efde-b4cd-446b-9f74-15c631e4c45a HTTP/1.1" status: 200 len: 217 time: 0.0519876 Nov 02 12:52:38.510302 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-623cb131-0509-4f34-8a51-eb743e8e1f26 req-f51d95a9-a98c-4582-bbca-96ac671a7afb tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1279984 Nov 02 12:52:38.557277 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e200cde-7ebd-4c5e-ba1d-4795b7164d18 req-f152267c-a48f-486f-a2df-ae9a2c2f8ab2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:38.560827 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0e200cde-7ebd-4c5e-ba1d-4795b7164d18 req-f152267c-a48f-486f-a2df-ae9a2c2f8ab2 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=9a20b259-01c2-4b3f-8f92-0797a18ff7f7 HTTP/1.1" status: 200 len: 848 time: 0.0979860 Nov 02 12:52:38.639164 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e200cde-7ebd-4c5e-ba1d-4795b7164d18 req-bb080c69-194e-45d5-905c-2be91f08c35c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:38.640776 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0e200cde-7ebd-4c5e-ba1d-4795b7164d18 req-bb080c69-194e-45d5-905c-2be91f08c35c service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=adffa68a-25de-4006-9dcc-006cbedf32e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0711358 Nov 02 12:52:38.803884 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0e200cde-7ebd-4c5e-ba1d-4795b7164d18 req-648f66b6-61c0-4e2e-be11-21e8f87bb141 service neutron] 10.222.0.90 "GET /v2.0/networks/adffa68a-25de-4006-9dcc-006cbedf32e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1532371 Nov 02 12:52:39.030479 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0e200cde-7ebd-4c5e-ba1d-4795b7164d18 req-582925e3-3441-47d3-a125-2e94e34610b4 service neutron] 10.222.0.90 "GET /v2.0/networks/adffa68a-25de-4006-9dcc-006cbedf32e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2173734 Nov 02 12:52:39.173512 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd5fdc2f-ed85-4c58-9e3a-da87655ddad7 req-abade44a-9c5e-4213-9231-380ee1abe1d7 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:39.182667 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bd5fdc2f-ed85-4c58-9e3a-da87655ddad7 req-abade44a-9c5e-4213-9231-380ee1abe1d7 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.1282141 Nov 02 12:52:39.209702 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 59580) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:39.426531 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bd5fdc2f-ed85-4c58-9e3a-da87655ddad7 req-32a1cfa2-efa7-48eb-837a-033c520df99d tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2305732 Nov 02 12:52:39.726692 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ad9f2db-38ee-4bf7-8511-58b6d87c0be1 req-f06bc670-906c-4c00-a9fb-833697f739a3 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:39.734511 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9ad9f2db-38ee-4bf7-8511-58b6d87c0be1 req-f06bc670-906c-4c00-a9fb-833697f739a3 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.1316221 Nov 02 12:52:39.820193 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9ad9f2db-38ee-4bf7-8511-58b6d87c0be1 req-d3d35e35-fa75-4e2c-824f-60a1e474d34e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0833106 Nov 02 12:52:39.946257 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-27a73da0-a00d-4931-a9d7-d3d308ed2678 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1590128'] for router_interface, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:40.608763 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b61a3d1-92e0-415c-9f66-2688a28e3566 req-9714525c-93d0-44b1-94f5-e819a4c93da6 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:40.610359 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6b61a3d1-92e0-415c-9f66-2688a28e3566 req-9714525c-93d0-44b1-94f5-e819a4c93da6 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.0699658 Nov 02 12:52:40.611982 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-27a73da0-a00d-4931-a9d7-d3d308ed2678 admin admin] Deleting port 490fac23-7b22-4b5a-965d-a1dc3250589d {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:52:40.612342 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-27a73da0-a00d-4931-a9d7-d3d308ed2678 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:40.788804 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6b61a3d1-92e0-415c-9f66-2688a28e3566 req-6f5c8956-cd86-408b-bb20-09547f7d7aa1 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1664982 Nov 02 12:52:40.827817 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [None req-27a73da0-a00d-4931-a9d7-d3d308ed2678 admin admin] For port 490fac23-7b22-4b5a-965d-a1dc3250589d, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=490fac23-7b22-4b5a-965d-a1dc3250589d,segment=NetworkSegment(db93b928-f362-4483-9a9d-ce7880e2d162),segment_id=db93b928-f362-4483-9a9d-ce7880e2d162)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:52:40.828078 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-27a73da0-a00d-4931-a9d7-d3d308ed2678 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:40.855096 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-27a73da0-a00d-4931-a9d7-d3d308ed2678 admin admin] Calling delete_port for 490fac23-7b22-4b5a-965d-a1dc3250589d owned by network:router_interface {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:52:41.072463 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e419439b-aa82-4d0b-b784-a078a629b9c4 req-f83cc7d1-6f3c-49f2-b1be-3301b1d607f4 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:41.074767 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e419439b-aa82-4d0b-b784-a078a629b9c4 req-f83cc7d1-6f3c-49f2-b1be-3301b1d607f4 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.0869372 Nov 02 12:52:41.188845 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e419439b-aa82-4d0b-b784-a078a629b9c4 req-cd7c3325-443d-4d89-be5f-182fde51a7d7 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1061862 Nov 02 12:52:41.299684 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-27a73da0-a00d-4931-a9d7-d3d308ed2678 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:41.367474 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27a73da0-a00d-4931-a9d7-d3d308ed2678 admin admin] Pushing event deleted for resources: {'Port': ['ID=490fac23-7b22-4b5a-965d-a1dc3250589d,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:41.664418 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-27a73da0-a00d-4931-a9d7-d3d308ed2678 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1649147', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1591488'] for router_interface, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:42.269419 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba3971dc-1fa0-4299-b121-deae9948e21c req-5e1cb829-48ba-41c7-88fa-390bf48fd3d8 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:42.278164 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ba3971dc-1fa0-4299-b121-deae9948e21c req-5e1cb829-48ba-41c7-88fa-390bf48fd3d8 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.2706206 Nov 02 12:52:42.552567 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ba3971dc-1fa0-4299-b121-deae9948e21c req-1ee0297d-3cfe-4079-843b-9ecdc059f8da tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2557955 Nov 02 12:52:42.586101 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f84b97fe-2d33-4207-ae73-e0378f47facf req-d1e25e75-018f-4c1d-a59c-41ee409f7754 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:42.599988 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f84b97fe-2d33-4207-ae73-e0378f47facf req-d1e25e75-018f-4c1d-a59c-41ee409f7754 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.2268915 Nov 02 12:52:42.715060 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f84b97fe-2d33-4207-ae73-e0378f47facf req-977606c9-0925-481e-b78b-c56b6ed27818 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1109357 Nov 02 12:52:42.729428 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-27a73da0-a00d-4931-a9d7-d3d308ed2678 admin admin] Router 4b99bdb0-b8b9-4f04-8c39-efb93626ff5b has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108543) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 12:52:43.015696 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-27a73da0-a00d-4931-a9d7-d3d308ed2678 admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108543) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:52:43.024928 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 59634) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:43.032855 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7987605e-f6da-4bdc-992c-87d4adca35cd None None] Sync routers for ids ['4b99bdb0-b8b9-4f04-8c39-efb93626ff5b'] in dv-cinder-816324-1-iscsi {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:52:43.051548 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-27a73da0-a00d-4931-a9d7-d3d308ed2678 admin admin] 10.222.0.98 "PUT /v2.0/routers/4b99bdb0-b8b9-4f04-8c39-efb93626ff5b/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.8391554 Nov 02 12:52:43.063529 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7987605e-f6da-4bdc-992c-87d4adca35cd None None] Routers {'4b99bdb0-b8b9-4f04-8c39-efb93626ff5b'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:52:43.066306 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-7987605e-f6da-4bdc-992c-87d4adca35cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:52:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['4b99bdb0-b8b9-4f04-8c39-efb93626ff5b'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:52:43.232085 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-910cbcb1-33e1-476a-83ac-8ac82a32c2db admin admin] Publish callbacks [] for router, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:43.292690 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-7987605e-f6da-4bdc-992c-87d4adca35cd None None] Set router 4b99bdb0-b8b9-4f04-8c39-efb93626ff5b gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:52:43.352702 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-910cbcb1-33e1-476a-83ac-8ac82a32c2db admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:43.504732 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-910cbcb1-33e1-476a-83ac-8ac82a32c2db admin admin] Deleting port b4d5a738-c102-44ca-ae66-2d125f202102 {{(pid=108542) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:52:43.504972 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-910cbcb1-33e1-476a-83ac-8ac82a32c2db admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:43.663461 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-7987605e-f6da-4bdc-992c-87d4adca35cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b99bdb0-b8b9-4f04-8c39-efb93626ff5b', 'name': 'tempest-ServerRescueNegativeTestJSON-2129619320-router', 'tenant_id': '28a90b1659054909ab64ba5320160f74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.115'}], 'enable_snat': True}, 'gw_port_id': 'b4d5a738-c102-44ca-ae66-2d125f202102', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:52:41Z', 'revision_number': 5, 'project_id': '28a90b1659054909ab64ba5320160f74', 'gw_port': {'id': 'b4d5a738-c102-44ca-ae66-2d125f202102', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:b2:07:49', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '4b99bdb0-b8b9-4f04-8c39-efb93626ff5b', 'device_owner': 'network:router_gateway', 'standard_attr_id': 58, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.115', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:11Z', 'updated_at': '2021-11-02T12:49:22Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:52:43.704844 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [None req-910cbcb1-33e1-476a-83ac-8ac82a32c2db admin admin] For port b4d5a738-c102-44ca-ae66-2d125f202102, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=b4d5a738-c102-44ca-ae66-2d125f202102,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108542) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:52:43.705978 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-910cbcb1-33e1-476a-83ac-8ac82a32c2db admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:43.782445 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-910cbcb1-33e1-476a-83ac-8ac82a32c2db admin admin] Calling delete_port for b4d5a738-c102-44ca-ae66-2d125f202102 owned by network:router_gateway {{(pid=108542) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:52:43.811299 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7987605e-f6da-4bdc-992c-87d4adca35cd None None] Checking router: 4b99bdb0-b8b9-4f04-8c39-efb93626ff5b for host: dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:52:43.835785 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7987605e-f6da-4bdc-992c-87d4adca35cd None None] Routers {'4b99bdb0-b8b9-4f04-8c39-efb93626ff5b'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:52:43.837349 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-7987605e-f6da-4bdc-992c-87d4adca35cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 7, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 7, "log_agent_heartbeats": false, "routers": 7},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:52:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['4b99bdb0-b8b9-4f04-8c39-efb93626ff5b'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:52:43.858690 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ebb625b8-5960-43ac-af93-b5e4f7192015 req-f47a0fdf-3cac-40dd-8835-3e4dbfebe0f9 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:43.860743 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ebb625b8-5960-43ac-af93-b5e4f7192015 req-f47a0fdf-3cac-40dd-8835-3e4dbfebe0f9 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.1798358 Nov 02 12:52:44.048625 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-7987605e-f6da-4bdc-992c-87d4adca35cd None None] Set router 4b99bdb0-b8b9-4f04-8c39-efb93626ff5b gateway port host: None {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:52:44.114477 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ebb625b8-5960-43ac-af93-b5e4f7192015 req-21c319e9-4cb5-4771-a39a-2d9f0e70d78e tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2467024 Nov 02 12:52:44.150707 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a42c77cb-35f8-45d8-b78e-c2566199e2f9 req-eda7927d-04a8-4ff5-9170-3dca1db98996 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:44.158149 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a42c77cb-35f8-45d8-b78e-c2566199e2f9 req-eda7927d-04a8-4ff5-9170-3dca1db98996 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.2430069 Nov 02 12:52:44.189336 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-7987605e-f6da-4bdc-992c-87d4adca35cd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '4b99bdb0-b8b9-4f04-8c39-efb93626ff5b', 'name': 'tempest-ServerRescueNegativeTestJSON-2129619320-router', 'tenant_id': '28a90b1659054909ab64ba5320160f74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:52:43Z', 'revision_number': 6, 'project_id': '28a90b1659054909ab64ba5320160f74', 'gw_port_host': None}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:52:44.252699 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7987605e-f6da-4bdc-992c-87d4adca35cd None None] The sync data for ids ['4b99bdb0-b8b9-4f04-8c39-efb93626ff5b'] in dv-cinder-816324-1-iscsi is: [{'id': '4b99bdb0-b8b9-4f04-8c39-efb93626ff5b', 'name': 'tempest-ServerRescueNegativeTestJSON-2129619320-router', 'tenant_id': '28a90b1659054909ab64ba5320160f74', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:52:43Z', 'revision_number': 6, 'project_id': '28a90b1659054909ab64ba5320160f74', 'gw_port_host': None}] {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:52:44.305761 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-910cbcb1-33e1-476a-83ac-8ac82a32c2db admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:44.309928 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a42c77cb-35f8-45d8-b78e-c2566199e2f9 req-814dc345-33cd-4b0f-8d29-0cd89cd560a4 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1353137 Nov 02 12:52:44.439363 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-910cbcb1-33e1-476a-83ac-8ac82a32c2db admin admin] Pushing event deleted for resources: {'Port': ['ID=b4d5a738-c102-44ca-ae66-2d125f202102,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:44.609013 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-910cbcb1-33e1-476a-83ac-8ac82a32c2db admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1595046'] for router_gateway, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:45.083995 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-910cbcb1-33e1-476a-83ac-8ac82a32c2db admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1593116', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-25699'] for router, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:45.086918 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-910cbcb1-33e1-476a-83ac-8ac82a32c2db admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:45.281695 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-910cbcb1-33e1-476a-83ac-8ac82a32c2db admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1593093'] for router, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:45.283902 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-910cbcb1-33e1-476a-83ac-8ac82a32c2db admin admin] Fanout notify agent at l3_agent the message router_deleted on router 4b99bdb0-b8b9-4f04-8c39-efb93626ff5b {{(pid=108542) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 02 12:52:45.289804 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-910cbcb1-33e1-476a-83ac-8ac82a32c2db admin admin] Publish callbacks [] for router, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:45.295813 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-910cbcb1-33e1-476a-83ac-8ac82a32c2db admin admin] 10.222.0.98 "DELETE /v2.0/routers/4b99bdb0-b8b9-4f04-8c39-efb93626ff5b HTTP/1.1" status: 204 len: 168 time: 2.2692900 Nov 02 12:52:45.296907 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 59654) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:45.380844 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_v2 [None req-1136a2b7-84ef-4924-b76a-6a4f8a38fb3d admin admin] Deleting subnet b29075d9-9995-4f6f-8ebd-8f7d748977ef {{(pid=108542) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 02 12:52:45.384798 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1136a2b7-84ef-4924-b76a-6a4f8a38fb3d admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:45.443751 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0e16ec13-d5ac-407b-8d69-dc19298446a9 req-4e9d57b6-76fb-4cf0-b620-dcbc63849bfa tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:45.450047 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1136a2b7-84ef-4924-b76a-6a4f8a38fb3d admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3344686'] for subnet, precommit_delete_associations {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:45.450205 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0e16ec13-d5ac-407b-8d69-dc19298446a9 req-4e9d57b6-76fb-4cf0-b620-dcbc63849bfa tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.1780903 Nov 02 12:52:45.504901 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1136a2b7-84ef-4924-b76a-6a4f8a38fb3d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-933154'] for subnet, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:45.682320 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1136a2b7-84ef-4924-b76a-6a4f8a38fb3d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-933141', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126478215', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126185624'] for subnet, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:45.731465 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1136a2b7-84ef-4924-b76a-6a4f8a38fb3d admin admin] Pushing event deleted for resources: {'Subnet': ['ID=b29075d9-9995-4f6f-8ebd-8f7d748977ef,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:45.751261 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1136a2b7-84ef-4924-b76a-6a4f8a38fb3d admin admin] Publish callbacks [] for subnet, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:45.767037 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-1136a2b7-84ef-4924-b76a-6a4f8a38fb3d admin admin] 10.222.0.98 "DELETE /v2.0/subnets/b29075d9-9995-4f6f-8ebd-8f7d748977ef HTTP/1.1" status: 204 len: 168 time: 0.4684377 Nov 02 12:52:45.768843 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 59662) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:45.859578 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0e16ec13-d5ac-407b-8d69-dc19298446a9 req-05750243-5aac-49e3-a06f-343ff23a8f03 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3935797 Nov 02 12:52:45.911047 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-adfeb9c6-4b84-48c2-9567-46378e508c94 req-a047b514-7d93-45e5-b672-3d6fd5c71f70 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:45.913225 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-adfeb9c6-4b84-48c2-9567-46378e508c94 req-a047b514-7d93-45e5-b672-3d6fd5c71f70 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.3929343 Nov 02 12:52:46.010076 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-adfeb9c6-4b84-48c2-9567-46378e508c94 req-8d6bfd95-5676-46fe-8482-17d262d22ec6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0858779 Nov 02 12:52:46.029554 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-81e0f2a3-9297-4ad0-9b03-1db67f82d4bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-972735'] for network, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:46.314958 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-81e0f2a3-9297-4ad0-9b03-1db67f82d4bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-930985', 'neutron.services.segments.db._delete_segments_for_network-8738449897966'] for network, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:46.338424 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 490fac23-7b22-4b5a-965d-a1dc3250589d no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:52:46.369606 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device af83efde-b4cd-446b-9f74-15c631e4c45a details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 12:52:46.386899 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-81e0f2a3-9297-4ad0-9b03-1db67f82d4bb admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c965eaf1-5fb6-4689-8b12-fa3913e4f081']}} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:52:46.430149 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-81e0f2a3-9297-4ad0-9b03-1db67f82d4bb admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'db93b928-f362-4483-9a9d-ce7880e2d162') {'for_net_delete': True} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:52:46.430476 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-81e0f2a3-9297-4ad0-9b03-1db67f82d4bb admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'db93b928-f362-4483-9a9d-ce7880e2d162') {} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:52:46.462401 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-81e0f2a3-9297-4ad0-9b03-1db67f82d4bb admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738449902583', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3344697'] for segment, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:46.507367 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-81e0f2a3-9297-4ad0-9b03-1db67f82d4bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:46.523372 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-81e0f2a3-9297-4ad0-9b03-1db67f82d4bb admin admin] Releasing vlan 884 on physical network physnet1 to pool {{(pid=108542) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 02 12:52:46.523959 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-81e0f2a3-9297-4ad0-9b03-1db67f82d4bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126476581'] for segment, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:46.564074 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port af83efde-b4cd-446b-9f74-15c631e4c45a, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=af83efde-b4cd-446b-9f74-15c631e4c45a,segment=NetworkSegment(e206345e-67db-4144-84ee-50b4e5db5d75),segment_id=e206345e-67db-4144-84ee-50b4e5db5d75)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:52:46.596308 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: 490fac23-7b22-4b5a-965d-a1dc3250589d {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:52:46.596649 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 490fac23-7b22-4b5a-965d-a1dc3250589d not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:52:46.597269 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device b4d5a738-c102-44ca-ae66-2d125f202102 no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:52:46.601964 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': 'af83efde-b4cd-446b-9f74-15c631e4c45a', 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3', 'port_id': 'af83efde-b4cd-446b-9f74-15c631e4c45a', 'mac_address': 'fa:16:3e:85:c9:af', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 874, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9a20b259-01c2-4b3f-8f92-0797a18ff7f7', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: Traceback (most recent call last): Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: timer() Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: cb(*args, **kw) Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: return func(*args, **kwargs) Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: self._notify() Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: self.callback(batched_events) Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: event.method(event) Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: aggregate_uuid = self.p_client.list_aggregates( Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: return f(self, *a, **k) Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: return self._get(url).json() Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: return self.request(url, 'GET', **kwargs) Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: base_url = self.get_endpoint(auth, allow=allow, Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 02 12:52:46.638537 dv-cinder-816324-1-iscsi neutron-server[108542]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 02 12:52:46.667456 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: b4d5a738-c102-44ca-ae66-2d125f202102 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:52:46.676737 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device b4d5a738-c102-44ca-ae66-2d125f202102 not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:52:46.743661 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:46.760830 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id af83efde-b4cd-446b-9f74-15c631e4c45a {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:52:46.788895 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port af83efde-b4cd-446b-9f74-15c631e4c45a, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=af83efde-b4cd-446b-9f74-15c631e4c45a,segment=NetworkSegment(e206345e-67db-4144-84ee-50b4e5db5d75),segment_id=e206345e-67db-4144-84ee-50b4e5db5d75)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:52:46.883829 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-81e0f2a3-9297-4ad0-9b03-1db67f82d4bb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-930976', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1594946'] for network, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:46.917034 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-81e0f2a3-9297-4ad0-9b03-1db67f82d4bb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:46.939341 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-81e0f2a3-9297-4ad0-9b03-1db67f82d4bb admin admin] 10.222.0.98 "DELETE /v2.0/networks/c965eaf1-5fb6-4689-8b12-fa3913e4f081 HTTP/1.1" status: 204 len: 168 time: 1.1690128 Nov 02 12:52:46.951715 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:47.006251 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-81e0f2a3-9297-4ad0-9b03-1db67f82d4bb admin admin] Pushing event deleted for resources: {'Network': ['ID=c965eaf1-5fb6-4689-8b12-fa3913e4f081,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:47.177675 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=af83efde-b4cd-446b-9f74-15c631e4c45a,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:47.227229 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c922a7e-7f46-49b5-b8eb-973db0984b78 req-1fbfdd71-fe62-46c0-9ba2-bd0ee79d3137 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:47.237929 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8c922a7e-7f46-49b5-b8eb-973db0984b78 req-1fbfdd71-fe62-46c0-9ba2-bd0ee79d3137 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 944 time: 0.1961212 Nov 02 12:52:47.281941 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['af83efde-b4cd-446b-9f74-15c631e4c45a'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:52:47.435441 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8c922a7e-7f46-49b5-b8eb-973db0984b78 req-54b35684-db8a-4aed-849f-670392d5eabe tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1961858 Nov 02 12:52:47.494766 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0cad332-47c9-4858-a411-d2eb434c1a1a req-9ee45d34-4705-450c-aa77-69d1a961f374 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:47.506588 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b0cad332-47c9-4858-a411-d2eb434c1a1a req-9ee45d34-4705-450c-aa77-69d1a961f374 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.2450452 Nov 02 12:52:47.659339 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 59678) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:47.775743 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b0cad332-47c9-4858-a411-d2eb434c1a1a req-39562629-3e95-488a-bce8-13166778da1d tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.2479374 Nov 02 12:52:47.821470 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-61fc7490-a500-451b-84b6-3de515877594 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=28a90b1659054909ab64ba5320160f74&name=default HTTP/1.1" status: 200 len: 2992 time: 0.1529481 Nov 02 12:52:47.822124 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 59684) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:47.999380 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-a6818986-9150-4384-9a18-c4fbb1033bb7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:48.072635 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-a6818986-9150-4384-9a18-c4fbb1033bb7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:48.373700 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-a6818986-9150-4384-9a18-c4fbb1033bb7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:48.377378 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-a6818986-9150-4384-9a18-c4fbb1033bb7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:48.381174 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-a6818986-9150-4384-9a18-c4fbb1033bb7 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/19d9438a-e04a-457d-9eb4-d4547a94b10f HTTP/1.1" status: 204 len: 168 time: 0.5556557 Nov 02 12:52:48.399134 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a6818986-9150-4384-9a18-c4fbb1033bb7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=19d9438a-e04a-457d-9eb4-d4547a94b10f,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:48.590288 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ee678f2b-ca0a-4ac7-b866-b5415f1c4f55 req-a4a639df-f89c-486d-9bdb-aaee93a5eac2 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:48.592356 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ee678f2b-ca0a-4ac7-b866-b5415f1c4f55 req-a4a639df-f89c-486d-9bdb-aaee93a5eac2 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 944 time: 0.0652585 Nov 02 12:52:48.663365 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ee678f2b-ca0a-4ac7-b866-b5415f1c4f55 req-0bfed8f0-3b41-430d-b3f0-e908951a6457 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0627499 Nov 02 12:52:49.101252 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd928eae-98e1-491f-a1de-26d11a1319ed req-6b890172-a1a1-4448-82db-7375cc35443b tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:49.118499 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bd928eae-98e1-491f-a1de-26d11a1319ed req-6b890172-a1a1-4448-82db-7375cc35443b tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.1589086 Nov 02 12:52:49.232994 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bd928eae-98e1-491f-a1de-26d11a1319ed req-bca9c553-39ed-483a-9fde-1aaa214323c0 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1127036 Nov 02 12:52:49.911579 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cdc741d-6f16-4b1b-82b4-6b69e6b65c5d req-15d9e87c-9a8a-427b-a2ec-f5ab15a8b729 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:49.914116 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4cdc741d-6f16-4b1b-82b4-6b69e6b65c5d req-15d9e87c-9a8a-427b-a2ec-f5ab15a8b729 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 944 time: 0.0770340 Nov 02 12:52:50.057872 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4cdc741d-6f16-4b1b-82b4-6b69e6b65c5d req-d8bb3c5e-ebaf-4683-aa86-2cca7e022e93 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1360025 Nov 02 12:52:50.272298 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device af83efde-b4cd-446b-9f74-15c631e4c45a up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:52:50.541042 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dfdbdbaa-db5d-476e-8067-5151c87aabfa req-7ea515e9-cb56-4a28-8020-84210594d9e9 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:50.545398 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning for port af83efde-b4cd-446b-9f74-15c631e4c45a completed by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 02 12:52:50.550921 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port af83efde-b4cd-446b-9f74-15c631e4c45a triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:52:50.552391 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:50.559448 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-dfdbdbaa-db5d-476e-8067-5151c87aabfa req-7ea515e9-cb56-4a28-8020-84210594d9e9 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.1225450 Nov 02 12:52:50.682365 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-dfdbdbaa-db5d-476e-8067-5151c87aabfa req-b93cffa8-e3ba-4d08-9db2-15eb9ac632d7 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1050360 Nov 02 12:52:50.784979 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:50.896988 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'af83efde-b4cd-446b-9f74-15c631e4c45a'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:52:50.920892 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-99db128f-e5ad-4e50-b05f-5467340dd7fa" -d '{"events": [{"server_uuid": "d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8", "name": "network-vif-plugged", "status": "completed", "tag": "af83efde-b4cd-446b-9f74-15c631e4c45a"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:52:51.031992 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:52:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4696600d-c8e2-4a51-ac0f-6dccf7e296b8 x-openstack-request-id: req-4696600d-c8e2-4a51-ac0f-6dccf7e296b8 {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:52:51.031992 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8", "name": "network-vif-plugged", "status": "completed", "tag": "af83efde-b4cd-446b-9f74-15c631e4c45a", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:52:51.031992 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-4696600d-c8e2-4a51-ac0f-6dccf7e296b8 {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:52:51.031992 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'af83efde-b4cd-446b-9f74-15c631e4c45a', 'code': 200} Nov 02 12:52:51.038649 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port af83efde-b4cd-446b-9f74-15c631e4c45a, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=af83efde-b4cd-446b-9f74-15c631e4c45a,segment=NetworkSegment(e206345e-67db-4144-84ee-50b4e5db5d75),segment_id=e206345e-67db-4144-84ee-50b4e5db5d75)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:52:51.286444 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-534a7072-2192-41b5-9e5f-021262aebfa3 req-f940d8f7-8a6a-4295-b829-a8cce3438dd6 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:51.294734 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-534a7072-2192-41b5-9e5f-021262aebfa3 req-f940d8f7-8a6a-4295-b829-a8cce3438dd6 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 944 time: 0.0627770 Nov 02 12:52:51.361552 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-534a7072-2192-41b5-9e5f-021262aebfa3 req-7f9554b8-bc5c-4b67-b81e-2bf21a63e674 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0640893 Nov 02 12:52:51.459255 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:51.571474 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=af83efde-b4cd-446b-9f74-15c631e4c45a,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:51.998587 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-10b9365a-8262-4ef3-bdbc-987d02e11158 req-578133c2-72ca-49e6-bfdb-318b61989b49 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:52.009249 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-10b9365a-8262-4ef3-bdbc-987d02e11158 req-578133c2-72ca-49e6-bfdb-318b61989b49 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.1580884 Nov 02 12:52:52.143154 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-10b9365a-8262-4ef3-bdbc-987d02e11158 req-c0b68e83-9d69-4dcd-851b-e25d6d3d69ee tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1273148 Nov 02 12:52:52.676917 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-da1bfb0e-af95-4395-b6eb-b34b1799dc3b req-9b45e15d-e1bf-4eb9-b41e-659b1832ed38 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:52.679721 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-da1bfb0e-af95-4395-b6eb-b34b1799dc3b req-9b45e15d-e1bf-4eb9-b41e-659b1832ed38 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 1098 time: 0.1186001 Nov 02 12:52:52.691512 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26e27d6f-530f-4f7f-82da-490b6b97993b req-4466a6dd-eae6-4b0c-bb45-2ed6c5b60681 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:52.693456 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-26e27d6f-530f-4f7f-82da-490b6b97993b req-4466a6dd-eae6-4b0c-bb45-2ed6c5b60681 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.2029684 Nov 02 12:52:52.793332 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-26e27d6f-530f-4f7f-82da-490b6b97993b req-6c2c55fb-8bbe-433d-b1bd-955f9cc50155 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0769105 Nov 02 12:52:52.910165 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-da1bfb0e-af95-4395-b6eb-b34b1799dc3b req-70be4868-3821-451a-a72f-a0feeedfebbc service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0516243 Nov 02 12:52:53.445791 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-90f88224-df3c-4868-b9b0-cc8cc6998b5a req-5a627e40-4002-461a-b3df-c0bb84e6e105 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:53.459931 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-90f88224-df3c-4868-b9b0-cc8cc6998b5a req-5a627e40-4002-461a-b3df-c0bb84e6e105 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.1315427 Nov 02 12:52:53.510208 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-cac40bd8-4013-493e-9164-9c437d6e3e4c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:53.563574 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-90f88224-df3c-4868-b9b0-cc8cc6998b5a req-d42abb3a-237b-4d83-bdf2-69b75992dffe tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1025465 Nov 02 12:52:54.019149 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68e89a07-f752-4e4c-865f-5cc35f5ff6a6 req-7fd5301a-e33b-4a72-bbaa-65e894f0bc05 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:54.027001 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-68e89a07-f752-4e4c-865f-5cc35f5ff6a6 req-7fd5301a-e33b-4a72-bbaa-65e894f0bc05 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.1256568 Nov 02 12:52:54.115384 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-68e89a07-f752-4e4c-865f-5cc35f5ff6a6 req-2fa723d9-9d95-4006-af98-54bcafca9b92 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0758257 Nov 02 12:52:54.901820 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1814d859-578b-47ab-9edb-aed85054613d req-ef72a572-429e-41d1-8f37-b3598166581a tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:54.915403 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1814d859-578b-47ab-9edb-aed85054613d req-ef72a572-429e-41d1-8f37-b3598166581a tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.1891308 Nov 02 12:52:54.979328 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1814d859-578b-47ab-9edb-aed85054613d req-05effd6c-9cb6-4691-9451-737851c01402 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0611780 Nov 02 12:52:55.372835 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea3fbc35-febb-4d05-9deb-4f584a335498 req-0aac84b1-fb9e-49e9-a460-850869b8bb45 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:55.383839 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ea3fbc35-febb-4d05-9deb-4f584a335498 req-0aac84b1-fb9e-49e9-a460-850869b8bb45 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.1161621 Nov 02 12:52:55.512007 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ea3fbc35-febb-4d05-9deb-4f584a335498 req-9c0328e7-3465-4e9f-8b60-5454e23084d4 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1264884 Nov 02 12:52:55.711209 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-7346da91-4537-483e-a368-3ae65656a7ad None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:56.197151 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dcd95bd-6a77-4667-9f10-df2fa160542d req-614f8040-1e71-4fcc-8438-7a406f91531f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:56.205157 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3dcd95bd-6a77-4667-9f10-df2fa160542d req-614f8040-1e71-4fcc-8438-7a406f91531f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.0635548 Nov 02 12:52:56.310517 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3dcd95bd-6a77-4667-9f10-df2fa160542d req-68cf90f7-f821-42e6-ad39-9ffb3b845472 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1010299 Nov 02 12:52:56.663493 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-30657435-b847-4dd2-881b-16252b03c678 req-d67ed064-6fc7-4a3c-b9b7-cd0274d1f69f tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:56.669646 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-30657435-b847-4dd2-881b-16252b03c678 req-d67ed064-6fc7-4a3c-b9b7-cd0274d1f69f tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0754538 Nov 02 12:52:56.811310 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-30657435-b847-4dd2-881b-16252b03c678 req-27e003e0-15c2-44ff-8981-62dcac40ae3c tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1380372 Nov 02 12:52:56.839477 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:56.857418 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-c9430bc6-69ad-4852-b459-b7c243592781 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:56.859115 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-c9430bc6-69ad-4852-b459-b7c243592781 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/networks?id=bfe7dfe3-4b23-4454-b60a-4955be8d2d31 HTTP/1.1" status: 200 len: 815 time: 0.1687648 Nov 02 12:52:56.875867 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-b647464a-c0fd-4db6-99b8-f39ce9a5020e tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/quotas/dfe80527be524672a94a38908e154182 HTTP/1.1" status: 200 len: 375 time: 0.0108559 Nov 02 12:52:56.977065 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-56efd589-c938-4085-a552-04637c4839af tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?tenant_id=dfe80527be524672a94a38908e154182&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0946698 Nov 02 12:52:56.987242 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58da1d36-8cfd-4e44-b7df-8e9ab829ae81 req-6a8624fc-8a2f-4dea-a788-8f511fc887af tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:56.993510 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-58da1d36-8cfd-4e44-b7df-8e9ab829ae81 req-6a8624fc-8a2f-4dea-a788-8f511fc887af tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0731046 Nov 02 12:52:57.117652 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-58da1d36-8cfd-4e44-b7df-8e9ab829ae81 req-670ddfb3-35fd-4d2b-b8dc-6570be4780f0 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1181407 Nov 02 12:52:57.142684 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 59844) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:57.168745 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-fb06c185-263c-4f62-9073-f7fda50f5391 service neutron] 10.222.0.98 "GET /v2.0/networks/bfe7dfe3-4b23-4454-b60a-4955be8d2d31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1783369 Nov 02 12:52:57.727440 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-d61c52b5-958e-4029-8c5e-69f662a8de36 service neutron] 10.222.0.98 "GET /v2.0/networks/bfe7dfe3-4b23-4454-b60a-4955be8d2d31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.5521209 Nov 02 12:52:57.731787 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-33cf0b9a-610b-4a55-8f49-6996578881ec tempest-TestShelveInstance-1853807939 tempest-TestShelveInstance-1853807939-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:57.733004 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-33cf0b9a-610b-4a55-8f49-6996578881ec tempest-TestShelveInstance-1853807939 tempest-TestShelveInstance-1853807939-project-admin] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 1093 time: 0.5815988 Nov 02 12:52:57.736381 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 59866) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:52:57.741053 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-c24ab68d-2923-419d-958e-161466f77945 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Request body: {'floatingip': {'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'port_id': 'af83efde-b4cd-446b-9f74-15c631e4c45a', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'fixed_ip_address': '172.20.0.7'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:52:57.754398 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-301f868b-dd66-49ca-9a6d-c343be2cb5eb req-205c78d9-116d-4c0a-a1d3-b121aeafe5fe tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:57.759071 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-301f868b-dd66-49ca-9a6d-c343be2cb5eb req-205c78d9-116d-4c0a-a1d3-b121aeafe5fe tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.1281192 Nov 02 12:52:57.808158 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-301f868b-dd66-49ca-9a6d-c343be2cb5eb req-50ced498-a843-495f-8403-a3fc8f7018cd tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0478821 Nov 02 12:52:57.888318 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c24ab68d-2923-419d-958e-161466f77945 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for floatingip, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:58.023260 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c24ab68d-2923-419d-958e-161466f77945 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:58.060231 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-51a78f74-3000-460f-bda7-dbaa8cbb6295 req-0ecf7d10-5e79-4c30-9dab-ad67558a1b9e tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=a22a0824-cc65-473d-87a8-d29d93f08b8c HTTP/1.1" status: 200 len: 210 time: 0.0327544 Nov 02 12:52:58.214347 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_common [None req-c24ab68d-2923-419d-958e-161466f77945 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Allocated IP 172.27.0.18 (43464fa8-eb00-46fb-9ca0-be7342f9ddbf/44a807bc-f2b6-41f0-b765-e5d3393fe305/aed3a923-6de8-4776-8486-734106a997df) {{(pid=108542) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:52:58.347030 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c24ab68d-2923-419d-958e-161466f77945 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for port, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:58.372490 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:58.489400 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c24ab68d-2923-419d-958e-161466f77945 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:58.544017 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c24ab68d-2923-419d-958e-161466f77945 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:52:58.545750 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-c24ab68d-2923-419d-958e-161466f77945 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:52:58.548677 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c24ab68d-2923-419d-958e-161466f77945 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Received port after_create {{(pid=108542) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:52:58.587314 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c24ab68d-2923-419d-958e-161466f77945 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Pushing event updated for resources: {'Port': ['ID=aed3a923-6de8-4776-8486-734106a997df,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:58.971161 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aa27ed2-d9eb-4316-b3e4-6660c793659a req-ed7c52f2-570c-43ae-9f02-089f5a18fb4b tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:52:58.973716 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5aa27ed2-d9eb-4316-b3e4-6660c793659a req-ed7c52f2-570c-43ae-9f02-089f5a18fb4b tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.0795488 Nov 02 12:52:59.056680 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5aa27ed2-d9eb-4316-b3e4-6660c793659a req-6884c832-5cd0-4eba-ad7a-bf707818d831 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0641377 Nov 02 12:52:59.172660 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-20d3088b-6445-4b3a-b8ad-bad384423271 req-07ef31c9-b3a5-4b42-9560-cd78ab4782b4 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=a22a0824-cc65-473d-87a8-d29d93f08b8c HTTP/1.1" status: 200 len: 210 time: 0.0317082 Nov 02 12:52:59.254002 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c24ab68d-2923-419d-958e-161466f77945 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:59.475901 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c24ab68d-2923-419d-958e-161466f77945 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:59.655844 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c24ab68d-2923-419d-958e-161466f77945 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for port, precommit_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:59.858952 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c24ab68d-2923-419d-958e-161466f77945 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126476609'] for port, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:52:59.931689 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c24ab68d-2923-419d-958e-161466f77945 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Pushing event updated for resources: {'Port': ['ID=aed3a923-6de8-4776-8486-734106a997df,revision_number=2']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:52:59.944855 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c24ab68d-2923-419d-958e-161466f77945 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1594992'] for floatingip, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:00.059991 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.db.l3_db [None req-c24ab68d-2923-419d-958e-161466f77945 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Floating IP f46d9396-c840-4a9d-8cad-669b6639bbc1 associated. External IP: 172.27.0.18, port: af83efde-b4cd-446b-9f74-15c631e4c45a. Nov 02 12:53:00.196209 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a42e13c4-95c3-4be3-af37-1d838d260994 req-6874e6a3-a431-4589-9b94-7eb9dddf3128 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:00.197761 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a42e13c4-95c3-4be3-af37-1d838d260994 req-6874e6a3-a431-4589-9b94-7eb9dddf3128 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.0605252 Nov 02 12:53:00.256093 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a42e13c4-95c3-4be3-af37-1d838d260994 req-5f898e7a-f46b-42cc-8b7c-5d5a156ff8c7 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0514133 Nov 02 12:53:00.293959 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-50b80d3a-36bb-4e7c-b8c4-d606a9bad0de req-039cce79-3f70-4763-b9fd-94d66bca19b7 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=a22a0824-cc65-473d-87a8-d29d93f08b8c HTTP/1.1" status: 200 len: 210 time: 0.0315773 Nov 02 12:53:00.319952 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c24ab68d-2923-419d-958e-161466f77945 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Router 10f9b13b-6fcd-41e4-937a-5876beb694b1 has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108542) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 12:53:00.692643 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c24ab68d-2923-419d-958e-161466f77945 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108542) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:53:00.703046 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e06af5ba-4ad4-4e20-974b-3f36f39bc674 None None] Sync routers for ids ['10f9b13b-6fcd-41e4-937a-5876beb694b1'] in dv-cinder-816324-1-iscsi {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:53:00.713129 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e06af5ba-4ad4-4e20-974b-3f36f39bc674 None None] Routers {'10f9b13b-6fcd-41e4-937a-5876beb694b1'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:53:00.713762 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-e06af5ba-4ad4-4e20-974b-3f36f39bc674 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:52:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['10f9b13b-6fcd-41e4-937a-5876beb694b1'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:53:00.885257 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c24ab68d-2923-419d-958e-161466f77945 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for floatingip, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:00.919602 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-c24ab68d-2923-419d-958e-161466f77945 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 995 time: 3.1820631 Nov 02 12:53:00.920425 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8', 'tag': 'af83efde-b4cd-446b-9f74-15c631e4c45a'}] {{(pid=108542) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:53:00.923649 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8fdc2194739644bb754d6b187539f80d2eba7dc5c5d5392f1a2d22d03c0a316c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-26eb3ed8-da85-42b5-9649-93c4a783a82a" -d '{"events": [{"name": "network-changed", "server_uuid": "d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8", "tag": "af83efde-b4cd-446b-9f74-15c631e4c45a"}]}' {{(pid=108542) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:53:00.948815 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:00.964255 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:53:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-16cbb735-0c44-4dac-a4f4-d8748716d60c x-openstack-request-id: req-16cbb735-0c44-4dac-a4f4-d8748716d60c {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:53:00.965075 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8", "tag": "af83efde-b4cd-446b-9f74-15c631e4c45a", "status": "completed", "code": 200}]} {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:53:00.965552 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-16cbb735-0c44-4dac-a4f4-d8748716d60c {{(pid=108542) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:53:00.966177 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8', 'tag': 'af83efde-b4cd-446b-9f74-15c631e4c45a', 'status': 'completed', 'code': 200} Nov 02 12:53:00.975319 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-e06af5ba-4ad4-4e20-974b-3f36f39bc674 None None] Set router 10f9b13b-6fcd-41e4-937a-5876beb694b1 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:53:00.989305 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-a66308ad-03e1-4013-a200-ac9330c37c1f tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:00.991379 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-a66308ad-03e1-4013-a200-ac9330c37c1f tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.90 "GET /v2.0/networks?id=bfe7dfe3-4b23-4454-b60a-4955be8d2d31 HTTP/1.1" status: 200 len: 815 time: 0.1377478 Nov 02 12:53:01.007128 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-37af35a3-b532-420f-8d52-5ad56cfd773f tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Request body: {'port': {'device_id': 'a22a0824-cc65-473d-87a8-d29d93f08b8c', 'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31', 'admin_state_up': True, 'tenant_id': 'dfe80527be524672a94a38908e154182'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:53:01.039471 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26eb3ed8-da85-42b5-9649-93c4a783a82a req-522a0b6c-9563-499e-93c0-645c9728855c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:01.041405 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-26eb3ed8-da85-42b5-9649-93c4a783a82a req-522a0b6c-9563-499e-93c0-645c9728855c service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=d3bf5c9bdd7f479aa4cbc28f9a007c81&device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 1098 time: 0.0496702 Nov 02 12:53:01.164040 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26eb3ed8-da85-42b5-9649-93c4a783a82a req-3202945f-b453-4c6c-8d9a-cf8f7fbe8798 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:01.165671 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-26eb3ed8-da85-42b5-9649-93c4a783a82a req-3202945f-b453-4c6c-8d9a-cf8f7fbe8798 service neutron] 10.222.0.90 "GET /v2.0/networks?id=adffa68a-25de-4006-9dcc-006cbedf32e3 HTTP/1.1" status: 200 len: 910 time: 0.1158812 Nov 02 12:53:01.285090 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-26eb3ed8-da85-42b5-9649-93c4a783a82a req-e0febc33-576b-4dcb-b4b9-cf83a1cf1956 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=af83efde-b4cd-446b-9f74-15c631e4c45a HTTP/1.1" status: 200 len: 998 time: 0.1089182 Nov 02 12:53:01.289364 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-37af35a3-b532-420f-8d52-5ad56cfd773f tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Made reservation on behalf of dfe80527be524672a94a38908e154182 for: {'port': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:53:01.293942 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-37af35a3-b532-420f-8d52-5ad56cfd773f tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:01.323318 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-e06af5ba-4ad4-4e20-974b-3f36f39bc674 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'name': 'tempest-TestShelveInstance-1902419255-router', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:17Z', 'updated_at': '2021-11-02T12:51:26Z', 'revision_number': 4, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'gw_port': {'id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b1:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 365, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:19Z', 'updated_at': '2021-11-02T12:51:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': 'f46d9396-c840-4a9d-8cad-669b6639bbc1', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'floating_ip_address': '172.27.0.18', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'port_id': 'af83efde-b4cd-446b-9f74-15c631e4c45a', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 465, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3', 'mac_address': 'fa:16:3e:85:c9:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:52:58Z', 'updated_at': '2021-11-02T12:52:58Z', 'revision_number': 0, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0201d689-2e60-4ec9-800a-0897da7fce09', 'name': '', 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'mac_address': 'fa:16:3e:34:99:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '9a20b259-01c2-4b3f-8f92-0797a18ff7f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:24Z', 'updated_at': '2021-11-02T12:51:36Z', 'revision_number': 5, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'subnets': [{'id': '9a20b259-01c2-4b3f-8f92-0797a18ff7f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:53:01.358241 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26eb3ed8-da85-42b5-9649-93c4a783a82a req-dba04f57-11b7-4c96-a48e-5c79bf9cb033 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:01.360818 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-26eb3ed8-da85-42b5-9649-93c4a783a82a req-dba04f57-11b7-4c96-a48e-5c79bf9cb033 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=9a20b259-01c2-4b3f-8f92-0797a18ff7f7 HTTP/1.1" status: 200 len: 848 time: 0.0631247 Nov 02 12:53:01.400222 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e06af5ba-4ad4-4e20-974b-3f36f39bc674 None None] Checking router: 10f9b13b-6fcd-41e4-937a-5876beb694b1 for host: dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:53:01.410780 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e06af5ba-4ad4-4e20-974b-3f36f39bc674 None None] Routers {'10f9b13b-6fcd-41e4-937a-5876beb694b1'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:53:01.411749 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-e06af5ba-4ad4-4e20-974b-3f36f39bc674 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:52:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['10f9b13b-6fcd-41e4-937a-5876beb694b1'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:53:01.443512 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26eb3ed8-da85-42b5-9649-93c4a783a82a req-08283f22-9894-48da-adde-db80f3faa8a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:01.445059 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-26eb3ed8-da85-42b5-9649-93c4a783a82a req-08283f22-9894-48da-adde-db80f3faa8a6 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=adffa68a-25de-4006-9dcc-006cbedf32e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0760517 Nov 02 12:53:01.501056 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-dc3133e1-887c-482a-903a-341d5fec9003 req-5a92df9b-d450-4784-9dd1-900037bcd9a2 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=a22a0824-cc65-473d-87a8-d29d93f08b8c HTTP/1.1" status: 200 len: 210 time: 0.0532904 Nov 02 12:53:01.536666 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-37af35a3-b532-420f-8d52-5ad56cfd773f tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Allocated IP 172.20.0.2 (bfe7dfe3-4b23-4454-b60a-4955be8d2d31/8f42833a-0a0e-4198-a7cf-e79133593615/4f01baba-1c26-4499-8ddb-2a95a7508f49) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:53:01.546946 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-e06af5ba-4ad4-4e20-974b-3f36f39bc674 None None] Set router 10f9b13b-6fcd-41e4-937a-5876beb694b1 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:53:01.562842 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a27207d-3b6c-41b4-9e9d-ac7e98cf285f req-11632a20-61ed-4cf1-80fa-62e8523855b6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:01.564595 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a27207d-3b6c-41b4-9e9d-ac7e98cf285f req-11632a20-61ed-4cf1-80fa-62e8523855b6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.1158180 Nov 02 12:53:01.588393 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-26eb3ed8-da85-42b5-9649-93c4a783a82a req-0d69f350-0aae-4cf2-aae1-d7a1bb4d2a8e service neutron] 10.222.0.90 "GET /v2.0/networks/adffa68a-25de-4006-9dcc-006cbedf32e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1350327 Nov 02 12:53:01.686104 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a27207d-3b6c-41b4-9e9d-ac7e98cf285f req-b18f7fc4-f4ef-4233-9a01-ad8268fde093 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1070323 Nov 02 12:53:01.748749 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-26eb3ed8-da85-42b5-9649-93c4a783a82a req-07da4238-a540-4c5d-9c7f-a44648b80467 service neutron] 10.222.0.90 "GET /v2.0/networks/adffa68a-25de-4006-9dcc-006cbedf32e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1438577 Nov 02 12:53:01.803725 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-37af35a3-b532-420f-8d52-5ad56cfd773f tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:01.833501 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-e06af5ba-4ad4-4e20-974b-3f36f39bc674 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'name': 'tempest-TestShelveInstance-1902419255-router', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:17Z', 'updated_at': '2021-11-02T12:51:26Z', 'revision_number': 4, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'gw_port': {'id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b1:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 365, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:19Z', 'updated_at': '2021-11-02T12:51:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': 'f46d9396-c840-4a9d-8cad-669b6639bbc1', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'floating_ip_address': '172.27.0.18', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'port_id': 'af83efde-b4cd-446b-9f74-15c631e4c45a', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 465, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3', 'mac_address': 'fa:16:3e:85:c9:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:52:58Z', 'updated_at': '2021-11-02T12:52:58Z', 'revision_number': 0, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0201d689-2e60-4ec9-800a-0897da7fce09', 'name': '', 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'mac_address': 'fa:16:3e:34:99:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '9a20b259-01c2-4b3f-8f92-0797a18ff7f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:24Z', 'updated_at': '2021-11-02T12:51:36Z', 'revision_number': 5, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'subnets': [{'id': '9a20b259-01c2-4b3f-8f92-0797a18ff7f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:53:01.863035 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e06af5ba-4ad4-4e20-974b-3f36f39bc674 None None] The sync data for ids ['10f9b13b-6fcd-41e4-937a-5876beb694b1'] in dv-cinder-816324-1-iscsi is: [{'id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'name': 'tempest-TestShelveInstance-1902419255-router', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:17Z', 'updated_at': '2021-11-02T12:51:26Z', 'revision_number': 4, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'gw_port': {'id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b1:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 365, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:19Z', 'updated_at': '2021-11-02T12:51:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': 'f46d9396-c840-4a9d-8cad-669b6639bbc1', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'floating_ip_address': '172.27.0.18', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'port_id': 'af83efde-b4cd-446b-9f74-15c631e4c45a', 'fixed_ip_address': '172.20.0.7', 'status': 'DOWN', 'standard_attr_id': 465, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3', 'mac_address': 'fa:16:3e:85:c9:af', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:52:58Z', 'updated_at': '2021-11-02T12:52:58Z', 'revision_number': 0, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '0201d689-2e60-4ec9-800a-0897da7fce09', 'name': '', 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'mac_address': 'fa:16:3e:34:99:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '9a20b259-01c2-4b3f-8f92-0797a18ff7f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:24Z', 'updated_at': '2021-11-02T12:51:36Z', 'revision_number': 5, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'subnets': [{'id': '9a20b259-01c2-4b3f-8f92-0797a18ff7f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:53:01.967156 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-37af35a3-b532-420f-8d52-5ad56cfd773f tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:01.982687 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['4c597805-3835-4f59-b320-5614de6b4ec6', '4767bbe8-ea52-4258-9417-d866fb33fb53', 'f173e8db-9c28-4415-be12-b2f898eb931e'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:53:02.030818 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-37af35a3-b532-420f-8d52-5ad56cfd773f tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Network bfe7dfe3-4b23-4454-b60a-4955be8d2d31 is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:53:02.032982 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-37af35a3-b532-420f-8d52-5ad56cfd773f tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:53:02.037604 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-37af35a3-b532-420f-8d52-5ad56cfd773f tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:53:02.103457 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-37af35a3-b532-420f-8d52-5ad56cfd773f tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Pushing event updated for resources: {'Port': ['ID=4f01baba-1c26-4499-8ddb-2a95a7508f49,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:53:02.139239 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-37af35a3-b532-420f-8d52-5ad56cfd773f tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:02.140042 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-37af35a3-b532-420f-8d52-5ad56cfd773f tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:02.156832 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-37d21aa8-465f-4136-a61f-ff19e39d607d None None] New status for floating IP f46d9396-c840-4a9d-8cad-669b6639bbc1: ACTIVE {{(pid=108545) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 02 12:53:02.193115 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-11282aa8-b4be-439d-bd87-c3418a379bb1 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-167174139&fields=id&tenant_id=697de566c0334435b902950f6f31da45 HTTP/1.1" status: 200 len: 267 time: 0.0743203 Nov 02 12:53:02.280004 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-37af35a3-b532-420f-8d52-5ad56cfd773f tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2774181 Nov 02 12:53:02.305193 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-a0715148-032e-4019-b992-038970dbd391 service neutron] Request body: {'port': {'device_id': 'a22a0824-cc65-473d-87a8-d29d93f08b8c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81632'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:53:02.383174 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-19899426-d8eb-474b-bee3-f3812b41bee3 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:02.384729 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-19899426-d8eb-474b-bee3-f3812b41bee3 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/networks?id=89f406ae-1b9f-4be7-8881-87075d7c5aa1 HTTP/1.1" status: 200 len: 812 time: 0.1833167 Nov 02 12:53:02.394009 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-a0715148-032e-4019-b992-038970dbd391 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:02.411344 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-fed08d0e-543b-4ba5-a090-392a158edc0b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/quotas/697de566c0334435b902950f6f31da45 HTTP/1.1" status: 200 len: 375 time: 0.0189764 Nov 02 12:53:02.550556 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-04ecd43b-c9d0-4d6f-8997-48755440a8c6 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?tenant_id=697de566c0334435b902950f6f31da45&fields=id HTTP/1.1" status: 200 len: 302 time: 0.1326616 Nov 02 12:53:02.645873 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 60036) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:53:02.695661 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_v2 [None req-13ba6d2d-87c1-4844-988f-1ea506705b36 admin admin] Deleting subnet 2d4c8b31-ca6f-4edf-b0a6-e43793692679 {{(pid=108542) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 02 12:53:02.700022 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-13ba6d2d-87c1-4844-988f-1ea506705b36 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:02.749183 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-13ba6d2d-87c1-4844-988f-1ea506705b36 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3344686'] for subnet, precommit_delete_associations {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:02.770669 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2c13f0b-6891-4799-b752-435fdf372b04 req-ae01e116-8a41-4b59-85c7-ae58d1a70c02 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:02.772375 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a2c13f0b-6891-4799-b752-435fdf372b04 req-ae01e116-8a41-4b59-85c7-ae58d1a70c02 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=a22a0824-cc65-473d-87a8-d29d93f08b8c HTTP/1.1" status: 200 len: 931 time: 0.1849043 Nov 02 12:53:02.798733 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-4b2a5dbf-d974-40ac-8206-4fe16b786488 service neutron] 10.222.0.98 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2335978 Nov 02 12:53:02.820244 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-13ba6d2d-87c1-4844-988f-1ea506705b36 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-933154'] for subnet, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:02.906348 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-136e3aa0-e83a-4f0d-81da-4bdd9a7918ae req-c825c357-842f-4e3b-a4dc-2061ddfa9a51 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:02.908099 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-136e3aa0-e83a-4f0d-81da-4bdd9a7918ae req-c825c357-842f-4e3b-a4dc-2061ddfa9a51 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=aaddc046689441b8ab3641f2afd07c0e&device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 1096 time: 0.0575974 Nov 02 12:53:02.932638 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a2c13f0b-6891-4799-b752-435fdf372b04 req-cf7f1845-3183-4314-8726-c6f43e7dd3a9 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1486843 Nov 02 12:53:02.944565 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-a0715148-032e-4019-b992-038970dbd391 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 4f01baba-1c26-4499-8ddb-2a95a7508f49 {{(pid=108543) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:53:02.964131 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-a0715148-032e-4019-b992-038970dbd391 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:02.988851 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-cb55d7c7-6c56-4f7c-9e28-e8b51f77b22f service neutron] 10.222.0.98 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1828125 Nov 02 12:53:02.990232 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.provisioning_blocks [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-a0715148-032e-4019-b992-038970dbd391 service neutron] Transition to ACTIVE for port object 4f01baba-1c26-4499-8ddb-2a95a7508f49 will not be triggered until provisioned by entity L2. {{(pid=108543) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 02 12:53:02.991560 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-13ba6d2d-87c1-4844-988f-1ea506705b36 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-933141', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126478215', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126185624'] for subnet, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:03.023538 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-13ba6d2d-87c1-4844-988f-1ea506705b36 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=2d4c8b31-ca6f-4edf-b0a6-e43793692679,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:53:03.041222 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-13ba6d2d-87c1-4844-988f-1ea506705b36 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:03.047393 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-13ba6d2d-87c1-4844-988f-1ea506705b36 admin admin] 10.222.0.98 "DELETE /v2.0/subnets/2d4c8b31-ca6f-4edf-b0a6-e43793692679 HTTP/1.1" status: 204 len: 168 time: 0.4000027 Nov 02 12:53:03.049881 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 60042) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:53:03.071756 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-704026c3-c74c-43fe-a085-502d8920f6c8 req-a8bd16ec-dbd2-4dc8-8020-e6b253478aa3 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:03.073350 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-704026c3-c74c-43fe-a085-502d8920f6c8 req-a8bd16ec-dbd2-4dc8-8020-e6b253478aa3 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.0755334 Nov 02 12:53:03.094936 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-a0715148-032e-4019-b992-038970dbd391 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:03.100375 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-136e3aa0-e83a-4f0d-81da-4bdd9a7918ae req-024b4271-64d2-4446-8102-f801bdc4bb54 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:03.100375 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-136e3aa0-e83a-4f0d-81da-4bdd9a7918ae req-024b4271-64d2-4446-8102-f801bdc4bb54 service neutron] 10.222.0.90 "GET /v2.0/networks?id=c468f0e1-3636-49b9-90c6-b90c643ed7d1 HTTP/1.1" status: 200 len: 917 time: 0.1682878 Nov 02 12:53:03.214784 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-136e3aa0-e83a-4f0d-81da-4bdd9a7918ae req-cc064aa1-70ac-411a-88e6-5d334eddc93f service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=bf7c4605-4045-4117-af22-08d75129b835 HTTP/1.1" status: 200 len: 999 time: 0.1092467 Nov 02 12:53:03.249037 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-704026c3-c74c-43fe-a085-502d8920f6c8 req-5992c591-cc4b-4415-bf59-3783f8b2886e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1634879 Nov 02 12:53:03.249740 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0715148-032e-4019-b992-038970dbd391 service neutron] Pushing event updated for resources: {'Port': ['ID=4f01baba-1c26-4499-8ddb-2a95a7508f49,revision_number=2']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:53:03.256305 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-35b4b718-aeb7-4f51-b73c-a390664cc9e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-972735'] for network, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:03.279959 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-136e3aa0-e83a-4f0d-81da-4bdd9a7918ae req-71bbb7ff-4b0c-49f7-aa2e-2f5898bd4c8c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:03.281505 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-136e3aa0-e83a-4f0d-81da-4bdd9a7918ae req-71bbb7ff-4b0c-49f7-aa2e-2f5898bd4c8c service neutron] 10.222.0.90 "GET /v2.0/subnets?id=ec48fe57-a1cd-4e7c-874f-073624f71f4b HTTP/1.1" status: 200 len: 855 time: 0.0575335 Nov 02 12:53:03.331204 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-136e3aa0-e83a-4f0d-81da-4bdd9a7918ae req-a2128b67-6a9a-4bcd-8a23-04d15c389d8a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:03.332773 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-136e3aa0-e83a-4f0d-81da-4bdd9a7918ae req-a2128b67-6a9a-4bcd-8a23-04d15c389d8a service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=c468f0e1-3636-49b9-90c6-b90c643ed7d1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0428572 Nov 02 12:53:03.361595 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:03.407368 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-35b4b718-aeb7-4f51-b73c-a390664cc9e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-930985', 'neutron.services.segments.db._delete_segments_for_network-8738449897966'] for network, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:03.415950 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-a0715148-032e-4019-b992-038970dbd391 service neutron] Attempting to bind port 4f01baba-1c26-4499-8ddb-2a95a7508f49 on host hv-cinder-81632 for vnic_type normal with profile {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:53:03.415950 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-a0715148-032e-4019-b992-038970dbd391 service neutron] Attempting to bind port 4f01baba-1c26-4499-8ddb-2a95a7508f49 by drivers openvswitch,hyperv on host hv-cinder-81632 at level 0 using segments [{'id': 'e912b2b1-808c-4d37-a99d-fcfdb9d2a5db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31'}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:53:03.416296 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-a0715148-032e-4019-b992-038970dbd391 service neutron] Attempting to bind port 4f01baba-1c26-4499-8ddb-2a95a7508f49 on network bfe7dfe3-4b23-4454-b60a-4955be8d2d31 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:53:03.425203 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-a0715148-032e-4019-b992-038970dbd391 service neutron] Port 4f01baba-1c26-4499-8ddb-2a95a7508f49 on network bfe7dfe3-4b23-4454-b60a-4955be8d2d31 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81632 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 02 12:53:03.425527 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-a0715148-032e-4019-b992-038970dbd391 service neutron] Attempting to bind port 4f01baba-1c26-4499-8ddb-2a95a7508f49 on network bfe7dfe3-4b23-4454-b60a-4955be8d2d31 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:53:03.435164 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-136e3aa0-e83a-4f0d-81da-4bdd9a7918ae req-5baa0e79-bc46-46d1-ad71-19a0232d918e service neutron] 10.222.0.90 "GET /v2.0/networks/c468f0e1-3636-49b9-90c6-b90c643ed7d1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0946467 Nov 02 12:53:03.438952 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-a0715148-032e-4019-b992-038970dbd391 service neutron] Checking agent: {'id': '0d57fa42-4660-4f08-b7dc-53a872c3c01c', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81632', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'started_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 53, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:53:03.439293 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-a0715148-032e-4019-b992-038970dbd391 service neutron] Checking segment: {'id': 'e912b2b1-808c-4d37-a99d-fcfdb9d2a5db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108543) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:53:03.439728 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-a0715148-032e-4019-b992-038970dbd391 service neutron] Bound using segment: {'id': 'e912b2b1-808c-4d37-a99d-fcfdb9d2a5db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31'} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:53:03.440179 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-a0715148-032e-4019-b992-038970dbd391 service neutron] Bound port: 4f01baba-1c26-4499-8ddb-2a95a7508f49, host: hv-cinder-81632, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e912b2b1-808c-4d37-a99d-fcfdb9d2a5db', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 862, 'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31'}}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:53:03.440611 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-a0715148-032e-4019-b992-038970dbd391 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:03.444238 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.services.segments.db [None req-35b4b718-aeb7-4f51-b73c-a390664cc9e0 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['cf53051c-17aa-4d08-a264-6c6ed50a7a96']}} {{(pid=108543) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:53:03.463422 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.services.segments.db [None req-35b4b718-aeb7-4f51-b73c-a390664cc9e0 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '9918b664-73ec-4ba3-8b79-1b2dd2746c03') {'for_net_delete': True} {{(pid=108543) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:53:03.463726 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.services.segments.db [None req-35b4b718-aeb7-4f51-b73c-a390664cc9e0 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '9918b664-73ec-4ba3-8b79-1b2dd2746c03') {} {{(pid=108543) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:53:03.492359 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-35b4b718-aeb7-4f51-b73c-a390664cc9e0 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738449902583', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3308610'] for segment, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:03.514725 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-35b4b718-aeb7-4f51-b73c-a390664cc9e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:03.530602 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-35b4b718-aeb7-4f51-b73c-a390664cc9e0 admin admin] Releasing vlan 889 on physical network physnet1 to pool {{(pid=108543) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 02 12:53:03.531003 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-35b4b718-aeb7-4f51-b73c-a390664cc9e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126393740'] for segment, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: Traceback (most recent call last): Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: timer() Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: cb(*args, **kw) Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: return func(*args, **kwargs) Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: self._notify() Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: self.callback(batched_events) Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: event.method(event) Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: aggregate_uuid = self.p_client.list_aggregates( Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: return f(self, *a, **k) Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: return self._get(url).json() Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: return self.request(url, 'GET', **kwargs) Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: base_url = self.get_endpoint(auth, allow=allow, Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 02 12:53:03.533122 dv-cinder-816324-1-iscsi neutron-server[108543]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 02 12:53:03.546209 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-136e3aa0-e83a-4f0d-81da-4bdd9a7918ae req-1155be69-2ea2-497b-9cc5-532660cad3de service neutron] 10.222.0.90 "GET /v2.0/networks/c468f0e1-3636-49b9-90c6-b90c643ed7d1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1016665 Nov 02 12:53:03.593044 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-a0715148-032e-4019-b992-038970dbd391 service neutron] For port 4f01baba-1c26-4499-8ddb-2a95a7508f49, host hv-cinder-81632, cleared binding levels {{(pid=108543) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:53:03.605867 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-a0715148-032e-4019-b992-038970dbd391 service neutron] For port 4f01baba-1c26-4499-8ddb-2a95a7508f49, host hv-cinder-81632, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=4f01baba-1c26-4499-8ddb-2a95a7508f49,segment=NetworkSegment(e912b2b1-808c-4d37-a99d-fcfdb9d2a5db),segment_id=e912b2b1-808c-4d37-a99d-fcfdb9d2a5db)] {{(pid=108543) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:53:03.741268 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 60054) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:53:03.767680 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-35b4b718-aeb7-4f51-b73c-a390664cc9e0 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-930976', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1594946'] for network, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:03.773480 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-35b4b718-aeb7-4f51-b73c-a390664cc9e0 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:03.777805 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-35b4b718-aeb7-4f51-b73c-a390664cc9e0 admin admin] 10.222.0.98 "DELETE /v2.0/networks/cf53051c-17aa-4d08-a264-6c6ed50a7a96 HTTP/1.1" status: 204 len: 168 time: 0.7268796 Nov 02 12:53:03.782213 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-a0715148-032e-4019-b992-038970dbd391 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:03.824808 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-35b4b718-aeb7-4f51-b73c-a390664cc9e0 admin admin] Pushing event deleted for resources: {'Network': ['ID=cf53051c-17aa-4d08-a264-6c6ed50a7a96,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:53:03.848692 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-a0715148-032e-4019-b992-038970dbd391 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:03.849317 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-a0715148-032e-4019-b992-038970dbd391 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:03.851333 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-a0715148-032e-4019-b992-038970dbd391 service neutron] 10.222.0.90 "PUT /v2.0/ports/4f01baba-1c26-4499-8ddb-2a95a7508f49 HTTP/1.1" status: 200 len: 1093 time: 1.5512085 Nov 02 12:53:03.863424 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a22a0824-cc65-473d-87a8-d29d93f08b8c', 'tag': '4f01baba-1c26-4499-8ddb-2a95a7508f49'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:53:03.866647 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2e35f29c-1706-4f78-a1ae-b913c36cde74" -d '{"events": [{"name": "network-changed", "server_uuid": "a22a0824-cc65-473d-87a8-d29d93f08b8c", "tag": "4f01baba-1c26-4499-8ddb-2a95a7508f49"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:53:03.892504 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ccd6afeb-055e-41fa-8c76-faf45047e067 req-54e099a4-bd04-4bb5-acb3-9fcc7e740c24 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 210 time: 0.0708413 Nov 02 12:53:03.927383 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:53:03 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-df83baa1-27d0-4b8e-b9da-3e1e85d43ef3 x-openstack-request-id: req-df83baa1-27d0-4b8e-b9da-3e1e85d43ef3 {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:53:03.927721 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a22a0824-cc65-473d-87a8-d29d93f08b8c", "tag": "4f01baba-1c26-4499-8ddb-2a95a7508f49", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:53:03.927983 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-df83baa1-27d0-4b8e-b9da-3e1e85d43ef3 {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:53:03.928377 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a22a0824-cc65-473d-87a8-d29d93f08b8c', 'tag': '4f01baba-1c26-4499-8ddb-2a95a7508f49', 'status': 'completed', 'code': 200} Nov 02 12:53:03.945226 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0715148-032e-4019-b992-038970dbd391 service neutron] Pushing event updated for resources: {'Port': ['ID=4f01baba-1c26-4499-8ddb-2a95a7508f49,revision_number=3']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:53:03.960942 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a0aaad2f-6827-4dca-9b48-c8b9a271d8f3 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:04.005675 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e35f29c-1706-4f78-a1ae-b913c36cde74 req-b8dabf92-c2bd-4568-b6db-94faf0709fd9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:04.007444 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2e35f29c-1706-4f78-a1ae-b913c36cde74 req-b8dabf92-c2bd-4568-b6db-94faf0709fd9 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=dfe80527be524672a94a38908e154182&device_id=a22a0824-cc65-473d-87a8-d29d93f08b8c HTTP/1.1" status: 200 len: 1096 time: 0.0501680 Nov 02 12:53:04.070642 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a0aaad2f-6827-4dca-9b48-c8b9a271d8f3 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:04.141676 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-75cad63d-0de2-4379-98f8-4ea2450c2864 req-2939ccec-79b1-4085-84f1-bf66bddda026 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:04.143790 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-75cad63d-0de2-4379-98f8-4ea2450c2864 req-2939ccec-79b1-4085-84f1-bf66bddda026 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=a22a0824-cc65-473d-87a8-d29d93f08b8c HTTP/1.1" status: 200 len: 943 time: 0.1285274 Nov 02 12:53:04.180042 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e35f29c-1706-4f78-a1ae-b913c36cde74 req-27d57a06-30c4-4f97-9ed1-4b8c680433d1 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:04.181642 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2e35f29c-1706-4f78-a1ae-b913c36cde74 req-27d57a06-30c4-4f97-9ed1-4b8c680433d1 service neutron] 10.222.0.90 "GET /v2.0/networks?tenant_id=dfe80527be524672a94a38908e154182&shared=False HTTP/1.1" status: 200 len: 916 time: 0.1565118 Nov 02 12:53:04.207328 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a0aaad2f-6827-4dca-9b48-c8b9a271d8f3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:04.240482 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-75cad63d-0de2-4379-98f8-4ea2450c2864 req-1e78f964-1425-43f4-98bd-771a22829d9c tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0903304 Nov 02 12:53:04.249273 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0aaad2f-6827-4dca-9b48-c8b9a271d8f3 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=db8cbcbc-10e0-4891-98d7-c8f608567b15,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:53:04.253851 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-a0aaad2f-6827-4dca-9b48-c8b9a271d8f3 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=da3ebe2f415141e08ca50e190698d260&name=default HTTP/1.1" status: 200 len: 2996 time: 0.5114000 Nov 02 12:53:04.256521 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 60072) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:53:04.294655 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 60076) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:53:04.321601 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-02847d4d-223a-4da7-b42e-e24828c2b54b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:04.343019 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2e35f29c-1706-4f78-a1ae-b913c36cde74 req-dca295f6-08ab-498a-98a4-b11834b297e7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:04.344463 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2e35f29c-1706-4f78-a1ae-b913c36cde74 req-dca295f6-08ab-498a-98a4-b11834b297e7 service neutron] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1512332 Nov 02 12:53:04.350399 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-02847d4d-223a-4da7-b42e-e24828c2b54b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:04.352087 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device bf7c4605-4045-4117-af22-08d75129b835 details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 12:53:04.403876 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-2cb4e5b4-f408-4fff-b0e0-589a872eef9c admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=eeb1cb4c2b3844da903a64e77a350dab&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1079888 Nov 02 12:53:04.406720 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 60078) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:53:04.436691 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6214a602-7fcf-40ba-890f-15fc682128b6 req-ac945488-2919-4f2d-af0c-0bfc39ba1844 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:04.438134 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6214a602-7fcf-40ba-890f-15fc682128b6 req-ac945488-2919-4f2d-af0c-0bfc39ba1844 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 943 time: 0.1051865 Nov 02 12:53:04.466977 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-9cc9e759-1af2-4dbd-a137-d43874e9ff3a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:04.468485 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-9cc9e759-1af2-4dbd-a137-d43874e9ff3a service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=dfe80527be524672a94a38908e154182&device_id=a22a0824-cc65-473d-87a8-d29d93f08b8c HTTP/1.1" status: 200 len: 1096 time: 0.0766344 Nov 02 12:53:04.470208 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c9f77054-7285-40dd-904b-6a20d426a214 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:04.472323 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:53:04.480663 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port bf7c4605-4045-4117-af22-08d75129b835, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=bf7c4605-4045-4117-af22-08d75129b835,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:53:04.498821 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-02847d4d-223a-4da7-b42e-e24828c2b54b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:04.501335 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': 'bf7c4605-4045-4117-af22-08d75129b835', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'port_id': 'bf7c4605-4045-4117-af22-08d75129b835', 'mac_address': 'fa:16:3e:8b:d9:62', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 854, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 12:53:04.501669 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-02847d4d-223a-4da7-b42e-e24828c2b54b admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:04.506198 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-02847d4d-223a-4da7-b42e-e24828c2b54b admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/db8cbcbc-10e0-4891-98d7-c8f608567b15 HTTP/1.1" status: 204 len: 168 time: 0.2458375 Nov 02 12:53:04.529599 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-5f910885-da0e-4aad-96ee-ef85ce490959 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.2&port_id=4f01baba-1c26-4499-8ddb-2a95a7508f49 HTTP/1.1" status: 200 len: 217 time: 0.0491626 Nov 02 12:53:04.530996 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c9f77054-7285-40dd-904b-6a20d426a214 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:04.540850 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-02847d4d-223a-4da7-b42e-e24828c2b54b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=db8cbcbc-10e0-4891-98d7-c8f608567b15,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:53:04.549237 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:04.565380 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id bf7c4605-4045-4117-af22-08d75129b835 {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:53:04.585210 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6214a602-7fcf-40ba-890f-15fc682128b6 req-baf6e385-cb48-406d-97a2-2834aeb51ad0 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1389525 Nov 02 12:53:04.587262 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port bf7c4605-4045-4117-af22-08d75129b835, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=bf7c4605-4045-4117-af22-08d75129b835,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:53:04.614970 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-96e61354-8d54-4939-a32f-27dab5c66ec2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:04.616418 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-96e61354-8d54-4939-a32f-27dab5c66ec2 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=8f42833a-0a0e-4198-a7cf-e79133593615 HTTP/1.1" status: 200 len: 855 time: 0.0767791 Nov 02 12:53:04.658653 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-8a401dec-5161-40e7-85b2-fbe3a07904dc service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=bfe7dfe3-4b23-4454-b60a-4955be8d2d31&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0339341 Nov 02 12:53:04.681569 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:04.716616 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c9f77054-7285-40dd-904b-6a20d426a214 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:04.719565 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c9f77054-7285-40dd-904b-6a20d426a214 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:04.721027 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-c9f77054-7285-40dd-904b-6a20d426a214 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/eadb1119-2269-4956-923b-c60da15e2d12 HTTP/1.1" status: 204 len: 168 time: 0.3125865 Nov 02 12:53:04.732587 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c9f77054-7285-40dd-904b-6a20d426a214 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=eadb1119-2269-4956-923b-c60da15e2d12,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:53:04.754167 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=bf7c4605-4045-4117-af22-08d75129b835,revision_number=9']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:53:04.763951 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:04.764417 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:04.764652 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:04.766658 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:04.767166 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:04.767630 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:04.767853 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:04.768164 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:04.768506 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:04.768963 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:04.769159 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:04.769481 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:04.792523 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-689463c2-43cc-435e-9498-6fe0a660af6d service neutron] 10.222.0.90 "GET /v2.0/networks/bfe7dfe3-4b23-4454-b60a-4955be8d2d31?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1263342 Nov 02 12:53:04.893196 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cddd9dd0-c670-487a-a9f5-94c660ca4f82 req-c879a976-3785-474d-8299-934140de173b service neutron] 10.222.0.90 "GET /v2.0/networks/bfe7dfe3-4b23-4454-b60a-4955be8d2d31?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0922933 Nov 02 12:53:04.976988 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['bf7c4605-4045-4117-af22-08d75129b835'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:53:05.000590 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2aeb7fb0-d499-4a45-903c-fd97875ce98e req-9a704d88-6f4f-4ccc-b26d-31f3306fd55e tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 210 time: 0.0306449 Nov 02 12:53:05.374780 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5aa6be5a-b394-456a-968e-f54a15ab196b req-8eab77f7-df60-4da3-9b6a-3ff4a7f694e2 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:05.376454 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5aa6be5a-b394-456a-968e-f54a15ab196b req-8eab77f7-df60-4da3-9b6a-3ff4a7f694e2 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=a22a0824-cc65-473d-87a8-d29d93f08b8c HTTP/1.1" status: 200 len: 943 time: 0.0514941 Nov 02 12:53:05.425901 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5aa6be5a-b394-456a-968e-f54a15ab196b req-ef739c1d-4d64-4b15-a5c3-105c5fd43fb1 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0430541 Nov 02 12:53:05.757702 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-574571a6-3332-4751-a548-d5ef34d557e0 req-a85f39f5-154f-4846-95c3-c781962aa4f2 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:05.757702 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-574571a6-3332-4751-a548-d5ef34d557e0 req-a85f39f5-154f-4846-95c3-c781962aa4f2 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 944 time: 0.0652931 Nov 02 12:53:05.813811 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-574571a6-3332-4751-a548-d5ef34d557e0 req-a2fde69b-9b7a-411a-bb90-ce49f9acb9b8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0562994 Nov 02 12:53:06.097637 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-dea55b70-326b-4da3-8317-7df489bdddd5 req-ce845faa-b436-4a87-b8ed-923dc180bd5f tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 210 time: 0.0261257 Nov 02 12:53:06.363584 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 4f01baba-1c26-4499-8ddb-2a95a7508f49 details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 12:53:06.367581 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device bf7c4605-4045-4117-af22-08d75129b835 up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:53:06.492679 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port bf7c4605-4045-4117-af22-08d75129b835 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:53:06.493059 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:06.541974 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 4f01baba-1c26-4499-8ddb-2a95a7508f49, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=4f01baba-1c26-4499-8ddb-2a95a7508f49,segment=NetworkSegment(e912b2b1-808c-4d37-a99d-fcfdb9d2a5db),segment_id=e912b2b1-808c-4d37-a99d-fcfdb9d2a5db)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:53:06.558660 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': '4f01baba-1c26-4499-8ddb-2a95a7508f49', 'network_id': 'bfe7dfe3-4b23-4454-b60a-4955be8d2d31', 'port_id': '4f01baba-1c26-4499-8ddb-2a95a7508f49', 'mac_address': 'fa:16:3e:a0:8e:fc', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 862, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '8f42833a-0a0e-4198-a7cf-e79133593615', 'ip_address': '172.20.0.2'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 12:53:06.590235 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-836bc6a8-8f59-4d83-bab3-57bdf863b797 req-a8f44428-03c8-4d65-9c86-e5127a3c57e2 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:06.592281 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-836bc6a8-8f59-4d83-bab3-57bdf863b797 req-a8f44428-03c8-4d65-9c86-e5127a3c57e2 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=a22a0824-cc65-473d-87a8-d29d93f08b8c HTTP/1.1" status: 200 len: 943 time: 0.0586486 Nov 02 12:53:06.637859 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:06.648492 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:06.668292 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 4f01baba-1c26-4499-8ddb-2a95a7508f49 {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:53:06.687953 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7cc2c649-db32-4af2-b17b-1b744ef40a5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bf7c4605-4045-4117-af22-08d75129b835'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:53:06.690245 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3fce8d72-c9a5-4049-90b3-ce80795c2c96" -d '{"events": [{"server_uuid": "7cc2c649-db32-4af2-b17b-1b744ef40a5f", "name": "network-vif-plugged", "status": "completed", "tag": "bf7c4605-4045-4117-af22-08d75129b835"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:53:06.711132 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 4f01baba-1c26-4499-8ddb-2a95a7508f49, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=4f01baba-1c26-4499-8ddb-2a95a7508f49,segment=NetworkSegment(e912b2b1-808c-4d37-a99d-fcfdb9d2a5db),segment_id=e912b2b1-808c-4d37-a99d-fcfdb9d2a5db)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:53:06.713513 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port bf7c4605-4045-4117-af22-08d75129b835, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=bf7c4605-4045-4117-af22-08d75129b835,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:53:06.732957 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:53:06 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-825741c6-4013-4316-b6aa-0be511eb0b42 x-openstack-request-id: req-825741c6-4013-4316-b6aa-0be511eb0b42 {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:53:06.733266 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7cc2c649-db32-4af2-b17b-1b744ef40a5f", "name": "network-vif-plugged", "status": "completed", "tag": "bf7c4605-4045-4117-af22-08d75129b835", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:53:06.733603 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-825741c6-4013-4316-b6aa-0be511eb0b42 {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:53:06.733917 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7cc2c649-db32-4af2-b17b-1b744ef40a5f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'bf7c4605-4045-4117-af22-08d75129b835', 'code': 200} Nov 02 12:53:06.745754 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-836bc6a8-8f59-4d83-bab3-57bdf863b797 req-7021acde-7bd6-4ccb-b59e-f61abb638b66 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1348276 Nov 02 12:53:06.803523 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-c65b76dc-c2bc-4c39-a111-20bb56fc9f21 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:06.805039 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-c65b76dc-c2bc-4c39-a111-20bb56fc9f21 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.90 "GET /v2.0/networks?id=89f406ae-1b9f-4be7-8881-87075d7c5aa1 HTTP/1.1" status: 200 len: 812 time: 0.1808121 Nov 02 12:53:06.835241 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:06.839031 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:06.894548 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-63226231-526c-4db6-928e-f94571414b62 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.90 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=697de566c0334435b902950f6f31da45 HTTP/1.1" status: 200 len: 379 time: 0.0787497 Nov 02 12:53:06.909554 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-d263a57f-0aa5-4372-b78c-02acc7a91b22 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Request body: {'port': {'device_id': '23093020-2f8f-4aae-9657-27e0ea5d79b5', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'admin_state_up': True, 'tenant_id': '697de566c0334435b902950f6f31da45', 'security_groups': ['9bcd6e2d-4fff-4ee2-aaee-41104c05def3']}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:53:06.919259 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=4f01baba-1c26-4499-8ddb-2a95a7508f49,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:53:06.979985 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=bf7c4605-4045-4117-af22-08d75129b835,revision_number=10']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:53:07.049309 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-808242ee-3b64-4704-ace6-ad60f55fe1d6 req-5c93f0dd-1d7b-4ed2-acaf-1921ae1569da tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:07.056206 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-808242ee-3b64-4704-ace6-ad60f55fe1d6 req-5c93f0dd-1d7b-4ed2-acaf-1921ae1569da tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 946 time: 0.1375461 Nov 02 12:53:07.131030 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['4f01baba-1c26-4499-8ddb-2a95a7508f49'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:53:07.138769 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-808242ee-3b64-4704-ace6-ad60f55fe1d6 req-17f4957e-e788-4f62-8940-10e51b46fdf9 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0822773 Nov 02 12:53:07.248388 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-d263a57f-0aa5-4372-b78c-02acc7a91b22 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Made reservation on behalf of 697de566c0334435b902950f6f31da45 for: {'port': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:53:07.252722 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-d263a57f-0aa5-4372-b78c-02acc7a91b22 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:07.278197 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-52446703-c8aa-424c-97ea-5462f4405978 req-e2c92027-b04c-4909-96c1-29355b19a6cf tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 210 time: 0.0438137 Nov 02 12:53:07.423933 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-d263a57f-0aa5-4372-b78c-02acc7a91b22 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Allocated IP 172.20.0.9 (89f406ae-1b9f-4be7-8881-87075d7c5aa1/ae24c2fe-abba-48cd-9d91-28a628d2ef95/3023afb1-be90-4a32-980f-5f0fb88dc7be) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:53:07.572038 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5d11ddd1-0ffd-4a7b-bba8-bef330a84610 req-9467a7cd-89e5-4e18-8365-609398ecb2a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:07.573627 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-5d11ddd1-0ffd-4a7b-bba8-bef330a84610 req-9467a7cd-89e5-4e18-8365-609398ecb2a8 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 1099 time: 0.0457058 Nov 02 12:53:07.590272 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-d263a57f-0aa5-4372-b78c-02acc7a91b22 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:07.634018 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-5d11ddd1-0ffd-4a7b-bba8-bef330a84610 req-79b3d756-b582-4fc7-9bbd-83d0e37baf37 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0483668 Nov 02 12:53:07.756616 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-d263a57f-0aa5-4372-b78c-02acc7a91b22 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:07.801615 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-d263a57f-0aa5-4372-b78c-02acc7a91b22 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Network 89f406ae-1b9f-4be7-8881-87075d7c5aa1 is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:53:07.807064 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-d263a57f-0aa5-4372-b78c-02acc7a91b22 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:53:07.811129 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-d263a57f-0aa5-4372-b78c-02acc7a91b22 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:53:07.840068 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d263a57f-0aa5-4372-b78c-02acc7a91b22 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Pushing event updated for resources: {'Port': ['ID=3023afb1-be90-4a32-980f-5f0fb88dc7be,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:53:07.902289 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-d263a57f-0aa5-4372-b78c-02acc7a91b22 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:07.902968 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-d263a57f-0aa5-4372-b78c-02acc7a91b22 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:07.928072 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-459b4666-80bf-4fa0-baf0-7b2162d318ce req-7699e890-56cd-4fae-b802-26079b2aa3b8 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:07.932010 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-459b4666-80bf-4fa0-baf0-7b2162d318ce req-7699e890-56cd-4fae-b802-26079b2aa3b8 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=a22a0824-cc65-473d-87a8-d29d93f08b8c HTTP/1.1" status: 200 len: 944 time: 0.0944667 Nov 02 12:53:08.101376 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-51962a83-23b8-4d86-974b-1a07ddcc6a4b None None] Provisioning complete for port 3023afb1-be90-4a32-980f-5f0fb88dc7be triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:53:08.102418 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-51962a83-23b8-4d86-974b-1a07ddcc6a4b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:08.161534 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-51962a83-23b8-4d86-974b-1a07ddcc6a4b None None] Port 3023afb1-be90-4a32-980f-5f0fb88dc7be cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:53:08.235471 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-d263a57f-0aa5-4372-b78c-02acc7a91b22 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.3199208 Nov 02 12:53:08.253885 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-289f51b8-50e0-4c01-8962-90d857243209 service neutron] Request body: {'port': {'device_id': '23093020-2f8f-4aae-9657-27e0ea5d79b5', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81632'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:53:08.280668 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-459b4666-80bf-4fa0-baf0-7b2162d318ce req-5d9349ea-5fc8-462f-9d47-f520acce9236 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.3346779 Nov 02 12:53:08.347877 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-289f51b8-50e0-4c01-8962-90d857243209 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:08.359191 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-60045369-36de-4a40-8b8a-c332c4735722 req-52400c83-5d67-4531-963a-96b29a832dfc tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:08.360667 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-60045369-36de-4a40-8b8a-c332c4735722 req-52400c83-5d67-4531-963a-96b29a832dfc tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 946 time: 0.1028841 Nov 02 12:53:08.366757 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 4f01baba-1c26-4499-8ddb-2a95a7508f49 up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:53:08.498554 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-60045369-36de-4a40-8b8a-c332c4735722 req-e690de54-e6aa-44a0-a60c-cbbc56690e31 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1284039 Nov 02 12:53:08.576292 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20bf4ea7-267b-41c6-9e41-fa85d0ab4567 req-5834f56a-0069-4ec9-98ed-ff17d8ac9b78 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:08.577982 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-20bf4ea7-267b-41c6-9e41-fa85d0ab4567 req-5834f56a-0069-4ec9-98ed-ff17d8ac9b78 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 931 time: 0.1637149 Nov 02 12:53:08.674060 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning for port 4f01baba-1c26-4499-8ddb-2a95a7508f49 completed by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 02 12:53:08.678250 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port 4f01baba-1c26-4499-8ddb-2a95a7508f49 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:53:08.678704 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:08.687139 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-20bf4ea7-267b-41c6-9e41-fa85d0ab4567 req-1ccaa9dc-650d-439f-90e6-996d066af3cd tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1030107 Nov 02 12:53:08.780328 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:08.782138 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-289f51b8-50e0-4c01-8962-90d857243209 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 3023afb1-be90-4a32-980f-5f0fb88dc7be {{(pid=108543) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:53:08.790484 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-289f51b8-50e0-4c01-8962-90d857243209 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:08.803768 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.provisioning_blocks [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-289f51b8-50e0-4c01-8962-90d857243209 service neutron] Transition to ACTIVE for port object 3023afb1-be90-4a32-980f-5f0fb88dc7be will not be triggered until provisioned by entity L2. {{(pid=108543) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 02 12:53:08.806122 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a22a0824-cc65-473d-87a8-d29d93f08b8c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4f01baba-1c26-4499-8ddb-2a95a7508f49'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:53:08.808976 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fd5d7ef9-9900-48e1-993e-b8f6ca8394ea" -d '{"events": [{"server_uuid": "a22a0824-cc65-473d-87a8-d29d93f08b8c", "name": "network-vif-plugged", "status": "completed", "tag": "4f01baba-1c26-4499-8ddb-2a95a7508f49"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:53:08.823102 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 4f01baba-1c26-4499-8ddb-2a95a7508f49, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=4f01baba-1c26-4499-8ddb-2a95a7508f49,segment=NetworkSegment(e912b2b1-808c-4d37-a99d-fcfdb9d2a5db),segment_id=e912b2b1-808c-4d37-a99d-fcfdb9d2a5db)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:53:08.845347 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:53:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-00b9a8af-825a-4bcb-aa31-eecd21506f71 x-openstack-request-id: req-00b9a8af-825a-4bcb-aa31-eecd21506f71 {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:53:08.845667 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a22a0824-cc65-473d-87a8-d29d93f08b8c", "name": "network-vif-plugged", "status": "completed", "tag": "4f01baba-1c26-4499-8ddb-2a95a7508f49", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:53:08.846001 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-00b9a8af-825a-4bcb-aa31-eecd21506f71 {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:53:08.849753 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a22a0824-cc65-473d-87a8-d29d93f08b8c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '4f01baba-1c26-4499-8ddb-2a95a7508f49', 'code': 200} Nov 02 12:53:08.915899 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-289f51b8-50e0-4c01-8962-90d857243209 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:08.916881 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:08.994069 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-289f51b8-50e0-4c01-8962-90d857243209 service neutron] Pushing event updated for resources: {'Port': ['ID=3023afb1-be90-4a32-980f-5f0fb88dc7be,revision_number=2']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:53:09.011938 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=4f01baba-1c26-4499-8ddb-2a95a7508f49,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:53:09.072094 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-289f51b8-50e0-4c01-8962-90d857243209 service neutron] Attempting to bind port 3023afb1-be90-4a32-980f-5f0fb88dc7be on host hv-cinder-81632 for vnic_type normal with profile {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:53:09.079090 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-289f51b8-50e0-4c01-8962-90d857243209 service neutron] Attempting to bind port 3023afb1-be90-4a32-980f-5f0fb88dc7be by drivers openvswitch,hyperv on host hv-cinder-81632 at level 0 using segments [{'id': 'c8ecb7dc-9cc8-47a7-94e7-62f066a97c10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1'}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:53:09.079090 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-289f51b8-50e0-4c01-8962-90d857243209 service neutron] Attempting to bind port 3023afb1-be90-4a32-980f-5f0fb88dc7be on network 89f406ae-1b9f-4be7-8881-87075d7c5aa1 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:53:09.079869 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-289f51b8-50e0-4c01-8962-90d857243209 service neutron] Port 3023afb1-be90-4a32-980f-5f0fb88dc7be on network 89f406ae-1b9f-4be7-8881-87075d7c5aa1 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81632 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 02 12:53:09.080354 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-289f51b8-50e0-4c01-8962-90d857243209 service neutron] Attempting to bind port 3023afb1-be90-4a32-980f-5f0fb88dc7be on network 89f406ae-1b9f-4be7-8881-87075d7c5aa1 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:53:09.087072 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-289f51b8-50e0-4c01-8962-90d857243209 service neutron] Checking agent: {'id': '0d57fa42-4660-4f08-b7dc-53a872c3c01c', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81632', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'started_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 53, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:53:09.087783 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-289f51b8-50e0-4c01-8962-90d857243209 service neutron] Checking segment: {'id': 'c8ecb7dc-9cc8-47a7-94e7-62f066a97c10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108543) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:53:09.088478 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-289f51b8-50e0-4c01-8962-90d857243209 service neutron] Bound using segment: {'id': 'c8ecb7dc-9cc8-47a7-94e7-62f066a97c10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1'} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:53:09.090222 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-289f51b8-50e0-4c01-8962-90d857243209 service neutron] Bound port: 3023afb1-be90-4a32-980f-5f0fb88dc7be, host: hv-cinder-81632, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c8ecb7dc-9cc8-47a7-94e7-62f066a97c10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1'}}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:53:09.090815 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-289f51b8-50e0-4c01-8962-90d857243209 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:09.175229 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-289f51b8-50e0-4c01-8962-90d857243209 service neutron] For port 3023afb1-be90-4a32-980f-5f0fb88dc7be, host hv-cinder-81632, cleared binding levels {{(pid=108543) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:53:09.178763 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-289f51b8-50e0-4c01-8962-90d857243209 service neutron] For port 3023afb1-be90-4a32-980f-5f0fb88dc7be, host hv-cinder-81632, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=3023afb1-be90-4a32-980f-5f0fb88dc7be,segment=NetworkSegment(c8ecb7dc-9cc8-47a7-94e7-62f066a97c10),segment_id=c8ecb7dc-9cc8-47a7-94e7-62f066a97c10)] {{(pid=108543) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:53:09.300397 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-786cfad8-fa1b-41e8-b759-63a27fa6c8f5 req-58f4a3cc-aad1-41fc-bb2f-5b0255bbf8ed service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:09.301748 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-786cfad8-fa1b-41e8-b759-63a27fa6c8f5 req-58f4a3cc-aad1-41fc-bb2f-5b0255bbf8ed service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=a22a0824-cc65-473d-87a8-d29d93f08b8c HTTP/1.1" status: 200 len: 1098 time: 0.0503917 Nov 02 12:53:09.321368 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-289f51b8-50e0-4c01-8962-90d857243209 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:09.380822 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-289f51b8-50e0-4c01-8962-90d857243209 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:09.381475 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-289f51b8-50e0-4c01-8962-90d857243209 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:09.383291 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-289f51b8-50e0-4c01-8962-90d857243209 service neutron] 10.222.0.90 "PUT /v2.0/ports/3023afb1-be90-4a32-980f-5f0fb88dc7be HTTP/1.1" status: 200 len: 1093 time: 1.1334388 Nov 02 12:53:09.388707 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '23093020-2f8f-4aae-9657-27e0ea5d79b5', 'tag': '3023afb1-be90-4a32-980f-5f0fb88dc7be'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:53:09.388926 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-786cfad8-fa1b-41e8-b759-63a27fa6c8f5 req-d548407a-8946-4182-a044-91c09027fd8f service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0734680 Nov 02 12:53:09.389028 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3098f932-8e47-4ba8-97e9-97ac5c487927" -d '{"events": [{"name": "network-changed", "server_uuid": "23093020-2f8f-4aae-9657-27e0ea5d79b5", "tag": "3023afb1-be90-4a32-980f-5f0fb88dc7be"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:53:09.433877 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:53:09 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6719507b-967b-44b7-8c52-04ac3629f802 x-openstack-request-id: req-6719507b-967b-44b7-8c52-04ac3629f802 {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:53:09.434168 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "23093020-2f8f-4aae-9657-27e0ea5d79b5", "tag": "3023afb1-be90-4a32-980f-5f0fb88dc7be", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:53:09.434546 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-6719507b-967b-44b7-8c52-04ac3629f802 {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:53:09.434951 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '23093020-2f8f-4aae-9657-27e0ea5d79b5', 'tag': '3023afb1-be90-4a32-980f-5f0fb88dc7be', 'status': 'completed', 'code': 200} Nov 02 12:53:09.459253 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-289f51b8-50e0-4c01-8962-90d857243209 service neutron] Pushing event updated for resources: {'Port': ['ID=3023afb1-be90-4a32-980f-5f0fb88dc7be,revision_number=3']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:53:09.474913 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-83338b08-99eb-4a58-9dde-6c832a03a463 req-1393074b-b84f-4705-8644-8643fdaba535 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:09.476632 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-83338b08-99eb-4a58-9dde-6c832a03a463 req-1393074b-b84f-4705-8644-8643fdaba535 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=a22a0824-cc65-473d-87a8-d29d93f08b8c HTTP/1.1" status: 200 len: 945 time: 0.1189477 Nov 02 12:53:09.547254 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-83338b08-99eb-4a58-9dde-6c832a03a463 req-28d57974-68e6-4566-9444-82cdcf738211 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0633445 Nov 02 12:53:09.651140 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18172898-5945-408a-9e2e-3f1a6f6e6105 req-0f413e80-6b51-4907-a7c0-005f7174b25a tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:09.653375 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-18172898-5945-408a-9e2e-3f1a6f6e6105 req-0f413e80-6b51-4907-a7c0-005f7174b25a tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 946 time: 0.0579462 Nov 02 12:53:09.691972 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-f2206489-5c0a-420b-bacd-821721406f1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:09.693508 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-f2206489-5c0a-420b-bacd-821721406f1f service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=697de566c0334435b902950f6f31da45&device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 1096 time: 0.0491734 Nov 02 12:53:09.711375 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-18172898-5945-408a-9e2e-3f1a6f6e6105 req-2d7c3af5-7f2f-458e-8e27-3136bd2dcc38 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0495536 Nov 02 12:53:09.753181 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-ccb0896f-6aa8-4810-ad6f-c18d2363906a service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=3023afb1-be90-4a32-980f-5f0fb88dc7be HTTP/1.1" status: 200 len: 217 time: 0.0463076 Nov 02 12:53:09.805329 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-4bdcdfab-b6d6-4968-a34e-23e614ccf215 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:09.806877 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-4bdcdfab-b6d6-4968-a34e-23e614ccf215 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=ae24c2fe-abba-48cd-9d91-28a628d2ef95 HTTP/1.1" status: 200 len: 851 time: 0.0456915 Nov 02 12:53:09.810216 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-882afd63-8c01-4c93-83ea-e9783c97b23b req-a854fa54-e701-4fa5-a565-6be433a9fc13 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:09.811759 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-882afd63-8c01-4c93-83ea-e9783c97b23b req-a854fa54-e701-4fa5-a565-6be433a9fc13 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 943 time: 0.0514209 Nov 02 12:53:09.859269 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-7f0f8bbe-176d-4312-a011-98a2ed71fc37 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:09.860857 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-7f0f8bbe-176d-4312-a011-98a2ed71fc37 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=89f406ae-1b9f-4be7-8881-87075d7c5aa1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0434358 Nov 02 12:53:09.866750 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-882afd63-8c01-4c93-83ea-e9783c97b23b req-671793fc-b3e2-4b98-be9f-3533aa55e7b3 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0484390 Nov 02 12:53:09.980737 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-e3b60979-8208-4a55-91d0-e00fd07f983a service neutron] 10.222.0.90 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1010671 Nov 02 12:53:10.081942 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-883024f1-c52d-4a99-b57e-2e863c10e42e req-0f814052-2e1f-4cbd-beb1-56fb1192517c service neutron] 10.222.0.90 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0912077 Nov 02 12:53:10.274025 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3098f932-8e47-4ba8-97e9-97ac5c487927 req-efb3acbf-00fd-4dff-92ff-8d2329605026 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:10.275554 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-3098f932-8e47-4ba8-97e9-97ac5c487927 req-efb3acbf-00fd-4dff-92ff-8d2329605026 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=697de566c0334435b902950f6f31da45&device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 1096 time: 0.0423627 Nov 02 12:53:10.383234 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3098f932-8e47-4ba8-97e9-97ac5c487927 req-a0e38f1c-a3eb-403a-a071-78a731ff2f8b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:10.384630 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-3098f932-8e47-4ba8-97e9-97ac5c487927 req-a0e38f1c-a3eb-403a-a071-78a731ff2f8b service neutron] 10.222.0.90 "GET /v2.0/networks?id=89f406ae-1b9f-4be7-8881-87075d7c5aa1 HTTP/1.1" status: 200 len: 913 time: 0.0910132 Nov 02 12:53:10.441220 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-3098f932-8e47-4ba8-97e9-97ac5c487927 req-3ea79bcb-d97f-41a2-a63e-6b81fbec646f service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=3023afb1-be90-4a32-980f-5f0fb88dc7be HTTP/1.1" status: 200 len: 217 time: 0.0423107 Nov 02 12:53:10.505734 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3098f932-8e47-4ba8-97e9-97ac5c487927 req-91162c1d-4a7a-4363-a342-99300e968800 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:10.507286 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-3098f932-8e47-4ba8-97e9-97ac5c487927 req-91162c1d-4a7a-4363-a342-99300e968800 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=ae24c2fe-abba-48cd-9d91-28a628d2ef95 HTTP/1.1" status: 200 len: 851 time: 0.0521357 Nov 02 12:53:10.560277 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3098f932-8e47-4ba8-97e9-97ac5c487927 req-a55abebc-8e9e-42ef-a573-9446e5bee4b7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:10.562010 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-3098f932-8e47-4ba8-97e9-97ac5c487927 req-a55abebc-8e9e-42ef-a573-9446e5bee4b7 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=89f406ae-1b9f-4be7-8881-87075d7c5aa1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0456202 Nov 02 12:53:10.686759 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b83563b-18aa-4ec6-9cf1-78f15169f72f req-33e393fb-b45d-46e8-b2c2-fe304bc30312 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:10.689011 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4b83563b-18aa-4ec6-9cf1-78f15169f72f req-33e393fb-b45d-46e8-b2c2-fe304bc30312 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=a22a0824-cc65-473d-87a8-d29d93f08b8c HTTP/1.1" status: 200 len: 945 time: 0.0688643 Nov 02 12:53:10.703273 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-3098f932-8e47-4ba8-97e9-97ac5c487927 req-1546b2e4-0d12-4431-97e0-5243053daa3d service neutron] 10.222.0.90 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1155849 Nov 02 12:53:10.746157 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4b83563b-18aa-4ec6-9cf1-78f15169f72f req-6ac2eafe-4d53-4028-aed7-b8e36d2e4663 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0507944 Nov 02 12:53:10.810600 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-3098f932-8e47-4ba8-97e9-97ac5c487927 req-5ff2cbb3-a6fb-4ebd-9d32-e51d8c0b6260 service neutron] 10.222.0.90 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0989697 Nov 02 12:53:10.849324 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-790259de-8d7e-4f33-8a14-87bdfe86af82 req-21e3ec52-09f5-4601-9bad-de8e88ff6ab2 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:10.851012 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-790259de-8d7e-4f33-8a14-87bdfe86af82 req-21e3ec52-09f5-4601-9bad-de8e88ff6ab2 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 946 time: 0.0556891 Nov 02 12:53:10.902783 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-790259de-8d7e-4f33-8a14-87bdfe86af82 req-61098063-2352-469a-90d3-bc177c7de09e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442278 Nov 02 12:53:10.993702 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3175ff3-7250-4c67-a983-948eb3fd2db8 req-704f5ada-7560-44c6-8da2-120a39cc8039 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:10.996816 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a3175ff3-7250-4c67-a983-948eb3fd2db8 req-704f5ada-7560-44c6-8da2-120a39cc8039 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 943 time: 0.0575767 Nov 02 12:53:11.047877 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a3175ff3-7250-4c67-a983-948eb3fd2db8 req-a5694594-cd0f-4f07-a4a0-e4a50c56eb3e tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0460501 Nov 02 12:53:11.869111 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bf6baef0-52d5-4fa4-b290-947c23de0cb4 req-d63fc138-a398-4455-b91d-8caa27c7b077 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:11.871157 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bf6baef0-52d5-4fa4-b290-947c23de0cb4 req-d63fc138-a398-4455-b91d-8caa27c7b077 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=a22a0824-cc65-473d-87a8-d29d93f08b8c HTTP/1.1" status: 200 len: 945 time: 0.0499835 Nov 02 12:53:11.921745 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bf6baef0-52d5-4fa4-b290-947c23de0cb4 req-83a877c7-b86b-42a9-9592-dc63cbfe9332 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0445759 Nov 02 12:53:12.031218 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cab71966-800e-4818-8d13-3bac458f14f1 req-bb67c3e2-f744-48f3-bc52-f4ca2b00fac7 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:12.033462 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cab71966-800e-4818-8d13-3bac458f14f1 req-bb67c3e2-f744-48f3-bc52-f4ca2b00fac7 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 946 time: 0.0503132 Nov 02 12:53:12.097198 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cab71966-800e-4818-8d13-3bac458f14f1 req-7089eb26-9349-458e-ac64-1284455d3b57 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0575607 Nov 02 12:53:12.174690 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0be89571-4816-41ed-8148-0426f2114479 req-23c7e03a-61ef-4ee8-a296-97aeb2b4c532 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:12.176224 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0be89571-4816-41ed-8148-0426f2114479 req-23c7e03a-61ef-4ee8-a296-97aeb2b4c532 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 943 time: 0.0508006 Nov 02 12:53:12.238485 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0be89571-4816-41ed-8148-0426f2114479 req-3a78a4b0-aad5-40d2-a6e8-58468163d5c9 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0560689 Nov 02 12:53:13.357625 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4860d8ad-398f-4432-907d-02093d5f9bf3 req-17a82cab-a8e1-4a64-9f37-b82af20854d3 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:13.359165 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4860d8ad-398f-4432-907d-02093d5f9bf3 req-17a82cab-a8e1-4a64-9f37-b82af20854d3 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 943 time: 0.0535533 Nov 02 12:53:13.413674 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4860d8ad-398f-4432-907d-02093d5f9bf3 req-8af8432a-ca9a-492a-b36a-41f42c29ae97 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0482128 Nov 02 12:53:14.540398 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c050f1d9-b389-4968-a2a6-9415357b449a req-29c0e910-f091-4a04-be49-f55b39dccea2 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:14.541840 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c050f1d9-b389-4968-a2a6-9415357b449a req-29c0e910-f091-4a04-be49-f55b39dccea2 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 943 time: 0.0540364 Nov 02 12:53:14.591215 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c050f1d9-b389-4968-a2a6-9415357b449a req-5c764fa8-07f3-40fd-9063-e9ccfb6ebb6b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0433874 Nov 02 12:53:15.710526 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6f4c6078-edbc-479c-b01e-7d71d3cf243c req-39753f98-7ba6-4cbe-b0e7-7af603b83fec tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:15.712193 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6f4c6078-edbc-479c-b01e-7d71d3cf243c req-39753f98-7ba6-4cbe-b0e7-7af603b83fec tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 943 time: 0.0534847 Nov 02 12:53:15.772079 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6f4c6078-edbc-479c-b01e-7d71d3cf243c req-716aa1da-edc6-4609-87e1-8afe062a944e tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0528016 Nov 02 12:53:16.893312 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5a3a09a8-58b3-410c-88ea-8d2e9b80e81c req-ea710d9d-d3c9-48f0-9784-221432d1a1cd tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:16.895031 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a3a09a8-58b3-410c-88ea-8d2e9b80e81c req-ea710d9d-d3c9-48f0-9784-221432d1a1cd tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 943 time: 0.0533345 Nov 02 12:53:16.955671 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5a3a09a8-58b3-410c-88ea-8d2e9b80e81c req-da5d1ff2-216a-4434-8ed3-d5fe991ec581 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0545187 Nov 02 12:53:18.103045 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a68f0326-64b1-49f1-a100-5914485f4191 req-8574d311-998f-4e41-974e-6df6fa19a9d8 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:18.106697 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a68f0326-64b1-49f1-a100-5914485f4191 req-8574d311-998f-4e41-974e-6df6fa19a9d8 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 943 time: 0.0567164 Nov 02 12:53:18.165501 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a68f0326-64b1-49f1-a100-5914485f4191 req-9a9dd1d4-3c6e-4139-8a17-105dfbe4580c tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0521824 Nov 02 12:53:18.428335 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 3023afb1-be90-4a32-980f-5f0fb88dc7be details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 12:53:18.533459 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 3023afb1-be90-4a32-980f-5f0fb88dc7be, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=3023afb1-be90-4a32-980f-5f0fb88dc7be,segment=NetworkSegment(c8ecb7dc-9cc8-47a7-94e7-62f066a97c10),segment_id=c8ecb7dc-9cc8-47a7-94e7-62f066a97c10)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:53:18.667534 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': '3023afb1-be90-4a32-980f-5f0fb88dc7be', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'port_id': '3023afb1-be90-4a32-980f-5f0fb88dc7be', 'mac_address': 'fa:16:3e:df:8f:38', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 892, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 12:53:18.705330 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:18.718846 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 3023afb1-be90-4a32-980f-5f0fb88dc7be {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:53:18.738197 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 3023afb1-be90-4a32-980f-5f0fb88dc7be, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=3023afb1-be90-4a32-980f-5f0fb88dc7be,segment=NetworkSegment(c8ecb7dc-9cc8-47a7-94e7-62f066a97c10),segment_id=c8ecb7dc-9cc8-47a7-94e7-62f066a97c10)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:53:18.835830 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:18.883835 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=3023afb1-be90-4a32-980f-5f0fb88dc7be,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:53:19.228750 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['3023afb1-be90-4a32-980f-5f0fb88dc7be'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:53:19.286245 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b3d4d679-1bfd-477f-a0a5-007b3e2c683c req-1a40a9a2-c67c-415b-b2a8-ff07da6ff427 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:19.287871 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b3d4d679-1bfd-477f-a0a5-007b3e2c683c req-1a40a9a2-c67c-415b-b2a8-ff07da6ff427 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 944 time: 0.0515947 Nov 02 12:53:19.338553 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b3d4d679-1bfd-477f-a0a5-007b3e2c683c req-1357c256-82a8-4b94-9d64-4c23114c61c4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436425 Nov 02 12:53:20.441863 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 3023afb1-be90-4a32-980f-5f0fb88dc7be up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:53:20.463356 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0ae6590-b5cb-4776-9720-31b245e086a7 req-75a459ad-e599-4146-a9e5-3be10c40ef7c tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:20.464893 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b0ae6590-b5cb-4776-9720-31b245e086a7 req-75a459ad-e599-4146-a9e5-3be10c40ef7c tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 944 time: 0.0556991 Nov 02 12:53:20.517876 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b0ae6590-b5cb-4776-9720-31b245e086a7 req-6f3610b9-fbb6-426a-9728-4a43ffde0588 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0463674 Nov 02 12:53:20.561387 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning for port 3023afb1-be90-4a32-980f-5f0fb88dc7be completed by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 02 12:53:20.565653 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port 3023afb1-be90-4a32-980f-5f0fb88dc7be triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:53:20.566031 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:20.645320 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:20.667804 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '23093020-2f8f-4aae-9657-27e0ea5d79b5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3023afb1-be90-4a32-980f-5f0fb88dc7be'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:53:20.670166 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c2e5962a-230b-429c-93d1-43a9cee33023" -d '{"events": [{"server_uuid": "23093020-2f8f-4aae-9657-27e0ea5d79b5", "name": "network-vif-plugged", "status": "completed", "tag": "3023afb1-be90-4a32-980f-5f0fb88dc7be"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:53:20.684478 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 3023afb1-be90-4a32-980f-5f0fb88dc7be, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=3023afb1-be90-4a32-980f-5f0fb88dc7be,segment=NetworkSegment(c8ecb7dc-9cc8-47a7-94e7-62f066a97c10),segment_id=c8ecb7dc-9cc8-47a7-94e7-62f066a97c10)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:53:20.709843 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:53:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-89626d74-99f6-4d70-b3f0-3a033658355b x-openstack-request-id: req-89626d74-99f6-4d70-b3f0-3a033658355b {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:53:20.710272 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "23093020-2f8f-4aae-9657-27e0ea5d79b5", "name": "network-vif-plugged", "status": "completed", "tag": "3023afb1-be90-4a32-980f-5f0fb88dc7be", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:53:20.710563 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-89626d74-99f6-4d70-b3f0-3a033658355b {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:53:20.710951 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '23093020-2f8f-4aae-9657-27e0ea5d79b5', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '3023afb1-be90-4a32-980f-5f0fb88dc7be', 'code': 200} Nov 02 12:53:20.773130 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:20.824975 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=3023afb1-be90-4a32-980f-5f0fb88dc7be,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:53:21.641953 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a1a5b0f-0a89-4425-a2dd-868db46c1cb6 req-e6c344fc-f5c3-4572-a696-a5a5b36570c0 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:21.643514 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3a1a5b0f-0a89-4425-a2dd-868db46c1cb6 req-e6c344fc-f5c3-4572-a696-a5a5b36570c0 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 945 time: 0.0556819 Nov 02 12:53:21.696539 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3a1a5b0f-0a89-4425-a2dd-868db46c1cb6 req-88ec75f9-2b65-4752-9835-9976c5cb2b04 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0467713 Nov 02 12:53:22.762183 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d39769bb-3144-4f8c-a6ce-fb3b379456d8 req-11a34397-24e1-4840-8b51-a222c8cd4f94 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:22.763745 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-d39769bb-3144-4f8c-a6ce-fb3b379456d8 req-11a34397-24e1-4840-8b51-a222c8cd4f94 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 1098 time: 0.0494983 Nov 02 12:53:22.820579 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-379ccc4c-0b25-4a28-a5d3-7accf1f31de5 req-066cf85e-ffb2-49c9-9cf6-ff93e4527196 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:22.822078 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-379ccc4c-0b25-4a28-a5d3-7accf1f31de5 req-066cf85e-ffb2-49c9-9cf6-ff93e4527196 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 945 time: 0.0538549 Nov 02 12:53:22.873673 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-379ccc4c-0b25-4a28-a5d3-7accf1f31de5 req-4c1bb584-6355-41c8-8b7d-ed2dc726dc76 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444040 Nov 02 12:53:23.508739 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1b18eea8-7b5f-42f0-8287-9fcbf3ffb02a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:23.749204 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-d39769bb-3144-4f8c-a6ce-fb3b379456d8 req-4bc8c066-7c71-4b61-b891-b9d8081f83ba service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0466716 Nov 02 12:53:24.000795 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3da12c32-ccf7-48cd-8189-a6d183f2aff4 req-48f58f10-83d9-4ae9-b511-db6c0b7d2092 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:24.002196 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3da12c32-ccf7-48cd-8189-a6d183f2aff4 req-48f58f10-83d9-4ae9-b511-db6c0b7d2092 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 945 time: 0.0504699 Nov 02 12:53:24.051821 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3da12c32-ccf7-48cd-8189-a6d183f2aff4 req-8a9c42e1-9032-4234-82d7-83ae2a632301 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0436230 Nov 02 12:53:25.169854 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-399d4697-c4c8-4f53-9ff1-4c23b4a70d9d req-a5532bfa-7742-4646-b84a-962880f61730 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:25.171424 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-399d4697-c4c8-4f53-9ff1-4c23b4a70d9d req-a5532bfa-7742-4646-b84a-962880f61730 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 945 time: 0.0503867 Nov 02 12:53:25.226233 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-399d4697-c4c8-4f53-9ff1-4c23b4a70d9d req-4abe6c2a-6d57-42e8-8dbd-2fc04a42e1fd tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0479631 Nov 02 12:53:25.699130 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5f634386-343c-498b-b618-7307c60acd11 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:26.347588 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a14d9921-ea28-4f69-a07f-14ac41d91951 req-d18e8e9b-7fdc-44ec-b999-e8e94f82fdac tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:26.349220 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a14d9921-ea28-4f69-a07f-14ac41d91951 req-d18e8e9b-7fdc-44ec-b999-e8e94f82fdac tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 945 time: 0.0534682 Nov 02 12:53:26.400623 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a14d9921-ea28-4f69-a07f-14ac41d91951 req-64fb4487-46d2-428f-a453-a55078644980 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0443628 Nov 02 12:53:26.549056 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6042472b-8d21-47e2-b8d4-c72c35401c59 req-c1233db3-e6de-43a1-a88b-291b8857e6e4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:26.550893 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6042472b-8d21-47e2-b8d4-c72c35401c59 req-c1233db3-e6de-43a1-a88b-291b8857e6e4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 945 time: 0.0714564 Nov 02 12:53:26.606823 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6042472b-8d21-47e2-b8d4-c72c35401c59 req-88d0f439-996c-4126-8d53-f558c6c7ce2d tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0488968 Nov 02 12:53:26.637420 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 60480) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:53:26.840784 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e32e1f7c-2610-48e5-bb85-fef6ccc8ff11 tempest-TestVolumeBootPattern-1047552789 tempest-TestVolumeBootPattern-1047552789-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:26.842386 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-e32e1f7c-2610-48e5-bb85-fef6ccc8ff11 tempest-TestVolumeBootPattern-1047552789 tempest-TestVolumeBootPattern-1047552789-project-admin] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 1093 time: 0.2027967 Nov 02 12:53:26.845808 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 60484) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:53:26.850567 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Request body: {'floatingip': {'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'port_id': '3023afb1-be90-4a32-980f-5f0fb88dc7be', 'tenant_id': '697de566c0334435b902950f6f31da45', 'fixed_ip_address': '172.20.0.9'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:53:26.887689 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:26.990401 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for floatingip, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:27.089316 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:27.199016 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Allocated IP 172.27.0.129 (43464fa8-eb00-46fb-9ca0-be7342f9ddbf/44a807bc-f2b6-41f0-b765-e5d3393fe305/da6a05e1-fb58-46cf-b287-1333614c13a8) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:53:27.304083 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:27.453128 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:27.498714 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:53:27.504334 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:53:27.509064 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:53:27.515138 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Pushing event updated for resources: {'Port': ['ID=da6a05e1-fb58-46cf-b287-1333614c13a8,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:53:27.544979 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:27.545331 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:27.545663 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:27.546000 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:27.546407 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:27.546686 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:27.547025 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:27.547351 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:27.547671 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:27.547995 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:27.548314 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:27.548630 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:28.005562 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:28.209623 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:28.373854 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for port, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:28.389194 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:28.565798 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:28.638007 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Pushing event updated for resources: {'Port': ['ID=da6a05e1-fb58-46cf-b287-1333614c13a8,revision_number=2']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:53:28.647734 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1594992'] for floatingip, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:28.753020 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.db.l3_db [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Floating IP bff9f016-a411-4056-a280-4f387caba2b4 associated. External IP: 172.27.0.129, port: 3023afb1-be90-4a32-980f-5f0fb88dc7be. Nov 02 12:53:28.969538 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108543) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 12:53:29.078710 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108543) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:53:29.090684 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b3785e7-7cc4-4801-ab42-10c96b09af05 None None] Sync routers for ids ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'] in dv-cinder-816324-1-iscsi {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:53:29.100804 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b3785e7-7cc4-4801-ab42-10c96b09af05 None None] Routers {'2a2f63fd-e512-4ad2-9007-46e6ab6e8134'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:53:29.101426 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-2b3785e7-7cc4-4801-ab42-10c96b09af05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:53:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:53:29.174322 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for floatingip, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:29.203115 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-7a7c60da-4070-4ea0-9a0a-f87b3a58fda4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.3561637 Nov 02 12:53:29.203682 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '23093020-2f8f-4aae-9657-27e0ea5d79b5', 'tag': '3023afb1-be90-4a32-980f-5f0fb88dc7be'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:53:29.205984 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-aeaab7ff-b463-4253-ad51-6d539ec80b31" -d '{"events": [{"name": "network-changed", "server_uuid": "23093020-2f8f-4aae-9657-27e0ea5d79b5", "tag": "3023afb1-be90-4a32-980f-5f0fb88dc7be"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:53:29.216905 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-2b3785e7-7cc4-4801-ab42-10c96b09af05 None None] Set router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:53:29.243993 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:53:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8d24bfc5-bafe-4d99-9f4f-6597a89d4fde x-openstack-request-id: req-8d24bfc5-bafe-4d99-9f4f-6597a89d4fde {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:53:29.255534 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "23093020-2f8f-4aae-9657-27e0ea5d79b5", "tag": "3023afb1-be90-4a32-980f-5f0fb88dc7be", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:53:29.255534 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-8d24bfc5-bafe-4d99-9f4f-6597a89d4fde {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:53:29.255534 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '23093020-2f8f-4aae-9657-27e0ea5d79b5', 'tag': '3023afb1-be90-4a32-980f-5f0fb88dc7be', 'status': 'completed', 'code': 200} Nov 02 12:53:29.328253 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeaab7ff-b463-4253-ad51-6d539ec80b31 req-2793bdfe-ba0c-41ca-8ce0-03209ea5ad44 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:29.331377 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-aeaab7ff-b463-4253-ad51-6d539ec80b31 req-2793bdfe-ba0c-41ca-8ce0-03209ea5ad44 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=697de566c0334435b902950f6f31da45&device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 1098 time: 0.0464191 Nov 02 12:53:29.441861 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeaab7ff-b463-4253-ad51-6d539ec80b31 req-5c24f82d-8c88-4505-981a-4d0775a55ac7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:29.443386 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-aeaab7ff-b463-4253-ad51-6d539ec80b31 req-5c24f82d-8c88-4505-981a-4d0775a55ac7 service neutron] 10.222.0.90 "GET /v2.0/networks?id=89f406ae-1b9f-4be7-8881-87075d7c5aa1 HTTP/1.1" status: 200 len: 913 time: 0.0989017 Nov 02 12:53:29.471184 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-2b3785e7-7cc4-4801-ab42-10c96b09af05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port': {'id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:1f:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:31Z', 'updated_at': '2021-11-02T12:51:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': 'bff9f016-a411-4056-a280-4f387caba2b4', 'tenant_id': '697de566c0334435b902950f6f31da45', 'floating_ip_address': '172.27.0.129', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'port_id': '3023afb1-be90-4a32-980f-5f0fb88dc7be', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 474, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'mac_address': 'fa:16:3e:df:8f:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '23093020-2f8f-4aae-9657-27e0ea5d79b5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:53:27Z', 'updated_at': '2021-11-02T12:53:27Z', 'revision_number': 0, 'project_id': '697de566c0334435b902950f6f31da45', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '80a55893-6272-4299-8834-e840aa37d37b', 'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'tenant_id': '697de566c0334435b902950f6f31da45', 'mac_address': 'fa:16:3e:64:ef:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_interface', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:48Z', 'updated_at': '2021-11-02T12:52:07Z', 'revision_number': 5, 'project_id': '697de566c0334435b902950f6f31da45', 'subnets': [{'id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:53:29.517778 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b3785e7-7cc4-4801-ab42-10c96b09af05 None None] Checking router: 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 for host: dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:53:29.528929 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2b3785e7-7cc4-4801-ab42-10c96b09af05 None None] Routers {'2a2f63fd-e512-4ad2-9007-46e6ab6e8134'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:53:29.529875 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-2b3785e7-7cc4-4801-ab42-10c96b09af05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:53:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:53:29.541228 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-aeaab7ff-b463-4253-ad51-6d539ec80b31 req-4999895c-e608-45e9-ac93-c32e4117603f service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=3023afb1-be90-4a32-980f-5f0fb88dc7be HTTP/1.1" status: 200 len: 999 time: 0.0837617 Nov 02 12:53:29.601430 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeaab7ff-b463-4253-ad51-6d539ec80b31 req-667df7a4-c068-429b-b95d-df70fff5094d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:29.602921 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-aeaab7ff-b463-4253-ad51-6d539ec80b31 req-667df7a4-c068-429b-b95d-df70fff5094d service neutron] 10.222.0.90 "GET /v2.0/subnets?id=ae24c2fe-abba-48cd-9d91-28a628d2ef95 HTTP/1.1" status: 200 len: 851 time: 0.0479250 Nov 02 12:53:29.645131 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-2b3785e7-7cc4-4801-ab42-10c96b09af05 None None] Set router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:53:29.657066 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aeaab7ff-b463-4253-ad51-6d539ec80b31 req-d7d77adb-72f0-4103-a686-2a0795b85f7a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:29.659104 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-aeaab7ff-b463-4253-ad51-6d539ec80b31 req-d7d77adb-72f0-4103-a686-2a0795b85f7a service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=89f406ae-1b9f-4be7-8881-87075d7c5aa1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0468564 Nov 02 12:53:29.757103 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-aeaab7ff-b463-4253-ad51-6d539ec80b31 req-b86f90f6-e33a-4090-8302-44362936a910 service neutron] 10.222.0.90 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0905676 Nov 02 12:53:29.864461 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-aeaab7ff-b463-4253-ad51-6d539ec80b31 req-3a0469d6-cc60-487d-8e52-1015c7bd62a1 service neutron] 10.222.0.90 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0992353 Nov 02 12:53:29.905480 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-2b3785e7-7cc4-4801-ab42-10c96b09af05 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port': {'id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:1f:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:31Z', 'updated_at': '2021-11-02T12:51:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': 'bff9f016-a411-4056-a280-4f387caba2b4', 'tenant_id': '697de566c0334435b902950f6f31da45', 'floating_ip_address': '172.27.0.129', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'port_id': '3023afb1-be90-4a32-980f-5f0fb88dc7be', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 474, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'mac_address': 'fa:16:3e:df:8f:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '23093020-2f8f-4aae-9657-27e0ea5d79b5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:53:27Z', 'updated_at': '2021-11-02T12:53:27Z', 'revision_number': 0, 'project_id': '697de566c0334435b902950f6f31da45', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '80a55893-6272-4299-8834-e840aa37d37b', 'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'tenant_id': '697de566c0334435b902950f6f31da45', 'mac_address': 'fa:16:3e:64:ef:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_interface', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:48Z', 'updated_at': '2021-11-02T12:52:07Z', 'revision_number': 5, 'project_id': '697de566c0334435b902950f6f31da45', 'subnets': [{'id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:53:29.933511 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2b3785e7-7cc4-4801-ab42-10c96b09af05 None None] The sync data for ids ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'] in dv-cinder-816324-1-iscsi is: [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port': {'id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:1f:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:31Z', 'updated_at': '2021-11-02T12:51:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': 'bff9f016-a411-4056-a280-4f387caba2b4', 'tenant_id': '697de566c0334435b902950f6f31da45', 'floating_ip_address': '172.27.0.129', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'port_id': '3023afb1-be90-4a32-980f-5f0fb88dc7be', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 474, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'mac_address': 'fa:16:3e:df:8f:38', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '23093020-2f8f-4aae-9657-27e0ea5d79b5', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:53:27Z', 'updated_at': '2021-11-02T12:53:27Z', 'revision_number': 0, 'project_id': '697de566c0334435b902950f6f31da45', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '80a55893-6272-4299-8834-e840aa37d37b', 'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'tenant_id': '697de566c0334435b902950f6f31da45', 'mac_address': 'fa:16:3e:64:ef:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_interface', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:48Z', 'updated_at': '2021-11-02T12:52:07Z', 'revision_number': 5, 'project_id': '697de566c0334435b902950f6f31da45', 'subnets': [{'id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:53:30.117247 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-00c45cf7-d875-4610-8e40-7a9bacfee63c None None] New status for floating IP bff9f016-a411-4056-a280-4f387caba2b4: ACTIVE {{(pid=108545) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 02 12:53:30.863991 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:32.468920 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-976177d2-56a1-4bba-b782-ef8dee7d51de req-2b0cf3ab-9594-44cc-aa52-c7f98b20f98c tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:32.470404 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-976177d2-56a1-4bba-b782-ef8dee7d51de req-2b0cf3ab-9594-44cc-aa52-c7f98b20f98c tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=a22a0824-cc65-473d-87a8-d29d93f08b8c HTTP/1.1" status: 200 len: 945 time: 0.0540812 Nov 02 12:53:32.524296 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-976177d2-56a1-4bba-b782-ef8dee7d51de req-e7e7126f-32fe-4904-ad06-7be6d37b5f97 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0463057 Nov 02 12:53:33.395366 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:33.652050 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2f008a9-34a2-430d-ace2-cde443d47457 req-315260f7-ddc3-4567-aacf-a2e45e11964c tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:33.653602 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e2f008a9-34a2-430d-ace2-cde443d47457 req-315260f7-ddc3-4567-aacf-a2e45e11964c tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=a22a0824-cc65-473d-87a8-d29d93f08b8c HTTP/1.1" status: 200 len: 945 time: 0.0559709 Nov 02 12:53:33.705785 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e2f008a9-34a2-430d-ace2-cde443d47457 req-2f2d0174-dc8c-4a5d-84a6-bf74231c5e96 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0439901 Nov 02 12:53:34.428757 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22f5bbfa-210a-4639-997c-8cf40d997a3f req-8a3c1e76-945e-4b6c-b4fa-c9460d2f29af tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:34.430232 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-22f5bbfa-210a-4639-997c-8cf40d997a3f req-8a3c1e76-945e-4b6c-b4fa-c9460d2f29af tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.90 "GET /v2.0/ports?device_id=a22a0824-cc65-473d-87a8-d29d93f08b8c HTTP/1.1" status: 200 len: 945 time: 0.0502274 Nov 02 12:53:34.543361 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [req-22f5bbfa-210a-4639-997c-8cf40d997a3f req-edacfd7a-ab82-4ca0-b60f-cdf8f5fb8feb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Deleting port 4f01baba-1c26-4499-8ddb-2a95a7508f49 {{(pid=108542) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:53:34.543691 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-22f5bbfa-210a-4639-997c-8cf40d997a3f req-edacfd7a-ab82-4ca0-b60f-cdf8f5fb8feb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:34.663802 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [req-22f5bbfa-210a-4639-997c-8cf40d997a3f req-edacfd7a-ab82-4ca0-b60f-cdf8f5fb8feb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] For port 4f01baba-1c26-4499-8ddb-2a95a7508f49, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=4f01baba-1c26-4499-8ddb-2a95a7508f49,segment=NetworkSegment(e912b2b1-808c-4d37-a99d-fcfdb9d2a5db),segment_id=e912b2b1-808c-4d37-a99d-fcfdb9d2a5db)] {{(pid=108542) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:53:34.664164 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-22f5bbfa-210a-4639-997c-8cf40d997a3f req-edacfd7a-ab82-4ca0-b60f-cdf8f5fb8feb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:34.678624 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [req-22f5bbfa-210a-4639-997c-8cf40d997a3f req-edacfd7a-ab82-4ca0-b60f-cdf8f5fb8feb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Calling delete_port for 4f01baba-1c26-4499-8ddb-2a95a7508f49 owned by compute:nova {{(pid=108542) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:53:34.833449 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1884a11-b482-4ef6-84ca-b2ff038d6ea8 req-fee9ee59-8540-4728-b435-b796ebd03a9f tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:34.835070 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a1884a11-b482-4ef6-84ca-b2ff038d6ea8 req-fee9ee59-8540-4728-b435-b796ebd03a9f tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=a22a0824-cc65-473d-87a8-d29d93f08b8c HTTP/1.1" status: 200 len: 945 time: 0.0514882 Nov 02 12:53:34.891482 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a1884a11-b482-4ef6-84ca-b2ff038d6ea8 req-4abd2a3e-efef-4a1a-86ae-4fef0ab0f41e tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504189 Nov 02 12:53:34.967352 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-22f5bbfa-210a-4639-997c-8cf40d997a3f req-edacfd7a-ab82-4ca0-b60f-cdf8f5fb8feb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:34.984635 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['4c597805-3835-4f59-b320-5614de6b4ec6', '4767bbe8-ea52-4258-9417-d866fb33fb53', 'f173e8db-9c28-4415-be12-b2f898eb931e', '4f01baba-1c26-4499-8ddb-2a95a7508f49'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:53:35.006416 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edacfd7a-ab82-4ca0-b60f-cdf8f5fb8feb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Pushing event deleted for resources: {'Port': ['ID=4f01baba-1c26-4499-8ddb-2a95a7508f49,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:53:35.034478 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edacfd7a-ab82-4ca0-b60f-cdf8f5fb8feb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:35.035523 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edacfd7a-ab82-4ca0-b60f-cdf8f5fb8feb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:35.035523 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edacfd7a-ab82-4ca0-b60f-cdf8f5fb8feb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:35.035523 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edacfd7a-ab82-4ca0-b60f-cdf8f5fb8feb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:35.035814 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edacfd7a-ab82-4ca0-b60f-cdf8f5fb8feb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:35.036892 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edacfd7a-ab82-4ca0-b60f-cdf8f5fb8feb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:35.036892 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edacfd7a-ab82-4ca0-b60f-cdf8f5fb8feb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:35.036892 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edacfd7a-ab82-4ca0-b60f-cdf8f5fb8feb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:35.037197 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edacfd7a-ab82-4ca0-b60f-cdf8f5fb8feb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:35.037377 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edacfd7a-ab82-4ca0-b60f-cdf8f5fb8feb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:35.037694 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edacfd7a-ab82-4ca0-b60f-cdf8f5fb8feb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:35.040523 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-edacfd7a-ab82-4ca0-b60f-cdf8f5fb8feb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:53:35.059462 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [req-22f5bbfa-210a-4639-997c-8cf40d997a3f req-edacfd7a-ab82-4ca0-b60f-cdf8f5fb8feb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] No DVR routers for this DVR port 4f01baba-1c26-4499-8ddb-2a95a7508f49 on host hv-cinder-81632 {{(pid=108542) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 12:53:35.062066 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-22f5bbfa-210a-4639-997c-8cf40d997a3f req-edacfd7a-ab82-4ca0-b60f-cdf8f5fb8feb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:35.065902 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-22f5bbfa-210a-4639-997c-8cf40d997a3f req-edacfd7a-ab82-4ca0-b60f-cdf8f5fb8feb tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.90 "DELETE /v2.0/ports/4f01baba-1c26-4499-8ddb-2a95a7508f49 HTTP/1.1" status: 204 len: 173 time: 0.6288590 Nov 02 12:53:35.066411 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a22a0824-cc65-473d-87a8-d29d93f08b8c', 'name': 'network-vif-deleted', 'tag': '4f01baba-1c26-4499-8ddb-2a95a7508f49'}] {{(pid=108542) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:53:35.068797 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8fdc2194739644bb754d6b187539f80d2eba7dc5c5d5392f1a2d22d03c0a316c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b9b71279-dbf6-4a6d-98ac-5a2f666505f0" -d '{"events": [{"server_uuid": "a22a0824-cc65-473d-87a8-d29d93f08b8c", "name": "network-vif-deleted", "tag": "4f01baba-1c26-4499-8ddb-2a95a7508f49"}]}' {{(pid=108542) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:53:35.108759 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:53:35 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ca2e26b4-cba6-4204-9618-5248114d3e26 x-openstack-request-id: req-ca2e26b4-cba6-4204-9618-5248114d3e26 {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:53:35.108955 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a22a0824-cc65-473d-87a8-d29d93f08b8c", "name": "network-vif-deleted", "tag": "4f01baba-1c26-4499-8ddb-2a95a7508f49", "status": "completed", "code": 200}]} {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:53:35.109116 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-ca2e26b4-cba6-4204-9618-5248114d3e26 {{(pid=108542) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:53:35.109511 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a22a0824-cc65-473d-87a8-d29d93f08b8c', 'name': 'network-vif-deleted', 'tag': '4f01baba-1c26-4499-8ddb-2a95a7508f49', 'status': 'completed', 'code': 200} Nov 02 12:53:36.001455 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8a5eae99-0353-4e27-b512-9ae7e27a74cd req-5a4b5059-aeb1-48d5-8836-140ce734874d tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=a22a0824-cc65-473d-87a8-d29d93f08b8c HTTP/1.1" status: 200 len: 210 time: 0.0291307 Nov 02 12:53:38.524312 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 4f01baba-1c26-4499-8ddb-2a95a7508f49 no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:53:38.546339 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] No Port match for: 4f01baba-1c26-4499-8ddb-2a95a7508f49 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:53:38.546701 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 4f01baba-1c26-4499-8ddb-2a95a7508f49 not bound to the agent host hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:53:38.932172 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd1444c0-6f4c-4039-bcc7-388b21bf1fc5 req-026a1f4a-8454-4ec7-9dc8-edc20ab24588 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:38.933815 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bd1444c0-6f4c-4039-bcc7-388b21bf1fc5 req-026a1f4a-8454-4ec7-9dc8-edc20ab24588 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=c09c5da0-2ee0-40c1-b5fb-f06550d58ee4 HTTP/1.1" status: 200 len: 946 time: 0.0512199 Nov 02 12:53:38.983659 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bd1444c0-6f4c-4039-bcc7-388b21bf1fc5 req-acfaa152-b7ba-410a-9615-c11b7bc83787 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0437436 Nov 02 12:53:40.111468 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6190ffe2-9e51-47c1-a8ed-ff97b417e61a req-c9dc6459-5e44-4b98-b6d2-c7693dfd5569 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:40.113197 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6190ffe2-9e51-47c1-a8ed-ff97b417e61a req-c9dc6459-5e44-4b98-b6d2-c7693dfd5569 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=c09c5da0-2ee0-40c1-b5fb-f06550d58ee4 HTTP/1.1" status: 200 len: 946 time: 0.0538394 Nov 02 12:53:40.169065 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6190ffe2-9e51-47c1-a8ed-ff97b417e61a req-02e4a99a-6423-49c8-82ae-2aa24d4c5d7b tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493872 Nov 02 12:53:40.712875 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df3b49d2-88b9-41dd-98b2-f31ef90508d8 req-7d2a50a5-c547-4be6-bcd9-4184a303c3a8 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:40.714584 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-df3b49d2-88b9-41dd-98b2-f31ef90508d8 req-7d2a50a5-c547-4be6-bcd9-4184a303c3a8 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.90 "GET /v2.0/ports?device_id=c09c5da0-2ee0-40c1-b5fb-f06550d58ee4 HTTP/1.1" status: 200 len: 946 time: 0.0514488 Nov 02 12:53:40.821354 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [req-df3b49d2-88b9-41dd-98b2-f31ef90508d8 req-47f25d15-0531-49d6-8d47-8dc7df84afbe tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Deleting port f173e8db-9c28-4415-be12-b2f898eb931e {{(pid=108542) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:53:40.821688 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-df3b49d2-88b9-41dd-98b2-f31ef90508d8 req-47f25d15-0531-49d6-8d47-8dc7df84afbe tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:40.928047 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [req-df3b49d2-88b9-41dd-98b2-f31ef90508d8 req-47f25d15-0531-49d6-8d47-8dc7df84afbe tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] For port f173e8db-9c28-4415-be12-b2f898eb931e, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=f173e8db-9c28-4415-be12-b2f898eb931e,segment=NetworkSegment(e912b2b1-808c-4d37-a99d-fcfdb9d2a5db),segment_id=e912b2b1-808c-4d37-a99d-fcfdb9d2a5db)] {{(pid=108542) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:53:40.928406 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-df3b49d2-88b9-41dd-98b2-f31ef90508d8 req-47f25d15-0531-49d6-8d47-8dc7df84afbe tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:40.944232 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [req-df3b49d2-88b9-41dd-98b2-f31ef90508d8 req-47f25d15-0531-49d6-8d47-8dc7df84afbe tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Calling delete_port for f173e8db-9c28-4415-be12-b2f898eb931e owned by compute:nova {{(pid=108542) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:53:41.155659 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-df3b49d2-88b9-41dd-98b2-f31ef90508d8 req-47f25d15-0531-49d6-8d47-8dc7df84afbe tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:41.168992 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['4c597805-3835-4f59-b320-5614de6b4ec6', '4767bbe8-ea52-4258-9417-d866fb33fb53', 'f173e8db-9c28-4415-be12-b2f898eb931e'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:53:41.193597 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47f25d15-0531-49d6-8d47-8dc7df84afbe tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Pushing event deleted for resources: {'Port': ['ID=f173e8db-9c28-4415-be12-b2f898eb931e,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:53:41.236096 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [req-df3b49d2-88b9-41dd-98b2-f31ef90508d8 req-47f25d15-0531-49d6-8d47-8dc7df84afbe tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] No DVR routers for this DVR port f173e8db-9c28-4415-be12-b2f898eb931e on host hv-cinder-81632 {{(pid=108542) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 12:53:41.243389 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-df3b49d2-88b9-41dd-98b2-f31ef90508d8 req-47f25d15-0531-49d6-8d47-8dc7df84afbe tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:41.243389 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-df3b49d2-88b9-41dd-98b2-f31ef90508d8 req-47f25d15-0531-49d6-8d47-8dc7df84afbe tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.90 "DELETE /v2.0/ports/f173e8db-9c28-4415-be12-b2f898eb931e HTTP/1.1" status: 204 len: 173 time: 0.5203068 Nov 02 12:53:41.243389 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c09c5da0-2ee0-40c1-b5fb-f06550d58ee4', 'name': 'network-vif-deleted', 'tag': 'f173e8db-9c28-4415-be12-b2f898eb931e'}] {{(pid=108542) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:53:41.247824 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8fdc2194739644bb754d6b187539f80d2eba7dc5c5d5392f1a2d22d03c0a316c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b6906c18-3dc9-4865-88d8-8c7a2fb6b653" -d '{"events": [{"server_uuid": "c09c5da0-2ee0-40c1-b5fb-f06550d58ee4", "name": "network-vif-deleted", "tag": "f173e8db-9c28-4415-be12-b2f898eb931e"}]}' {{(pid=108542) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:53:41.285534 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-53a5c4b6-3470-476f-9033-cdfb5ba72f0d req-ffd52c0c-6ade-4354-839f-d6d47897ed4e tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=c09c5da0-2ee0-40c1-b5fb-f06550d58ee4 HTTP/1.1" status: 200 len: 210 time: 0.0341606 Nov 02 12:53:41.305387 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:53:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7ee310e9-b3e9-4ef6-a4d9-ac054ad07769 x-openstack-request-id: req-7ee310e9-b3e9-4ef6-a4d9-ac054ad07769 {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:53:41.305705 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c09c5da0-2ee0-40c1-b5fb-f06550d58ee4", "name": "network-vif-deleted", "tag": "f173e8db-9c28-4415-be12-b2f898eb931e", "status": "completed", "code": 200}]} {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:53:41.305987 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-7ee310e9-b3e9-4ef6-a4d9-ac054ad07769 {{(pid=108542) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:53:41.306398 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c09c5da0-2ee0-40c1-b5fb-f06550d58ee4', 'name': 'network-vif-deleted', 'tag': 'f173e8db-9c28-4415-be12-b2f898eb931e', 'status': 'completed', 'code': 200} Nov 02 12:53:41.472230 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:53:42.391730 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-71006051-5d00-444f-b463-686ebb70ee29 req-e932a449-c33c-4226-b951-c4365495792f tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=c09c5da0-2ee0-40c1-b5fb-f06550d58ee4 HTTP/1.1" status: 200 len: 210 time: 0.0279453 Nov 02 12:53:43.911177 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9cd1bb21-a869-47a7-9542-83c7c61289b4 req-3ffa10d7-a3a8-4882-9828-e5d1b36c7f06 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:43.912653 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9cd1bb21-a869-47a7-9542-83c7c61289b4 req-3ffa10d7-a3a8-4882-9828-e5d1b36c7f06 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=0d21bc42-7392-483d-b042-8c4ffea9a7f2 HTTP/1.1" status: 200 len: 945 time: 0.0494640 Nov 02 12:53:43.961735 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9cd1bb21-a869-47a7-9542-83c7c61289b4 req-9484b5bd-94dc-4760-b384-beeb404034a3 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0431075 Nov 02 12:53:44.616508 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device f173e8db-9c28-4415-be12-b2f898eb931e no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:53:44.642394 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] No Port match for: f173e8db-9c28-4415-be12-b2f898eb931e {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:53:44.642759 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device f173e8db-9c28-4415-be12-b2f898eb931e not bound to the agent host hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:53:45.085583 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d380f71b-a374-4161-8013-a5ec4a1dc65b req-c2aab549-7208-46af-a1a0-0a177a9a4c7c tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:45.087082 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d380f71b-a374-4161-8013-a5ec4a1dc65b req-c2aab549-7208-46af-a1a0-0a177a9a4c7c tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=0d21bc42-7392-483d-b042-8c4ffea9a7f2 HTTP/1.1" status: 200 len: 945 time: 0.0528007 Nov 02 12:53:45.134754 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d380f71b-a374-4161-8013-a5ec4a1dc65b req-bfb2bf03-9d71-44f1-ad94-6f87e12c24dd tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0416555 Nov 02 12:53:46.252527 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f5c693bc-b8b9-4a43-b018-2c10a7b57acc req-7f959025-6799-419a-b248-a074f9612c94 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:46.253989 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f5c693bc-b8b9-4a43-b018-2c10a7b57acc req-7f959025-6799-419a-b248-a074f9612c94 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=0d21bc42-7392-483d-b042-8c4ffea9a7f2 HTTP/1.1" status: 200 len: 945 time: 0.0501804 Nov 02 12:53:46.302178 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f5c693bc-b8b9-4a43-b018-2c10a7b57acc req-e41eff52-f252-41b6-91f5-d11a984c43ec tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0421429 Nov 02 12:53:47.456502 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7cc30df0-8269-4218-a75e-688faee75fa8 req-7d1c09d0-9e7f-4554-aa26-085621c9f5ef tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:47.458302 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7cc30df0-8269-4218-a75e-688faee75fa8 req-7d1c09d0-9e7f-4554-aa26-085621c9f5ef tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=0d21bc42-7392-483d-b042-8c4ffea9a7f2 HTTP/1.1" status: 200 len: 945 time: 0.0535090 Nov 02 12:53:47.521835 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7cc30df0-8269-4218-a75e-688faee75fa8 req-d6b0ade4-3e2a-4d72-83df-2177f1e1b32b tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0569806 Nov 02 12:53:48.654254 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ea24200-5df1-4c2f-8c4a-e612cb144bd9 req-9e5da25b-18a0-4292-a76f-90635abbb0f9 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:48.655847 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2ea24200-5df1-4c2f-8c4a-e612cb144bd9 req-9e5da25b-18a0-4292-a76f-90635abbb0f9 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=0d21bc42-7392-483d-b042-8c4ffea9a7f2 HTTP/1.1" status: 200 len: 945 time: 0.0600083 Nov 02 12:53:48.708786 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2ea24200-5df1-4c2f-8c4a-e612cb144bd9 req-6d9e3dec-c7f4-4145-9fe8-f864bd627468 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0461929 Nov 02 12:53:49.535649 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-142f18f2-9c5e-44b7-8734-b0bdb69d3cd6 req-2535de48-c1cf-45d9-b740-51ea13b89b9a tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:49.537984 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-142f18f2-9c5e-44b7-8734-b0bdb69d3cd6 req-2535de48-c1cf-45d9-b740-51ea13b89b9a tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.90 "GET /v2.0/ports?device_id=0d21bc42-7392-483d-b042-8c4ffea9a7f2 HTTP/1.1" status: 200 len: 945 time: 0.0615067 Nov 02 12:53:49.678045 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [req-142f18f2-9c5e-44b7-8734-b0bdb69d3cd6 req-2b19be6f-3228-4040-a606-bf69654020a9 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Deleting port 4767bbe8-ea52-4258-9417-d866fb33fb53 {{(pid=108542) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:53:49.678582 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-142f18f2-9c5e-44b7-8734-b0bdb69d3cd6 req-2b19be6f-3228-4040-a606-bf69654020a9 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:49.789371 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [req-142f18f2-9c5e-44b7-8734-b0bdb69d3cd6 req-2b19be6f-3228-4040-a606-bf69654020a9 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] For port 4767bbe8-ea52-4258-9417-d866fb33fb53, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=4767bbe8-ea52-4258-9417-d866fb33fb53,segment=NetworkSegment(e912b2b1-808c-4d37-a99d-fcfdb9d2a5db),segment_id=e912b2b1-808c-4d37-a99d-fcfdb9d2a5db)] {{(pid=108542) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:53:49.789785 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-142f18f2-9c5e-44b7-8734-b0bdb69d3cd6 req-2b19be6f-3228-4040-a606-bf69654020a9 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:49.805882 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [req-142f18f2-9c5e-44b7-8734-b0bdb69d3cd6 req-2b19be6f-3228-4040-a606-bf69654020a9 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Calling delete_port for 4767bbe8-ea52-4258-9417-d866fb33fb53 owned by compute:nova {{(pid=108542) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:53:49.854727 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c5c9bfcc-499f-49d2-bed0-4f2a4825217b req-8232a708-e652-4b0e-bba3-cb3d188aba91 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:49.856924 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c5c9bfcc-499f-49d2-bed0-4f2a4825217b req-8232a708-e652-4b0e-bba3-cb3d188aba91 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=0d21bc42-7392-483d-b042-8c4ffea9a7f2 HTTP/1.1" status: 200 len: 945 time: 0.0627289 Nov 02 12:53:49.939161 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c5c9bfcc-499f-49d2-bed0-4f2a4825217b req-bb113660-44fe-4f64-8620-f640181ac362 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0703332 Nov 02 12:53:50.076112 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-142f18f2-9c5e-44b7-8734-b0bdb69d3cd6 req-2b19be6f-3228-4040-a606-bf69654020a9 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:50.088730 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['4c597805-3835-4f59-b320-5614de6b4ec6', '4767bbe8-ea52-4258-9417-d866fb33fb53'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:53:50.111191 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b19be6f-3228-4040-a606-bf69654020a9 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Pushing event deleted for resources: {'Port': ['ID=4767bbe8-ea52-4258-9417-d866fb33fb53,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:53:50.175744 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [req-142f18f2-9c5e-44b7-8734-b0bdb69d3cd6 req-2b19be6f-3228-4040-a606-bf69654020a9 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] No DVR routers for this DVR port 4767bbe8-ea52-4258-9417-d866fb33fb53 on host hv-cinder-81632 {{(pid=108542) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 12:53:50.179588 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-142f18f2-9c5e-44b7-8734-b0bdb69d3cd6 req-2b19be6f-3228-4040-a606-bf69654020a9 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:50.186026 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-142f18f2-9c5e-44b7-8734-b0bdb69d3cd6 req-2b19be6f-3228-4040-a606-bf69654020a9 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.90 "DELETE /v2.0/ports/4767bbe8-ea52-4258-9417-d866fb33fb53 HTTP/1.1" status: 204 len: 173 time: 0.6414807 Nov 02 12:53:50.186834 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '0d21bc42-7392-483d-b042-8c4ffea9a7f2', 'name': 'network-vif-deleted', 'tag': '4767bbe8-ea52-4258-9417-d866fb33fb53'}] {{(pid=108542) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:53:50.196195 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8fdc2194739644bb754d6b187539f80d2eba7dc5c5d5392f1a2d22d03c0a316c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-27a8ba9e-0fa4-4a98-8b08-59078da8f2e4" -d '{"events": [{"server_uuid": "0d21bc42-7392-483d-b042-8c4ffea9a7f2", "name": "network-vif-deleted", "tag": "4767bbe8-ea52-4258-9417-d866fb33fb53"}]}' {{(pid=108542) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:53:50.254846 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:53:50 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-74ed4ed1-48a7-4466-8e42-739fecbac240 x-openstack-request-id: req-74ed4ed1-48a7-4466-8e42-739fecbac240 {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:53:50.255476 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "0d21bc42-7392-483d-b042-8c4ffea9a7f2", "name": "network-vif-deleted", "tag": "4767bbe8-ea52-4258-9417-d866fb33fb53", "status": "completed", "code": 200}]} {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:53:50.256860 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-74ed4ed1-48a7-4466-8e42-739fecbac240 {{(pid=108542) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:53:50.261307 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '0d21bc42-7392-483d-b042-8c4ffea9a7f2', 'name': 'network-vif-deleted', 'tag': '4767bbe8-ea52-4258-9417-d866fb33fb53', 'status': 'completed', 'code': 200} Nov 02 12:53:51.060253 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3842153b-0f5a-431b-afda-3786f58a9712 req-db5e21af-401c-452f-9a3c-3290bb1c4dfa tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=0d21bc42-7392-483d-b042-8c4ffea9a7f2 HTTP/1.1" status: 200 len: 210 time: 0.0312276 Nov 02 12:53:53.481570 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-6fffdc11-7d5a-4ffb-9a90-d1c17439f068 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:54.027653 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0877cb13-c160-4436-bafb-b4e544284901 req-5684f4f4-727e-4b10-8b5f-13f5ff0ccc07 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:54.029841 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0877cb13-c160-4436-bafb-b4e544284901 req-5684f4f4-727e-4b10-8b5f-13f5ff0ccc07 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 946 time: 0.0560062 Nov 02 12:53:54.085242 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0877cb13-c160-4436-bafb-b4e544284901 req-b9709fa3-c490-4150-b59e-629bc8f5453e tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0492537 Nov 02 12:53:54.598871 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 4767bbe8-ea52-4258-9417-d866fb33fb53 no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:53:54.622757 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] No Port match for: 4767bbe8-ea52-4258-9417-d866fb33fb53 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:53:54.623191 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 4767bbe8-ea52-4258-9417-d866fb33fb53 not bound to the agent host hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:53:55.208190 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2032f27b-d8c7-4548-bc7a-112cde1f63ae req-1da19727-b560-4b55-8c9f-5b5ad7ec4f94 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:55.209744 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2032f27b-d8c7-4548-bc7a-112cde1f63ae req-1da19727-b560-4b55-8c9f-5b5ad7ec4f94 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 946 time: 0.0504823 Nov 02 12:53:55.262856 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2032f27b-d8c7-4548-bc7a-112cde1f63ae req-b932f87d-2031-4829-b955-659ee59f3e01 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/security-groups?id=97f5e46c-1e9a-4380-8d78-d2449eba5bf1&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0459225 Nov 02 12:53:55.668198 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-fff2bc2d-7344-44a1-94e5-d7129dcda69e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:55.683447 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-481f47e2-a5b4-4145-9ab9-ca17a5b72916 req-6527668f-c9d7-4996-b109-0af5dd6d53e4 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:53:55.684955 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-481f47e2-a5b4-4145-9ab9-ca17a5b72916 req-6527668f-c9d7-4996-b109-0af5dd6d53e4 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.90 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 946 time: 0.0556738 Nov 02 12:53:55.788025 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [req-481f47e2-a5b4-4145-9ab9-ca17a5b72916 req-9ac5d1d7-548a-4ab8-9a51-8f371367e31a tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Deleting port 4c597805-3835-4f59-b320-5614de6b4ec6 {{(pid=108542) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:53:55.788357 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-481f47e2-a5b4-4145-9ab9-ca17a5b72916 req-9ac5d1d7-548a-4ab8-9a51-8f371367e31a tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:55.878286 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [req-481f47e2-a5b4-4145-9ab9-ca17a5b72916 req-9ac5d1d7-548a-4ab8-9a51-8f371367e31a tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] For port 4c597805-3835-4f59-b320-5614de6b4ec6, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=4c597805-3835-4f59-b320-5614de6b4ec6,segment=NetworkSegment(e912b2b1-808c-4d37-a99d-fcfdb9d2a5db),segment_id=e912b2b1-808c-4d37-a99d-fcfdb9d2a5db)] {{(pid=108542) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:53:55.878676 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-481f47e2-a5b4-4145-9ab9-ca17a5b72916 req-9ac5d1d7-548a-4ab8-9a51-8f371367e31a tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:55.891759 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [req-481f47e2-a5b4-4145-9ab9-ca17a5b72916 req-9ac5d1d7-548a-4ab8-9a51-8f371367e31a tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Calling delete_port for 4c597805-3835-4f59-b320-5614de6b4ec6 owned by compute:nova {{(pid=108542) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:53:56.115539 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-481f47e2-a5b4-4145-9ab9-ca17a5b72916 req-9ac5d1d7-548a-4ab8-9a51-8f371367e31a tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:56.127746 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['4c597805-3835-4f59-b320-5614de6b4ec6'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:53:56.145178 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ac5d1d7-548a-4ab8-9a51-8f371367e31a tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Pushing event deleted for resources: {'Port': ['ID=4c597805-3835-4f59-b320-5614de6b4ec6,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:53:56.193934 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [req-481f47e2-a5b4-4145-9ab9-ca17a5b72916 req-9ac5d1d7-548a-4ab8-9a51-8f371367e31a tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] No DVR routers for this DVR port 4c597805-3835-4f59-b320-5614de6b4ec6 on host hv-cinder-81632 {{(pid=108542) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 12:53:56.194721 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-481f47e2-a5b4-4145-9ab9-ca17a5b72916 req-9ac5d1d7-548a-4ab8-9a51-8f371367e31a tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:56.199948 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-481f47e2-a5b4-4145-9ab9-ca17a5b72916 req-9ac5d1d7-548a-4ab8-9a51-8f371367e31a tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.90 "DELETE /v2.0/ports/4c597805-3835-4f59-b320-5614de6b4ec6 HTTP/1.1" status: 204 len: 173 time: 0.5035751 Nov 02 12:53:56.199948 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'b5d96599-f79e-47ef-bc01-a14589555ab4', 'name': 'network-vif-deleted', 'tag': '4c597805-3835-4f59-b320-5614de6b4ec6'}] {{(pid=108542) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:53:56.201211 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8fdc2194739644bb754d6b187539f80d2eba7dc5c5d5392f1a2d22d03c0a316c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-27595020-39f9-43ab-a613-7c672ee3c223" -d '{"events": [{"server_uuid": "b5d96599-f79e-47ef-bc01-a14589555ab4", "name": "network-vif-deleted", "tag": "4c597805-3835-4f59-b320-5614de6b4ec6"}]}' {{(pid=108542) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:53:56.245902 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:53:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-da1e0531-0ed2-48b1-a2bb-f0133f06cca1 x-openstack-request-id: req-da1e0531-0ed2-48b1-a2bb-f0133f06cca1 {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:53:56.246262 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "b5d96599-f79e-47ef-bc01-a14589555ab4", "name": "network-vif-deleted", "tag": "4c597805-3835-4f59-b320-5614de6b4ec6", "status": "completed", "code": 200}]} {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:53:56.246613 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-da1e0531-0ed2-48b1-a2bb-f0133f06cca1 {{(pid=108542) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:53:56.247076 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'b5d96599-f79e-47ef-bc01-a14589555ab4', 'name': 'network-vif-deleted', 'tag': '4c597805-3835-4f59-b320-5614de6b4ec6', 'status': 'completed', 'code': 200} Nov 02 12:53:56.367296 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d35aa707-6fab-4467-ac19-23df257831e3 req-d6bee291-30a6-48d3-a691-2634597f0efc tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 210 time: 0.0298851 Nov 02 12:53:56.926890 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:57.486476 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f3ccb915-084a-4160-a803-651c89517bd7 req-88079daf-1b1d-4391-8d10-91b8e5ddc969 tempest-AttachVolumeNegativeTest-1876170783 tempest-AttachVolumeNegativeTest-1876170783-project] 10.222.0.98 "GET /v2.0/ports?device_id=b5d96599-f79e-47ef-bc01-a14589555ab4 HTTP/1.1" status: 200 len: 210 time: 0.0291374 Nov 02 12:53:58.326780 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:58.548361 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 60948) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:53:58.828913 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_v2 [None req-54233fad-35bc-4bf2-938c-5a05fb70b785 admin admin] Deleting subnet 8f42833a-0a0e-4198-a7cf-e79133593615 {{(pid=108542) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 02 12:53:58.832009 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-54233fad-35bc-4bf2-938c-5a05fb70b785 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:58.867238 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-54233fad-35bc-4bf2-938c-5a05fb70b785 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3344686'] for subnet, precommit_delete_associations {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:58.906557 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-54233fad-35bc-4bf2-938c-5a05fb70b785 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-933154'] for subnet, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:59.103140 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-54233fad-35bc-4bf2-938c-5a05fb70b785 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-933141', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126478215', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126185624'] for subnet, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:59.134861 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-54233fad-35bc-4bf2-938c-5a05fb70b785 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=8f42833a-0a0e-4198-a7cf-e79133593615,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:53:59.141810 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-54233fad-35bc-4bf2-938c-5a05fb70b785 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:59.150082 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-54233fad-35bc-4bf2-938c-5a05fb70b785 admin admin] 10.222.0.98 "DELETE /v2.0/subnets/8f42833a-0a0e-4198-a7cf-e79133593615 HTTP/1.1" status: 204 len: 168 time: 0.5972905 Nov 02 12:53:59.150691 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 60958) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:53:59.220293 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dfe15b6f-4189-47ac-94c7-190eddc03a2d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-972735'] for network, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:59.303055 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dfe15b6f-4189-47ac-94c7-190eddc03a2d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-930985', 'neutron.services.segments.db._delete_segments_for_network-8738449897966'] for network, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:59.323500 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-dfe15b6f-4189-47ac-94c7-190eddc03a2d admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['bfe7dfe3-4b23-4454-b60a-4955be8d2d31']}} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:53:59.332906 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-dfe15b6f-4189-47ac-94c7-190eddc03a2d admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e912b2b1-808c-4d37-a99d-fcfdb9d2a5db') {'for_net_delete': True} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:53:59.333195 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-dfe15b6f-4189-47ac-94c7-190eddc03a2d admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e912b2b1-808c-4d37-a99d-fcfdb9d2a5db') {} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:53:59.342903 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dfe15b6f-4189-47ac-94c7-190eddc03a2d admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738449902583', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3344697'] for segment, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:59.355906 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dfe15b6f-4189-47ac-94c7-190eddc03a2d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:59.361909 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-dfe15b6f-4189-47ac-94c7-190eddc03a2d admin admin] Releasing vlan 862 on physical network physnet1 to pool {{(pid=108542) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 02 12:53:59.362179 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dfe15b6f-4189-47ac-94c7-190eddc03a2d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126476581'] for segment, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: Traceback (most recent call last): Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: timer() Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: cb(*args, **kw) Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: return func(*args, **kwargs) Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: self._notify() Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: self.callback(batched_events) Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: event.method(event) Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: aggregate_uuid = self.p_client.list_aggregates( Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: return f(self, *a, **k) Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: return self._get(url).json() Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: return self.request(url, 'GET', **kwargs) Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: base_url = self.get_endpoint(auth, allow=allow, Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 02 12:53:59.363827 dv-cinder-816324-1-iscsi neutron-server[108542]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 02 12:53:59.503440 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dfe15b6f-4189-47ac-94c7-190eddc03a2d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-930976', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1594946'] for network, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:59.508959 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-dfe15b6f-4189-47ac-94c7-190eddc03a2d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:53:59.516505 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-dfe15b6f-4189-47ac-94c7-190eddc03a2d admin admin] 10.222.0.98 "DELETE /v2.0/networks/bfe7dfe3-4b23-4454-b60a-4955be8d2d31 HTTP/1.1" status: 204 len: 168 time: 0.3603981 Nov 02 12:53:59.523453 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dfe15b6f-4189-47ac-94c7-190eddc03a2d admin admin] Pushing event deleted for resources: {'Network': ['ID=bfe7dfe3-4b23-4454-b60a-4955be8d2d31,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:53:59.950031 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 60968) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:53:59.989396 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-280e450c-83d1-47a4-a768-abaadcac9d33 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=dfe80527be524672a94a38908e154182&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0381706 Nov 02 12:53:59.991873 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 60970) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:00.039763 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e669391a-8cfe-435c-bf8b-f8aab32ce92d admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:00.061514 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e669391a-8cfe-435c-bf8b-f8aab32ce92d admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:00.206731 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e669391a-8cfe-435c-bf8b-f8aab32ce92d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:00.209324 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e669391a-8cfe-435c-bf8b-f8aab32ce92d admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:00.210689 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-e669391a-8cfe-435c-bf8b-f8aab32ce92d admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/97f5e46c-1e9a-4380-8d78-d2449eba5bf1 HTTP/1.1" status: 204 len: 168 time: 0.2178671 Nov 02 12:54:00.218834 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e669391a-8cfe-435c-bf8b-f8aab32ce92d admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=97f5e46c-1e9a-4380-8d78-d2449eba5bf1,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:00.609137 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 4c597805-3835-4f59-b320-5614de6b4ec6 no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:54:00.635217 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] No Port match for: 4c597805-3835-4f59-b320-5614de6b4ec6 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:54:00.636003 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 4c597805-3835-4f59-b320-5614de6b4ec6 not bound to the agent host hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:54:00.789298 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:01.516413 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 32776) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:01.625919 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-21c12536-1687-4bb0-8689-7d1129462b5b admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:01.700289 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-21c12536-1687-4bb0-8689-7d1129462b5b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:01.841467 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-21c12536-1687-4bb0-8689-7d1129462b5b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:01.882230 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-21c12536-1687-4bb0-8689-7d1129462b5b admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=afe576a8b4524dfda6e0c27c56f6b38f&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3646963 Nov 02 12:54:01.883118 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-21c12536-1687-4bb0-8689-7d1129462b5b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=57c6ffb9-edcb-433a-98c1-326fdc0882fd,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:01.885088 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 32782) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:01.935223 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7e260521-f3b3-4c6b-bda3-8a824008628b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:01.957715 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7e260521-f3b3-4c6b-bda3-8a824008628b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:02.211951 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7e260521-f3b3-4c6b-bda3-8a824008628b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:02.215318 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7e260521-f3b3-4c6b-bda3-8a824008628b admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:02.216698 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-7e260521-f3b3-4c6b-bda3-8a824008628b admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/57c6ffb9-edcb-433a-98c1-326fdc0882fd HTTP/1.1" status: 204 len: 168 time: 0.3304164 Nov 02 12:54:02.224397 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e260521-f3b3-4c6b-bda3-8a824008628b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=57c6ffb9-edcb-433a-98c1-326fdc0882fd,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:03.389031 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:07.510027 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8384d62-3766-453f-a266-770efb8dd272 req-2fad30e7-7c94-4b6f-8b19-a857e18e26df tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:07.511743 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f8384d62-3766-453f-a266-770efb8dd272 req-2fad30e7-7c94-4b6f-8b19-a857e18e26df tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 946 time: 0.2088716 Nov 02 12:54:07.564369 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f8384d62-3766-453f-a266-770efb8dd272 req-cccbd7f6-0cfc-4f43-af11-90e4de8f05cd tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458884 Nov 02 12:54:08.700372 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e5c5e59d-a896-43f0-b52f-afcf2c92c0e0 req-be1ed1cf-c1a1-480f-bb64-6df4d96c982f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:08.701989 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e5c5e59d-a896-43f0-b52f-afcf2c92c0e0 req-be1ed1cf-c1a1-480f-bb64-6df4d96c982f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 946 time: 0.0550363 Nov 02 12:54:08.760280 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e5c5e59d-a896-43f0-b52f-afcf2c92c0e0 req-7d3852a6-bb3b-46fb-ae1b-6853a9e6092f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=766f224b-2f11-482d-8950-f06d70b54eae&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0504670 Nov 02 12:54:08.996235 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50e53694-2ec1-4006-ba49-587ee3fcd19d req-b42fc818-ccdf-4d2c-abdb-c068b29a3ce7 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:08.997687 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-50e53694-2ec1-4006-ba49-587ee3fcd19d req-b42fc818-ccdf-4d2c-abdb-c068b29a3ce7 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.90 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 946 time: 0.0492399 Nov 02 12:54:09.094246 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [req-50e53694-2ec1-4006-ba49-587ee3fcd19d req-f8aed58f-f911-4b4e-a547-0b5f0800c37f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Deleting port bf7c4605-4045-4117-af22-08d75129b835 {{(pid=108542) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:54:09.094630 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-50e53694-2ec1-4006-ba49-587ee3fcd19d req-f8aed58f-f911-4b4e-a547-0b5f0800c37f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:09.198747 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [req-50e53694-2ec1-4006-ba49-587ee3fcd19d req-f8aed58f-f911-4b4e-a547-0b5f0800c37f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] For port bf7c4605-4045-4117-af22-08d75129b835, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=bf7c4605-4045-4117-af22-08d75129b835,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108542) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:54:09.200105 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-50e53694-2ec1-4006-ba49-587ee3fcd19d req-f8aed58f-f911-4b4e-a547-0b5f0800c37f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:09.478394 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-50e53694-2ec1-4006-ba49-587ee3fcd19d req-f8aed58f-f911-4b4e-a547-0b5f0800c37f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:09.478771 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-50e53694-2ec1-4006-ba49-587ee3fcd19d req-f8aed58f-f911-4b4e-a547-0b5f0800c37f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1594992'] for floatingip, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:09.479068 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.db.l3_db [req-50e53694-2ec1-4006-ba49-587ee3fcd19d req-f8aed58f-f911-4b4e-a547-0b5f0800c37f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Floating IP 6407ff06-03f9-4f81-a9b3-7f350e066ed0 disassociated. External IP: 172.27.0.123, port: bf7c4605-4045-4117-af22-08d75129b835. Nov 02 12:54:09.479461 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [req-50e53694-2ec1-4006-ba49-587ee3fcd19d req-f8aed58f-f911-4b4e-a547-0b5f0800c37f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Calling delete_port for bf7c4605-4045-4117-af22-08d75129b835 owned by compute:nova {{(pid=108542) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:54:09.709463 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-50e53694-2ec1-4006-ba49-587ee3fcd19d req-f8aed58f-f911-4b4e-a547-0b5f0800c37f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:09.712855 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 32954) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:09.740885 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f8aed58f-f911-4b4e-a547-0b5f0800c37f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Pushing event deleted for resources: {'Port': ['ID=bf7c4605-4045-4117-af22-08d75129b835,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:09.854812 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-1ad81903-81e6-4799-83e1-d449e5190586 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:09.885691 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.l3_agent_scheduler [req-50e53694-2ec1-4006-ba49-587ee3fcd19d req-f8aed58f-f911-4b4e-a547-0b5f0800c37f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Router 308142a4-46ba-42ef-a1f2-5df4b969cc8f has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108542) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 12:54:09.900951 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-292d33d0-1f27-4753-956d-a424a31d93d7 req-16fb13a5-dfc1-4de3-87de-04965079d345 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 210 time: 0.0474017 Nov 02 12:54:09.976702 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-1ad81903-81e6-4799-83e1-d449e5190586 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:10.000920 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-50e53694-2ec1-4006-ba49-587ee3fcd19d req-f8aed58f-f911-4b4e-a547-0b5f0800c37f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108542) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:54:10.011675 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28e67044-d1db-49b0-8cb4-c00ce662c54e None None] Sync routers for ids ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'] in dv-cinder-816324-1-iscsi {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:54:10.021794 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28e67044-d1db-49b0-8cb4-c00ce662c54e None None] Routers {'308142a4-46ba-42ef-a1f2-5df4b969cc8f'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:54:10.022603 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-28e67044-d1db-49b0-8cb4-c00ce662c54e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:53:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:54:10.046657 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [req-50e53694-2ec1-4006-ba49-587ee3fcd19d req-f8aed58f-f911-4b4e-a547-0b5f0800c37f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] No DVR routers for this DVR port bf7c4605-4045-4117-af22-08d75129b835 on host hv-cinder-81632 {{(pid=108542) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 12:54:10.046657 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-50e53694-2ec1-4006-ba49-587ee3fcd19d req-f8aed58f-f911-4b4e-a547-0b5f0800c37f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:10.046657 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-50e53694-2ec1-4006-ba49-587ee3fcd19d req-f8aed58f-f911-4b4e-a547-0b5f0800c37f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.90 "DELETE /v2.0/ports/bf7c4605-4045-4117-af22-08d75129b835 HTTP/1.1" status: 204 len: 173 time: 1.0409448 Nov 02 12:54:10.046657 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '7cc2c649-db32-4af2-b17b-1b744ef40a5f', 'name': 'network-vif-deleted', 'tag': 'bf7c4605-4045-4117-af22-08d75129b835'}] {{(pid=108542) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:54:10.048668 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8fdc2194739644bb754d6b187539f80d2eba7dc5c5d5392f1a2d22d03c0a316c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a91415af-257b-4881-9392-00aab019434c" -d '{"events": [{"server_uuid": "7cc2c649-db32-4af2-b17b-1b744ef40a5f", "name": "network-vif-deleted", "tag": "bf7c4605-4045-4117-af22-08d75129b835"}]}' {{(pid=108542) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:54:10.083789 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:54:10 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-57e9a3ee-c6e1-4b85-8ec5-7edaecba8df6 x-openstack-request-id: req-57e9a3ee-c6e1-4b85-8ec5-7edaecba8df6 {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:54:10.084097 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "7cc2c649-db32-4af2-b17b-1b744ef40a5f", "name": "network-vif-deleted", "tag": "bf7c4605-4045-4117-af22-08d75129b835", "status": "completed", "code": 200}]} {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:54:10.084327 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-57e9a3ee-c6e1-4b85-8ec5-7edaecba8df6 {{(pid=108542) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:54:10.084729 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '7cc2c649-db32-4af2-b17b-1b744ef40a5f', 'name': 'network-vif-deleted', 'tag': 'bf7c4605-4045-4117-af22-08d75129b835', 'status': 'completed', 'code': 200} Nov 02 12:54:10.160740 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-1ad81903-81e6-4799-83e1-d449e5190586 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:10.204107 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-1ad81903-81e6-4799-83e1-d449e5190586 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=3d6bd7237d5e45c18d389f8241bc5a07&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4894693 Nov 02 12:54:10.206812 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 32970) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:10.213041 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ad81903-81e6-4799-83e1-d449e5190586 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=e600e2ab-b48b-43ca-afae-6c0964727969,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:10.266898 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-63b97e41-e3cb-4aab-bc2e-3bc09b704691 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:10.271019 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-28e67044-d1db-49b0-8cb4-c00ce662c54e None None] Set router 308142a4-46ba-42ef-a1f2-5df4b969cc8f gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:54:10.292111 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-63b97e41-e3cb-4aab-bc2e-3bc09b704691 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:10.480523 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-28e67044-d1db-49b0-8cb4-c00ce662c54e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'name': 'tempest-AttachVolumeShelveTestJSON-199949485-router', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207'}], 'enable_snat': True}, 'gw_port_id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:49:22Z', 'revision_number': 4, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'gw_port': {'id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:4a:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:12Z', 'updated_at': '2021-11-02T12:49:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '91fe3ff8-cdf3-4761-8b27-27e55f6f6690', 'name': '', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'mac_address': 'fa:16:3e:51:73:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:20Z', 'updated_at': '2021-11-02T12:49:34Z', 'revision_number': 5, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'subnets': [{'id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:54:10.491685 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-63b97e41-e3cb-4aab-bc2e-3bc09b704691 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:10.494575 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-63b97e41-e3cb-4aab-bc2e-3bc09b704691 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:10.498556 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-63b97e41-e3cb-4aab-bc2e-3bc09b704691 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/e600e2ab-b48b-43ca-afae-6c0964727969 HTTP/1.1" status: 204 len: 168 time: 0.2872839 Nov 02 12:54:10.505762 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-63b97e41-e3cb-4aab-bc2e-3bc09b704691 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e600e2ab-b48b-43ca-afae-6c0964727969,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:10.512294 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28e67044-d1db-49b0-8cb4-c00ce662c54e None None] Checking router: 308142a4-46ba-42ef-a1f2-5df4b969cc8f for host: dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:54:10.531828 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-28e67044-d1db-49b0-8cb4-c00ce662c54e None None] Routers {'308142a4-46ba-42ef-a1f2-5df4b969cc8f'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:54:10.533079 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-28e67044-d1db-49b0-8cb4-c00ce662c54e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:53:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:54:10.645969 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-28e67044-d1db-49b0-8cb4-c00ce662c54e None None] Set router 308142a4-46ba-42ef-a1f2-5df4b969cc8f gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:54:10.852980 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-28e67044-d1db-49b0-8cb4-c00ce662c54e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'name': 'tempest-AttachVolumeShelveTestJSON-199949485-router', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207'}], 'enable_snat': True}, 'gw_port_id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:49:22Z', 'revision_number': 4, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'gw_port': {'id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:4a:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:12Z', 'updated_at': '2021-11-02T12:49:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '91fe3ff8-cdf3-4761-8b27-27e55f6f6690', 'name': '', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'mac_address': 'fa:16:3e:51:73:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:20Z', 'updated_at': '2021-11-02T12:49:34Z', 'revision_number': 5, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'subnets': [{'id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:54:10.880892 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-28e67044-d1db-49b0-8cb4-c00ce662c54e None None] The sync data for ids ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'] in dv-cinder-816324-1-iscsi is: [{'id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'name': 'tempest-AttachVolumeShelveTestJSON-199949485-router', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207'}], 'enable_snat': True}, 'gw_port_id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:49:22Z', 'revision_number': 4, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'gw_port': {'id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:4a:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:12Z', 'updated_at': '2021-11-02T12:49:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '91fe3ff8-cdf3-4761-8b27-27e55f6f6690', 'name': '', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'mac_address': 'fa:16:3e:51:73:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:20Z', 'updated_at': '2021-11-02T12:49:34Z', 'revision_number': 5, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'subnets': [{'id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:54:11.032532 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3af3b74c-d0ef-447a-a247-95d7a31bd3bf req-c70f50a8-ca5b-49ff-ac06-0ca327e6c4d4 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=7cc2c649-db32-4af2-b17b-1b744ef40a5f HTTP/1.1" status: 200 len: 210 time: 0.0304282 Nov 02 12:54:11.171883 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e7b1ce22-671a-4694-a836-fa818d615ea5 None None] New status for floating IP 6407ff06-03f9-4f81-a9b3-7f350e066ed0: DOWN {{(pid=108545) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 02 12:54:11.272544 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 32984) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:11.294053 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-697c4532-3e1e-4f88-af76-9cfa676f0548 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:11.380723 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-697c4532-3e1e-4f88-af76-9cfa676f0548 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:11.515456 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-697c4532-3e1e-4f88-af76-9cfa676f0548 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:11.554529 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-697c4532-3e1e-4f88-af76-9cfa676f0548 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=8687a55f-5c1f-4524-aa90-0f8ed7bc9e6b,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:11.564105 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-697c4532-3e1e-4f88-af76-9cfa676f0548 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=e0f856e1150b428c96876d8e4a7517c9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2896948 Nov 02 12:54:11.567593 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 32996) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:11.619922 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-9e47c5be-74cc-4a6e-8f9b-4292b360ad92 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:11.643708 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-9e47c5be-74cc-4a6e-8f9b-4292b360ad92 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:11.778452 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-9e47c5be-74cc-4a6e-8f9b-4292b360ad92 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:11.781224 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-9e47c5be-74cc-4a6e-8f9b-4292b360ad92 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:11.782888 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-9e47c5be-74cc-4a6e-8f9b-4292b360ad92 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/8687a55f-5c1f-4524-aa90-0f8ed7bc9e6b HTTP/1.1" status: 204 len: 168 time: 0.2148037 Nov 02 12:54:11.792127 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9e47c5be-74cc-4a6e-8f9b-4292b360ad92 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=8687a55f-5c1f-4524-aa90-0f8ed7bc9e6b,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:12.287094 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 33012) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:12.348424 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-58255205-c570-49bf-8ebe-267f5d0b63c2 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:12.381716 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-58255205-c570-49bf-8ebe-267f5d0b63c2 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:12.639761 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-58255205-c570-49bf-8ebe-267f5d0b63c2 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:12.639761 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-58255205-c570-49bf-8ebe-267f5d0b63c2 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:12.639761 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-58255205-c570-49bf-8ebe-267f5d0b63c2 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "DELETE /v2.0/security-groups/766f224b-2f11-482d-8950-f06d70b54eae HTTP/1.1" status: 204 len: 168 time: 0.3510807 Nov 02 12:54:12.642442 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 33022) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:12.649489 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58255205-c570-49bf-8ebe-267f5d0b63c2 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=766f224b-2f11-482d-8950-f06d70b54eae,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:12.655837 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.api.v2.resource [None req-a9a179e6-747a-4ac9-a826-b16c72b04066 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] show failed (client error): The resource could not be found. Nov 02 12:54:12.658923 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-a9a179e6-747a-4ac9-a826-b16c72b04066 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups/766f224b-2f11-482d-8950-f06d70b54eae HTTP/1.1" status: 404 len: 347 time: 0.0154841 Nov 02 12:54:12.663902 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 33024) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:12.793945 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-9ef88628-565c-46a9-8394-ee66c6dc7fbb tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Deleting port 5a1e49c5-6882-4306-b4f2-69b968b3cce8 {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:54:12.793945 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-9ef88628-565c-46a9-8394-ee66c6dc7fbb tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:12.871078 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-9ef88628-565c-46a9-8394-ee66c6dc7fbb tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:12.871449 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-9ef88628-565c-46a9-8394-ee66c6dc7fbb tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:12.884374 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-9ef88628-565c-46a9-8394-ee66c6dc7fbb tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Calling delete_port for 5a1e49c5-6882-4306-b4f2-69b968b3cce8 owned by network:floatingip {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:54:13.360594 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-9ef88628-565c-46a9-8394-ee66c6dc7fbb tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:13.391192 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9ef88628-565c-46a9-8394-ee66c6dc7fbb tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Pushing event deleted for resources: {'Port': ['ID=5a1e49c5-6882-4306-b4f2-69b968b3cce8,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:13.451790 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-9ef88628-565c-46a9-8394-ee66c6dc7fbb tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for floatingip, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:13.454999 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-9ef88628-565c-46a9-8394-ee66c6dc7fbb tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for floatingip, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:13.458553 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-9ef88628-565c-46a9-8394-ee66c6dc7fbb tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "DELETE /v2.0/floatingips/6407ff06-03f9-4f81-a9b3-7f350e066ed0 HTTP/1.1" status: 204 len: 168 time: 0.7912443 Nov 02 12:54:13.956277 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 33054) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:13.961074 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-7bbc717a-5e37-48a2-a710-49bd9131ee8e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1911081623', 'description': 'tempest-description--254918836'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:54:14.115065 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7bbc717a-5e37-48a2-a710-49bd9131ee8e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:14.181817 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7bbc717a-5e37-48a2-a710-49bd9131ee8e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:14.303348 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7bbc717a-5e37-48a2-a710-49bd9131ee8e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:14.335464 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7bbc717a-5e37-48a2-a710-49bd9131ee8e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Pushing event updated for resources: {'SecurityGroup': ['ID=22be136f-6622-4997-9ab0-ce1c8e1fa2a3,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:14.454043 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7bbc717a-5e37-48a2-a710-49bd9131ee8e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:14.455367 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-7bbc717a-5e37-48a2-a710-49bd9131ee8e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.4980779 Nov 02 12:54:14.458406 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 33074) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:14.463219 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-de468d92-9119-48e4-a630-bdfdb7629983 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Request body: {'security_group_rule': {'security_group_id': '22be136f-6622-4997-9ab0-ce1c8e1fa2a3', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:54:14.593308 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-de468d92-9119-48e4-a630-bdfdb7629983 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:14.644282 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-de468d92-9119-48e4-a630-bdfdb7629983 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:14.719326 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device bf7c4605-4045-4117-af22-08d75129b835 no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:54:14.739383 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] No Port match for: bf7c4605-4045-4117-af22-08d75129b835 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:54:14.743984 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device bf7c4605-4045-4117-af22-08d75129b835 not bound to the agent host hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:54:14.766428 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-de468d92-9119-48e4-a630-bdfdb7629983 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:14.785792 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de468d92-9119-48e4-a630-bdfdb7629983 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=dddf5f29-bfd4-4029-ac4c-7abe4414bfa7,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:14.882759 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-de468d92-9119-48e4-a630-bdfdb7629983 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:14.883970 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-de468d92-9119-48e4-a630-bdfdb7629983 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4245458 Nov 02 12:54:14.886678 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 33076) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:14.895671 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-a55f4634-e410-48a7-ba67-b646a5ad46c3 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Request body: {'security_group_rule': {'security_group_id': '22be136f-6622-4997-9ab0-ce1c8e1fa2a3', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:54:15.018147 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a55f4634-e410-48a7-ba67-b646a5ad46c3 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:15.087473 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a55f4634-e410-48a7-ba67-b646a5ad46c3 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:15.189504 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a55f4634-e410-48a7-ba67-b646a5ad46c3 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:15.207741 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a55f4634-e410-48a7-ba67-b646a5ad46c3 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=76aabf2b-b59f-4093-9956-fdaa535978d1,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:15.316925 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a55f4634-e410-48a7-ba67-b646a5ad46c3 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:15.318212 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-a55f4634-e410-48a7-ba67-b646a5ad46c3 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4305851 Nov 02 12:54:15.321515 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 33084) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:15.326202 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-1ec7cac5-f9ad-4cd7-9ffe-2461ffd96a25 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Request body: {'floatingip': {'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:54:15.435223 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1ec7cac5-f9ad-4cd7-9ffe-2461ffd96a25 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for floatingip, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:15.536594 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1ec7cac5-f9ad-4cd7-9ffe-2461ffd96a25 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:15.639914 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_common [None req-1ec7cac5-f9ad-4cd7-9ffe-2461ffd96a25 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Allocated IP 172.27.0.7 (43464fa8-eb00-46fb-9ca0-be7342f9ddbf/44a807bc-f2b6-41f0-b765-e5d3393fe305/3248e1f1-a6aa-47f6-9b78-2c1fddd0adc7) {{(pid=108542) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:54:15.744917 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1ec7cac5-f9ad-4cd7-9ffe-2461ffd96a25 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for port, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:15.863660 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1ec7cac5-f9ad-4cd7-9ffe-2461ffd96a25 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:15.902916 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-1ec7cac5-f9ad-4cd7-9ffe-2461ffd96a25 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:54:15.908530 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-1ec7cac5-f9ad-4cd7-9ffe-2461ffd96a25 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:54:15.912964 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1ec7cac5-f9ad-4cd7-9ffe-2461ffd96a25 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Received port after_create {{(pid=108542) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:54:15.918820 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ec7cac5-f9ad-4cd7-9ffe-2461ffd96a25 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Pushing event updated for resources: {'Port': ['ID=3248e1f1-a6aa-47f6-9b78-2c1fddd0adc7,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:16.006645 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1ec7cac5-f9ad-4cd7-9ffe-2461ffd96a25 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:16.174621 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1ec7cac5-f9ad-4cd7-9ffe-2461ffd96a25 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:16.328239 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1ec7cac5-f9ad-4cd7-9ffe-2461ffd96a25 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for port, precommit_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:16.452052 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1ec7cac5-f9ad-4cd7-9ffe-2461ffd96a25 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126476609'] for port, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:16.520939 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1ec7cac5-f9ad-4cd7-9ffe-2461ffd96a25 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Pushing event updated for resources: {'Port': ['ID=3248e1f1-a6aa-47f6-9b78-2c1fddd0adc7,revision_number=2']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:16.534684 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1ec7cac5-f9ad-4cd7-9ffe-2461ffd96a25 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1594992'] for floatingip, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:16.631419 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1ec7cac5-f9ad-4cd7-9ffe-2461ffd96a25 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for floatingip, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:16.632689 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-1ec7cac5-f9ad-4cd7-9ffe-2461ffd96a25 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 691 time: 1.3101239 Nov 02 12:54:16.835437 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-035d0116-5c90-4c98-8ec2-7d212394498e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?name=tempest-securitygroup--1911081623&fields=id&tenant_id=aaddc046689441b8ab3641f2afd07c0e HTTP/1.1" status: 200 len: 267 time: 0.0459435 Nov 02 12:54:16.944972 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-b0bfff40-c0ba-44dd-a82a-f77460511be7 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:16.947176 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-b0bfff40-c0ba-44dd-a82a-f77460511be7 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/networks?id=c468f0e1-3636-49b9-90c6-b90c643ed7d1 HTTP/1.1" status: 200 len: 816 time: 0.1028080 Nov 02 12:54:16.962867 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-9cab51d2-bf82-4b1b-88cc-a13c3e9f19d4 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/quotas/aaddc046689441b8ab3641f2afd07c0e HTTP/1.1" status: 200 len: 375 time: 0.0103993 Nov 02 12:54:17.018003 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-b07be621-066f-45c9-8205-540e210bad16 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?tenant_id=aaddc046689441b8ab3641f2afd07c0e&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0481329 Nov 02 12:54:17.122324 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-f45558a5-7522-4f8c-800a-9a936b1689bf service neutron] 10.222.0.98 "GET /v2.0/networks/c468f0e1-3636-49b9-90c6-b90c643ed7d1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0927846 Nov 02 12:54:17.218944 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-6b2298e2-3bc1-4b2b-b449-41e0f28563fc service neutron] 10.222.0.98 "GET /v2.0/networks/c468f0e1-3636-49b9-90c6-b90c643ed7d1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0905232 Nov 02 12:54:17.655309 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fcd48cee-91ac-4383-a028-9bd60b2200d2 req-2bbc4bc5-a49b-4ead-ac69-1c0f6879cf67 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 210 time: 0.1981924 Nov 02 12:54:18.472194 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:54:18.752145 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-739a63c9-f7c9-4914-8b28-3b1c57e87830 req-435fcd2e-450f-48ff-bd1b-ce4dcb1b04b2 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 210 time: 0.0266719 Nov 02 12:54:19.297896 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 33184) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:19.409364 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-118bddaa-4383-4d26-afb4-d196bfcb6cc8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:19.485031 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-118bddaa-4383-4d26-afb4-d196bfcb6cc8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:19.596250 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-118bddaa-4383-4d26-afb4-d196bfcb6cc8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:19.644804 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-118bddaa-4383-4d26-afb4-d196bfcb6cc8 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=235375d455fc4395b188e70ce614d26b&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3457656 Nov 02 12:54:19.646816 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-118bddaa-4383-4d26-afb4-d196bfcb6cc8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d3dada7b-dc07-4698-9bd1-1e5023886362,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:19.647556 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 33188) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:19.705934 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-6d529e53-e3f5-4234-a338-dfc274d770e4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:19.728528 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-6d529e53-e3f5-4234-a338-dfc274d770e4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:19.859452 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f33cbc5f-8e99-421f-916d-28b10bd971f6 req-f479850b-c911-4187-85d6-e6f8bb71b427 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 210 time: 0.0283492 Nov 02 12:54:19.926260 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-6d529e53-e3f5-4234-a338-dfc274d770e4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:19.928991 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-6d529e53-e3f5-4234-a338-dfc274d770e4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:19.930153 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-6d529e53-e3f5-4234-a338-dfc274d770e4 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/d3dada7b-dc07-4698-9bd1-1e5023886362 HTTP/1.1" status: 204 len: 168 time: 0.2815795 Nov 02 12:54:19.939870 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d529e53-e3f5-4234-a338-dfc274d770e4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d3dada7b-dc07-4698-9bd1-1e5023886362,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:20.454754 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-2c8cd2fd-d990-4687-9609-b7cd5ac31c26 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:20.456291 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-2c8cd2fd-d990-4687-9609-b7cd5ac31c26 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.90 "GET /v2.0/networks?id=c468f0e1-3636-49b9-90c6-b90c643ed7d1 HTTP/1.1" status: 200 len: 816 time: 0.1028171 Nov 02 12:54:20.529637 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-98a30bb8-dd7e-425b-95e1-b1fec4af60d4 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.90 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=aaddc046689441b8ab3641f2afd07c0e HTTP/1.1" status: 200 len: 380 time: 0.0555477 Nov 02 12:54:20.543664 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-2b8514c4-13db-4bb6-9e45-ee6a0a87cb84 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Request body: {'port': {'device_id': 'a1984910-3b5c-43f5-8727-1c65226b3983', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'admin_state_up': True, 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'security_groups': ['22be136f-6622-4997-9ab0-ce1c8e1fa2a3']}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:54:20.776581 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-2b8514c4-13db-4bb6-9e45-ee6a0a87cb84 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Made reservation on behalf of aaddc046689441b8ab3641f2afd07c0e for: {'port': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:54:20.780090 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-2b8514c4-13db-4bb6-9e45-ee6a0a87cb84 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:20.786554 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 33216) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:20.800330 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-32ec1590-fc8a-4e0e-acb5-f922dfa4eeba admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:20.888312 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-32ec1590-fc8a-4e0e-acb5-f922dfa4eeba admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:20.927322 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_common [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-2b8514c4-13db-4bb6-9e45-ee6a0a87cb84 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Allocated IP 172.20.0.8 (c468f0e1-3636-49b9-90c6-b90c643ed7d1/ec48fe57-a1cd-4e7c-874f-073624f71f4b/b2c052d8-c7f4-4790-afab-5f3766f86877) {{(pid=108542) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:54:20.956823 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-32ec1590-fc8a-4e0e-acb5-f922dfa4eeba admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:20.982633 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8b9405f0-1244-44bb-aa93-6cd34c78cde4 req-a9436c62-cea5-49d4-8da7-73eca3f07cae tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 210 time: 0.0364201 Nov 02 12:54:21.019705 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-32ec1590-fc8a-4e0e-acb5-f922dfa4eeba admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=1d57783eb1214e6198e35c3743b155e3&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2320728 Nov 02 12:54:21.022105 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32ec1590-fc8a-4e0e-acb5-f922dfa4eeba admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=a80b046b-0127-43ba-9008-fe0aa73c2aae,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:21.024464 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 33220) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:21.090602 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-8784faf6-f3b5-467b-934c-dd9e702894d8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:21.094299 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-2b8514c4-13db-4bb6-9e45-ee6a0a87cb84 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for port, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:21.117566 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-8784faf6-f3b5-467b-934c-dd9e702894d8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:21.315047 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-8784faf6-f3b5-467b-934c-dd9e702894d8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:21.315326 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-2b8514c4-13db-4bb6-9e45-ee6a0a87cb84 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:21.317660 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-8784faf6-f3b5-467b-934c-dd9e702894d8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:21.319034 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-8784faf6-f3b5-467b-934c-dd9e702894d8 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/a80b046b-0127-43ba-9008-fe0aa73c2aae HTTP/1.1" status: 204 len: 168 time: 0.2936506 Nov 02 12:54:21.327406 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8784faf6-f3b5-467b-934c-dd9e702894d8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=a80b046b-0127-43ba-9008-fe0aa73c2aae,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:21.623358 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-2b8514c4-13db-4bb6-9e45-ee6a0a87cb84 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Network c468f0e1-3636-49b9-90c6-b90c643ed7d1 is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:54:21.629035 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-2b8514c4-13db-4bb6-9e45-ee6a0a87cb84 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:54:21.632917 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-2b8514c4-13db-4bb6-9e45-ee6a0a87cb84 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Received port after_create {{(pid=108542) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:54:21.658212 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2b8514c4-13db-4bb6-9e45-ee6a0a87cb84 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Pushing event updated for resources: {'Port': ['ID=b2c052d8-c7f4-4790-afab-5f3766f86877,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:21.689846 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-2b8514c4-13db-4bb6-9e45-ee6a0a87cb84 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:21.690513 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-2b8514c4-13db-4bb6-9e45-ee6a0a87cb84 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:21.814723 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-2b8514c4-13db-4bb6-9e45-ee6a0a87cb84 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2746544 Nov 02 12:54:21.836418 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-f2e79bb8-c0fd-4e37-9311-977e64b38035 service neutron] Request body: {'port': {'device_id': 'a1984910-3b5c-43f5-8727-1c65226b3983', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81632'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:54:21.895992 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-82488e51-bc39-4853-8ac9-e1cf346a23d2 None None] Provisioning complete for port b2c052d8-c7f4-4790-afab-5f3766f86877 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:54:21.897383 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-82488e51-bc39-4853-8ac9-e1cf346a23d2 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:21.927790 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-f2e79bb8-c0fd-4e37-9311-977e64b38035 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:21.965218 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-82488e51-bc39-4853-8ac9-e1cf346a23d2 None None] Port b2c052d8-c7f4-4790-afab-5f3766f86877 cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:54:22.128949 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a9285af-f378-4de5-a940-806432d2aa05 req-28fac9aa-b401-4bc5-b545-339347a5fdee tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:22.130633 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9a9285af-f378-4de5-a940-806432d2aa05 req-28fac9aa-b401-4bc5-b545-339347a5fdee tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 931 time: 0.0590494 Nov 02 12:54:22.188245 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9a9285af-f378-4de5-a940-806432d2aa05 req-748975ba-be07-468e-b37c-48dfe2e59fe3 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0512168 Nov 02 12:54:22.252638 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.notifiers.nova [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-f2e79bb8-c0fd-4e37-9311-977e64b38035 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id b2c052d8-c7f4-4790-afab-5f3766f86877 {{(pid=108542) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:54:22.260529 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-f2e79bb8-c0fd-4e37-9311-977e64b38035 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:22.273094 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.provisioning_blocks [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-f2e79bb8-c0fd-4e37-9311-977e64b38035 service neutron] Transition to ACTIVE for port object b2c052d8-c7f4-4790-afab-5f3766f86877 will not be triggered until provisioned by entity L2. {{(pid=108542) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 02 12:54:22.416370 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-f2e79bb8-c0fd-4e37-9311-977e64b38035 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126476609'] for port, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:22.476904 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2e79bb8-c0fd-4e37-9311-977e64b38035 service neutron] Pushing event updated for resources: {'Port': ['ID=b2c052d8-c7f4-4790-afab-5f3766f86877,revision_number=2']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:22.561258 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.managers [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-f2e79bb8-c0fd-4e37-9311-977e64b38035 service neutron] Attempting to bind port b2c052d8-c7f4-4790-afab-5f3766f86877 on host hv-cinder-81632 for vnic_type normal with profile {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:54:22.562152 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.managers [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-f2e79bb8-c0fd-4e37-9311-977e64b38035 service neutron] Attempting to bind port b2c052d8-c7f4-4790-afab-5f3766f86877 by drivers openvswitch,hyperv on host hv-cinder-81632 at level 0 using segments [{'id': 'b2bc3e69-86f7-4524-92d5-933aa81f8f2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1'}] {{(pid=108542) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:54:22.562515 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-f2e79bb8-c0fd-4e37-9311-977e64b38035 service neutron] Attempting to bind port b2c052d8-c7f4-4790-afab-5f3766f86877 on network c468f0e1-3636-49b9-90c6-b90c643ed7d1 {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:54:22.567812 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-f2e79bb8-c0fd-4e37-9311-977e64b38035 service neutron] Port b2c052d8-c7f4-4790-afab-5f3766f86877 on network c468f0e1-3636-49b9-90c6-b90c643ed7d1 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81632 {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 02 12:54:22.568316 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-f2e79bb8-c0fd-4e37-9311-977e64b38035 service neutron] Attempting to bind port b2c052d8-c7f4-4790-afab-5f3766f86877 on network c468f0e1-3636-49b9-90c6-b90c643ed7d1 {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:54:22.574410 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-f2e79bb8-c0fd-4e37-9311-977e64b38035 service neutron] Checking agent: {'id': '0d57fa42-4660-4f08-b7dc-53a872c3c01c', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81632', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'started_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 54, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:54:22.574752 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-f2e79bb8-c0fd-4e37-9311-977e64b38035 service neutron] Checking segment: {'id': 'b2bc3e69-86f7-4524-92d5-933aa81f8f2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108542) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:54:22.575134 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-f2e79bb8-c0fd-4e37-9311-977e64b38035 service neutron] Bound using segment: {'id': 'b2bc3e69-86f7-4524-92d5-933aa81f8f2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1'} {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:54:22.575630 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.managers [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-f2e79bb8-c0fd-4e37-9311-977e64b38035 service neutron] Bound port: b2c052d8-c7f4-4790-afab-5f3766f86877, host: hv-cinder-81632, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'b2bc3e69-86f7-4524-92d5-933aa81f8f2f', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 854, 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1'}}] {{(pid=108542) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:54:22.575985 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-f2e79bb8-c0fd-4e37-9311-977e64b38035 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:22.666212 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-f2e79bb8-c0fd-4e37-9311-977e64b38035 service neutron] For port b2c052d8-c7f4-4790-afab-5f3766f86877, host hv-cinder-81632, cleared binding levels {{(pid=108542) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:54:22.669661 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-f2e79bb8-c0fd-4e37-9311-977e64b38035 service neutron] For port b2c052d8-c7f4-4790-afab-5f3766f86877, host hv-cinder-81632, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=b2c052d8-c7f4-4790-afab-5f3766f86877,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108542) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:54:22.772872 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-f2e79bb8-c0fd-4e37-9311-977e64b38035 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126476609'] for port, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:22.812345 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-f2e79bb8-c0fd-4e37-9311-977e64b38035 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:22.813023 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-f2e79bb8-c0fd-4e37-9311-977e64b38035 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:22.814519 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-f2e79bb8-c0fd-4e37-9311-977e64b38035 service neutron] 10.222.0.90 "PUT /v2.0/ports/b2c052d8-c7f4-4790-afab-5f3766f86877 HTTP/1.1" status: 200 len: 1093 time: 0.9855497 Nov 02 12:54:22.815006 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a1984910-3b5c-43f5-8727-1c65226b3983', 'tag': 'b2c052d8-c7f4-4790-afab-5f3766f86877'}] {{(pid=108542) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:54:22.817542 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8fdc2194739644bb754d6b187539f80d2eba7dc5c5d5392f1a2d22d03c0a316c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f136ee2c-3aa1-4a69-8952-24c7aa3e69ca" -d '{"events": [{"name": "network-changed", "server_uuid": "a1984910-3b5c-43f5-8727-1c65226b3983", "tag": "b2c052d8-c7f4-4790-afab-5f3766f86877"}]}' {{(pid=108542) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:54:22.859348 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f2e79bb8-c0fd-4e37-9311-977e64b38035 service neutron] Pushing event updated for resources: {'Port': ['ID=b2c052d8-c7f4-4790-afab-5f3766f86877,revision_number=3']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:22.877659 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:54:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-70285d43-1323-4636-a540-0debb2797258 x-openstack-request-id: req-70285d43-1323-4636-a540-0debb2797258 {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:54:22.877940 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a1984910-3b5c-43f5-8727-1c65226b3983", "tag": "b2c052d8-c7f4-4790-afab-5f3766f86877", "status": "completed", "code": 200}]} {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:54:22.878194 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-70285d43-1323-4636-a540-0debb2797258 {{(pid=108542) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:54:22.878632 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a1984910-3b5c-43f5-8727-1c65226b3983', 'tag': 'b2c052d8-c7f4-4790-afab-5f3766f86877', 'status': 'completed', 'code': 200} Nov 02 12:54:22.958451 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f136ee2c-3aa1-4a69-8952-24c7aa3e69ca req-6fee3d1b-727f-4b5c-9026-f6e8bc7e4c28 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:22.961142 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-f136ee2c-3aa1-4a69-8952-24c7aa3e69ca req-6fee3d1b-727f-4b5c-9026-f6e8bc7e4c28 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=aaddc046689441b8ab3641f2afd07c0e&device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 1096 time: 0.0512178 Nov 02 12:54:23.097860 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f136ee2c-3aa1-4a69-8952-24c7aa3e69ca req-edcad593-d7f9-4e43-bf12-0d1fccc49255 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:23.099302 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-f136ee2c-3aa1-4a69-8952-24c7aa3e69ca req-edcad593-d7f9-4e43-bf12-0d1fccc49255 service neutron] 10.222.0.90 "GET /v2.0/networks?tenant_id=aaddc046689441b8ab3641f2afd07c0e&shared=False HTTP/1.1" status: 200 len: 917 time: 0.1224511 Nov 02 12:54:23.221796 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f136ee2c-3aa1-4a69-8952-24c7aa3e69ca req-4b2ce228-2904-4df5-a844-4b89e8d67c63 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:23.223500 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-f136ee2c-3aa1-4a69-8952-24c7aa3e69ca req-4b2ce228-2904-4df5-a844-4b89e8d67c63 service neutron] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1169016 Nov 02 12:54:23.335015 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-1979561e-70c2-4983-bd84-15e62b5d7532 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:23.336947 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-1979561e-70c2-4983-bd84-15e62b5d7532 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=aaddc046689441b8ab3641f2afd07c0e&device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 1096 time: 0.0419254 Nov 02 12:54:23.355660 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f715e171-8137-4f33-9f13-86fd024ffae7 req-aaa768b1-c945-44fd-b63d-57145de73ee8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:23.357180 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f715e171-8137-4f33-9f13-86fd024ffae7 req-aaa768b1-c945-44fd-b63d-57145de73ee8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 943 time: 0.0515137 Nov 02 12:54:23.383655 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-b2b8d478-4de5-4350-a2d9-07f6b858bb3f service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b2c052d8-c7f4-4790-afab-5f3766f86877 HTTP/1.1" status: 200 len: 217 time: 0.0348327 Nov 02 12:54:23.411929 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f715e171-8137-4f33-9f13-86fd024ffae7 req-940fc996-fac3-40ec-8935-bc6f139b20a8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482130 Nov 02 12:54:23.441620 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-d2023eab-3f81-43f5-b2fa-07d43533e8f6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:23.443379 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-d2023eab-3f81-43f5-b2fa-07d43533e8f6 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=ec48fe57-a1cd-4e7c-874f-073624f71f4b HTTP/1.1" status: 200 len: 855 time: 0.0523238 Nov 02 12:54:23.505131 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-5db4a4b2-8988-4c35-93ec-2587cd1d9441 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:23.506858 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-5db4a4b2-8988-4c35-93ec-2587cd1d9441 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=c468f0e1-3636-49b9-90c6-b90c643ed7d1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0562372 Nov 02 12:54:23.572165 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-a896dfab-232b-45cb-abc3-27ff452838ef None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:23.609430 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-6909c84a-fca0-487e-95c3-1fb62b1d190c service neutron] 10.222.0.90 "GET /v2.0/networks/c468f0e1-3636-49b9-90c6-b90c643ed7d1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0893600 Nov 02 12:54:23.724996 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-a451eb66-3b58-45ff-b770-7858bb638e89 req-e044c2fa-b343-4bc6-8ecd-d23d2540cc79 service neutron] 10.222.0.90 "GET /v2.0/networks/c468f0e1-3636-49b9-90c6-b90c643ed7d1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1038620 Nov 02 12:54:24.265731 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 33304) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:24.422486 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-cccb8c36-e596-42f4-83a3-a5e1259c388f admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:24.513368 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-cccb8c36-e596-42f4-83a3-a5e1259c388f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:24.567650 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7c26043b-51a7-47f5-b466-ab1e4d628694 req-abffa980-90fe-46b2-8cf4-b0d11ec988dc tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:24.569154 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7c26043b-51a7-47f5-b466-ab1e4d628694 req-abffa980-90fe-46b2-8cf4-b0d11ec988dc tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 943 time: 0.0700662 Nov 02 12:54:24.583004 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-cccb8c36-e596-42f4-83a3-a5e1259c388f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:24.620920 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-cccb8c36-e596-42f4-83a3-a5e1259c388f admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=a8f0cfc7444f45e89e481fe083222d20&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3540328 Nov 02 12:54:24.624313 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 33310) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:24.626041 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7c26043b-51a7-47f5-b466-ab1e4d628694 req-8cb37c2a-2953-4e5f-ba3f-bc5c6dc7ffe3 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0506291 Nov 02 12:54:24.632419 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-cccb8c36-e596-42f4-83a3-a5e1259c388f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=24736d84-24a3-485e-b4a3-2917db08dd8e,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:24.684627 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-ba72fcc7-ad71-45a3-aae9-934ce07fabfa admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:24.712666 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-ba72fcc7-ad71-45a3-aae9-934ce07fabfa admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:24.785473 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device b2c052d8-c7f4-4790-afab-5f3766f86877 details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 12:54:24.851901 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-ba72fcc7-ad71-45a3-aae9-934ce07fabfa admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:24.854591 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-ba72fcc7-ad71-45a3-aae9-934ce07fabfa admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:24.855778 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-ba72fcc7-ad71-45a3-aae9-934ce07fabfa admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/24736d84-24a3-485e-b4a3-2917db08dd8e HTTP/1.1" status: 204 len: 168 time: 0.2305479 Nov 02 12:54:24.864021 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba72fcc7-ad71-45a3-aae9-934ce07fabfa admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=24736d84-24a3-485e-b4a3-2917db08dd8e,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:24.910653 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port b2c052d8-c7f4-4790-afab-5f3766f86877, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=b2c052d8-c7f4-4790-afab-5f3766f86877,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:54:24.933945 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': 'b2c052d8-c7f4-4790-afab-5f3766f86877', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'port_id': 'b2c052d8-c7f4-4790-afab-5f3766f86877', 'mac_address': 'fa:16:3e:94:a8:39', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 854, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 12:54:24.980117 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:25.000150 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b2c052d8-c7f4-4790-afab-5f3766f86877 {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:54:25.023286 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port b2c052d8-c7f4-4790-afab-5f3766f86877, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=b2c052d8-c7f4-4790-afab-5f3766f86877,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:54:25.109310 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:25.159527 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=b2c052d8-c7f4-4790-afab-5f3766f86877,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:25.167174 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:25.167518 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:25.167854 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:25.168180 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:25.168505 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:25.168864 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:25.169146 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:25.169465 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:25.169782 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:25.170097 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:25.170585 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:25.170922 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:25.405188 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['b2c052d8-c7f4-4790-afab-5f3766f86877'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:54:25.635265 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-20c3a2dc-2e7c-4c54-9fa8-713fc4f8e358 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:25.727099 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 33322) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:25.742072 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-de116b73-c927-48df-9128-ebf94d3a0520 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:25.750715 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d0b78e57-fb94-4b77-81f7-4c9af845f552 req-a48fa9ec-5c5a-4cfb-89cf-df5d0a57cb6b tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:25.752222 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d0b78e57-fb94-4b77-81f7-4c9af845f552 req-a48fa9ec-5c5a-4cfb-89cf-df5d0a57cb6b tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 944 time: 0.0524385 Nov 02 12:54:25.803968 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d0b78e57-fb94-4b77-81f7-4c9af845f552 req-4de3b17d-fb34-44a3-8f3c-eddeb7412489 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449831 Nov 02 12:54:25.823207 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-de116b73-c927-48df-9128-ebf94d3a0520 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:25.914463 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-de116b73-c927-48df-9128-ebf94d3a0520 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:25.953878 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-de116b73-c927-48df-9128-ebf94d3a0520 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=8fa8936de23d4e6db229229483bea6ab&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2254934 Nov 02 12:54:25.954606 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-de116b73-c927-48df-9128-ebf94d3a0520 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=79abfa48-3697-4367-b597-1357008644bc,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:25.956618 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 33324) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:26.007187 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7d984548-f835-42dd-802e-6ab309005b99 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:26.032634 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7d984548-f835-42dd-802e-6ab309005b99 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:26.166215 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7d984548-f835-42dd-802e-6ab309005b99 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:26.169092 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7d984548-f835-42dd-802e-6ab309005b99 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:26.170267 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-7d984548-f835-42dd-802e-6ab309005b99 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/79abfa48-3697-4367-b597-1357008644bc HTTP/1.1" status: 204 len: 168 time: 0.2126672 Nov 02 12:54:26.178437 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7d984548-f835-42dd-802e-6ab309005b99 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=79abfa48-3697-4367-b597-1357008644bc,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:26.785729 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device b2c052d8-c7f4-4790-afab-5f3766f86877 up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:54:26.892117 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:26.971595 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning for port b2c052d8-c7f4-4790-afab-5f3766f86877 completed by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 02 12:54:26.976392 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port b2c052d8-c7f4-4790-afab-5f3766f86877 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:54:26.976893 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:27.059325 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:27.084897 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a1984910-3b5c-43f5-8727-1c65226b3983', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b2c052d8-c7f4-4790-afab-5f3766f86877'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:54:27.087159 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-b9d23401-605c-4347-a141-904213f88d17" -d '{"events": [{"server_uuid": "a1984910-3b5c-43f5-8727-1c65226b3983", "name": "network-vif-plugged", "status": "completed", "tag": "b2c052d8-c7f4-4790-afab-5f3766f86877"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:54:27.100737 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port b2c052d8-c7f4-4790-afab-5f3766f86877, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=b2c052d8-c7f4-4790-afab-5f3766f86877,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:54:27.152382 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:54:27 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-fafbd7f5-5c66-48c7-a8ee-e63ee45c9948 x-openstack-request-id: req-fafbd7f5-5c66-48c7-a8ee-e63ee45c9948 {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:54:27.152693 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a1984910-3b5c-43f5-8727-1c65226b3983", "name": "network-vif-plugged", "status": "completed", "tag": "b2c052d8-c7f4-4790-afab-5f3766f86877", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:54:27.152941 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-fafbd7f5-5c66-48c7-a8ee-e63ee45c9948 {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:54:27.153430 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a1984910-3b5c-43f5-8727-1c65226b3983', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b2c052d8-c7f4-4790-afab-5f3766f86877', 'code': 200} Nov 02 12:54:27.178644 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dd7d260-b1e4-4aaa-a555-c78dace5b67c req-ce3d8f43-2020-4b0b-8dff-97545adb699b tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:27.180351 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1dd7d260-b1e4-4aaa-a555-c78dace5b67c req-ce3d8f43-2020-4b0b-8dff-97545adb699b tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 944 time: 0.0657842 Nov 02 12:54:27.204782 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:27.238990 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1dd7d260-b1e4-4aaa-a555-c78dace5b67c req-0ea8f179-f95b-4c74-826e-341ad34bca06 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0517192 Nov 02 12:54:27.274441 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=b2c052d8-c7f4-4790-afab-5f3766f86877,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:27.535325 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8ce884a7-7e12-4762-af6a-566e4aefc5df req-ab1f6e9f-b91b-4498-a2d4-0829c657bf97 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:27.535325 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-8ce884a7-7e12-4762-af6a-566e4aefc5df req-ab1f6e9f-b91b-4498-a2d4-0829c657bf97 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 1098 time: 0.0412223 Nov 02 12:54:27.589798 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-8ce884a7-7e12-4762-af6a-566e4aefc5df req-b7caf6c9-83eb-4647-991c-e7fd86beac67 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443568 Nov 02 12:54:28.332045 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:28.362315 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d3148c0-b8e2-4b32-ac3c-e62758836130 req-723eb9c5-7fe5-4606-b4b8-00d0c6841fd1 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:28.363894 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2d3148c0-b8e2-4b32-ac3c-e62758836130 req-723eb9c5-7fe5-4606-b4b8-00d0c6841fd1 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0510273 Nov 02 12:54:28.459426 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2d3148c0-b8e2-4b32-ac3c-e62758836130 req-3205837f-cb27-4ded-badd-71263eec07c1 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0722663 Nov 02 12:54:29.253575 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 33398) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:29.364252 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-94b062e9-2141-48f2-bfdb-a07c4f4e464b admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:29.446463 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-94b062e9-2141-48f2-bfdb-a07c4f4e464b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:29.571707 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-025ac475-97eb-460d-8fcb-2be1b12f9a54 req-d61d754b-49f7-41ed-8edc-964207addd47 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:29.573325 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-025ac475-97eb-460d-8fcb-2be1b12f9a54 req-d61d754b-49f7-41ed-8edc-964207addd47 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0534127 Nov 02 12:54:29.595323 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-94b062e9-2141-48f2-bfdb-a07c4f4e464b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:29.651266 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-94b062e9-2141-48f2-bfdb-a07c4f4e464b admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=b3f358c330404974885d94f670d1e903&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3965871 Nov 02 12:54:29.654025 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 33412) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:29.658187 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-94b062e9-2141-48f2-bfdb-a07c4f4e464b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=f4c804fe-358a-4d5a-8fd0-5caaddff368c,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:29.671824 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-025ac475-97eb-460d-8fcb-2be1b12f9a54 req-23bc8b72-465f-4b85-9638-606892e292cb tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0920522 Nov 02 12:54:29.673731 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94b062e9-2141-48f2-bfdb-a07c4f4e464b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:29.673731 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94b062e9-2141-48f2-bfdb-a07c4f4e464b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:29.673941 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94b062e9-2141-48f2-bfdb-a07c4f4e464b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:29.674115 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94b062e9-2141-48f2-bfdb-a07c4f4e464b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:29.674509 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94b062e9-2141-48f2-bfdb-a07c4f4e464b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:29.674907 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94b062e9-2141-48f2-bfdb-a07c4f4e464b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:29.675265 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94b062e9-2141-48f2-bfdb-a07c4f4e464b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:29.675542 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94b062e9-2141-48f2-bfdb-a07c4f4e464b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:29.675868 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94b062e9-2141-48f2-bfdb-a07c4f4e464b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:29.676189 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94b062e9-2141-48f2-bfdb-a07c4f4e464b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:29.676506 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94b062e9-2141-48f2-bfdb-a07c4f4e464b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:29.676820 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-94b062e9-2141-48f2-bfdb-a07c4f4e464b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:29.716854 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-df9b5de3-79d4-452c-9608-977765ec19a4 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:29.741361 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-df9b5de3-79d4-452c-9608-977765ec19a4 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:29.804237 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8e196184-2832-4b66-8860-4cf6a9746456 req-0e2913d4-6566-4ad7-88fe-04de89f3c666 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:29.805718 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8e196184-2832-4b66-8860-4cf6a9746456 req-0e2913d4-6566-4ad7-88fe-04de89f3c666 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0519135 Nov 02 12:54:29.814132 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 33416) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:29.818725 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-39df62d5-9ca2-4e5e-a39e-0259e9f6f610 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Request body: {'floatingip': {'port_id': 'b2c052d8-c7f4-4790-afab-5f3766f86877'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:54:29.862743 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-39df62d5-9ca2-4e5e-a39e-0259e9f6f610 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for floatingip, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:29.891866 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-df9b5de3-79d4-452c-9608-977765ec19a4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:29.894659 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-df9b5de3-79d4-452c-9608-977765ec19a4 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:29.895884 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-df9b5de3-79d4-452c-9608-977765ec19a4 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/f4c804fe-358a-4d5a-8fd0-5caaddff368c HTTP/1.1" status: 204 len: 168 time: 0.2407348 Nov 02 12:54:29.904834 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-df9b5de3-79d4-452c-9608-977765ec19a4 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=f4c804fe-358a-4d5a-8fd0-5caaddff368c,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:30.067369 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 33422) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:30.288844 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-6018f9f3-a769-4241-b747-3bb8497a61db admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:30.365266 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-39df62d5-9ca2-4e5e-a39e-0259e9f6f610 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:30.380218 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-6018f9f3-a769-4241-b747-3bb8497a61db admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:30.457588 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-6018f9f3-a769-4241-b747-3bb8497a61db admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:30.457850 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-39df62d5-9ca2-4e5e-a39e-0259e9f6f610 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1594992'] for floatingip, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:30.499551 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-6018f9f3-a769-4241-b747-3bb8497a61db admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=14ddc26987bc48bd908e49beb4efeb7d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4308195 Nov 02 12:54:30.502364 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 33428) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:30.509289 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6018f9f3-a769-4241-b747-3bb8497a61db admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=47de9eee-743f-4797-a255-cb6564b29250,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:30.567726 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.db.l3_db [None req-39df62d5-9ca2-4e5e-a39e-0259e9f6f610 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Floating IP e3501cd6-2b83-4251-9681-b015fefeca51 associated. External IP: 172.27.0.7, port: b2c052d8-c7f4-4790-afab-5f3766f86877. Nov 02 12:54:30.572102 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d3c4e1f7-6c20-4ff6-b936-61cf4d10bee1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:30.597722 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d3c4e1f7-6c20-4ff6-b936-61cf4d10bee1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:30.676261 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 33430) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:30.690847 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c3735eb5-b7f0-445f-b3ee-0a76504b9951 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:30.727937 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d3c4e1f7-6c20-4ff6-b936-61cf4d10bee1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:30.731276 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d3c4e1f7-6c20-4ff6-b936-61cf4d10bee1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:30.732443 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-d3c4e1f7-6c20-4ff6-b936-61cf4d10bee1 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/47de9eee-743f-4797-a255-cb6564b29250 HTTP/1.1" status: 204 len: 168 time: 0.2290766 Nov 02 12:54:30.752745 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3c4e1f7-6c20-4ff6-b936-61cf4d10bee1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=47de9eee-743f-4797-a255-cb6564b29250,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:30.811972 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:30.813391 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c3735eb5-b7f0-445f-b3ee-0a76504b9951 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:30.844338 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-39df62d5-9ca2-4e5e-a39e-0259e9f6f610 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Router 308142a4-46ba-42ef-a1f2-5df4b969cc8f has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108543) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 12:54:30.891817 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c3735eb5-b7f0-445f-b3ee-0a76504b9951 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:30.940279 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-c3735eb5-b7f0-445f-b3ee-0a76504b9951 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=7388aab580ba4ad6b61fd7a3355b4f16&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2616694 Nov 02 12:54:30.941400 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c3735eb5-b7f0-445f-b3ee-0a76504b9951 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=88bf670c-beeb-4728-9c94-eda9d826dd3f,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:30.943866 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 33436) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:31.002041 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-39df62d5-9ca2-4e5e-a39e-0259e9f6f610 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108543) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:54:31.007622 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-39df62d5-9ca2-4e5e-a39e-0259e9f6f610 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for floatingip, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:31.012249 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11e2c684-03a3-46e2-81df-e16dd9270415 None None] Sync routers for ids ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'] in dv-cinder-816324-1-iscsi {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:54:31.021942 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11e2c684-03a3-46e2-81df-e16dd9270415 None None] Routers {'308142a4-46ba-42ef-a1f2-5df4b969cc8f'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:54:31.022839 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-11e2c684-03a3-46e2-81df-e16dd9270415 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:54:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:54:31.048450 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-39df62d5-9ca2-4e5e-a39e-0259e9f6f610 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "PUT /v2.0/floatingips/e3501cd6-2b83-4251-9681-b015fefeca51 HTTP/1.1" status: 200 len: 989 time: 1.2331934 Nov 02 12:54:31.049149 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'a1984910-3b5c-43f5-8727-1c65226b3983', 'tag': 'b2c052d8-c7f4-4790-afab-5f3766f86877'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:54:31.052053 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-fae92fd2-3708-45e5-b938-a42f7638a5dd" -d '{"events": [{"name": "network-changed", "server_uuid": "a1984910-3b5c-43f5-8727-1c65226b3983", "tag": "b2c052d8-c7f4-4790-afab-5f3766f86877"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:54:31.054663 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-51f0e5a1-3d42-4d8f-9b54-55c86e501718 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:31.080614 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-51f0e5a1-3d42-4d8f-9b54-55c86e501718 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:31.111014 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:54:31 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-73abe16a-07ce-4af5-a3b8-841bdef5509c x-openstack-request-id: req-73abe16a-07ce-4af5-a3b8-841bdef5509c {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:54:31.111334 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "a1984910-3b5c-43f5-8727-1c65226b3983", "tag": "b2c052d8-c7f4-4790-afab-5f3766f86877", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:54:31.111597 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-73abe16a-07ce-4af5-a3b8-841bdef5509c {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:54:31.112202 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'a1984910-3b5c-43f5-8727-1c65226b3983', 'tag': 'b2c052d8-c7f4-4790-afab-5f3766f86877', 'status': 'completed', 'code': 200} Nov 02 12:54:31.180098 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-11e2c684-03a3-46e2-81df-e16dd9270415 None None] Set router 308142a4-46ba-42ef-a1f2-5df4b969cc8f gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:54:31.224281 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-51f0e5a1-3d42-4d8f-9b54-55c86e501718 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:31.228146 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-51f0e5a1-3d42-4d8f-9b54-55c86e501718 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:31.231641 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-51f0e5a1-3d42-4d8f-9b54-55c86e501718 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/88bf670c-beeb-4728-9c94-eda9d826dd3f HTTP/1.1" status: 204 len: 168 time: 0.2832749 Nov 02 12:54:31.238962 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-51f0e5a1-3d42-4d8f-9b54-55c86e501718 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=88bf670c-beeb-4728-9c94-eda9d826dd3f,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:31.316628 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae92fd2-3708-45e5-b938-a42f7638a5dd req-829b1d79-dcfd-41d3-bb63-17adef0b2564 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:31.318308 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-fae92fd2-3708-45e5-b938-a42f7638a5dd req-829b1d79-dcfd-41d3-bb63-17adef0b2564 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=aaddc046689441b8ab3641f2afd07c0e&device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 1098 time: 0.1747735 Nov 02 12:54:31.428147 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae92fd2-3708-45e5-b938-a42f7638a5dd req-faad9376-7110-45bd-9b19-2d660bf1b6f4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:31.429681 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-fae92fd2-3708-45e5-b938-a42f7638a5dd req-faad9376-7110-45bd-9b19-2d660bf1b6f4 service neutron] 10.222.0.90 "GET /v2.0/networks?id=c468f0e1-3636-49b9-90c6-b90c643ed7d1 HTTP/1.1" status: 200 len: 917 time: 0.1034422 Nov 02 12:54:31.463345 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-11e2c684-03a3-46e2-81df-e16dd9270415 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'name': 'tempest-AttachVolumeShelveTestJSON-199949485-router', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207'}], 'enable_snat': True}, 'gw_port_id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:49:22Z', 'revision_number': 4, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'gw_port': {'id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:4a:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:12Z', 'updated_at': '2021-11-02T12:49:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': 'e3501cd6-2b83-4251-9681-b015fefeca51', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'floating_ip_address': '172.27.0.7', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'port_id': 'b2c052d8-c7f4-4790-afab-5f3766f86877', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 496, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'mac_address': 'fa:16:3e:94:a8:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1984910-3b5c-43f5-8727-1c65226b3983', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:54:15Z', 'updated_at': '2021-11-02T12:54:30Z', 'revision_number': 1, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '91fe3ff8-cdf3-4761-8b27-27e55f6f6690', 'name': '', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'mac_address': 'fa:16:3e:51:73:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:20Z', 'updated_at': '2021-11-02T12:49:34Z', 'revision_number': 5, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'subnets': [{'id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:54:31.494982 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11e2c684-03a3-46e2-81df-e16dd9270415 None None] Checking router: 308142a4-46ba-42ef-a1f2-5df4b969cc8f for host: dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:54:31.505664 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-11e2c684-03a3-46e2-81df-e16dd9270415 None None] Routers {'308142a4-46ba-42ef-a1f2-5df4b969cc8f'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:54:31.506733 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-11e2c684-03a3-46e2-81df-e16dd9270415 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:54:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:54:31.515275 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-fae92fd2-3708-45e5-b938-a42f7638a5dd req-8fdf6f48-2145-4430-8187-44346e5ccf16 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b2c052d8-c7f4-4790-afab-5f3766f86877 HTTP/1.1" status: 200 len: 997 time: 0.0775628 Nov 02 12:54:31.570978 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae92fd2-3708-45e5-b938-a42f7638a5dd req-73057530-1d98-4dc2-a2cc-89703ad857ae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:31.572624 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-fae92fd2-3708-45e5-b938-a42f7638a5dd req-73057530-1d98-4dc2-a2cc-89703ad857ae service neutron] 10.222.0.90 "GET /v2.0/subnets?id=ec48fe57-a1cd-4e7c-874f-073624f71f4b HTTP/1.1" status: 200 len: 855 time: 0.0505793 Nov 02 12:54:31.625966 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fae92fd2-3708-45e5-b938-a42f7638a5dd req-9ac814d0-0862-449c-a248-01a54c866ca5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:54:31.627629 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-fae92fd2-3708-45e5-b938-a42f7638a5dd req-9ac814d0-0862-449c-a248-01a54c866ca5 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=c468f0e1-3636-49b9-90c6-b90c643ed7d1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0479760 Nov 02 12:54:31.671402 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 33448) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:31.689105 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f5187dd7-9b23-400f-a502-9533e01f407c admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:31.751630 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-fae92fd2-3708-45e5-b938-a42f7638a5dd req-738b46d1-5154-4b83-a2ff-4bc60c924f09 service neutron] 10.222.0.90 "GET /v2.0/networks/c468f0e1-3636-49b9-90c6-b90c643ed7d1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1166098 Nov 02 12:54:31.761599 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-11e2c684-03a3-46e2-81df-e16dd9270415 None None] Set router 308142a4-46ba-42ef-a1f2-5df4b969cc8f gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:54:31.797268 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f5187dd7-9b23-400f-a502-9533e01f407c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:31.864369 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-fae92fd2-3708-45e5-b938-a42f7638a5dd req-68eefdbc-e80d-48ed-84e0-a90be90722e7 service neutron] 10.222.0.90 "GET /v2.0/networks/c468f0e1-3636-49b9-90c6-b90c643ed7d1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1054173 Nov 02 12:54:31.954846 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f5187dd7-9b23-400f-a502-9533e01f407c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:31.997560 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-f5187dd7-9b23-400f-a502-9533e01f407c admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=8a40871671a84c6bb22b4c8953d5e2d9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3224335 Nov 02 12:54:31.997763 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 33458) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:32.005766 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f5187dd7-9b23-400f-a502-9533e01f407c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=da40540d-31e6-41b7-a6fd-ad960fb7bc99,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:32.005970 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-11e2c684-03a3-46e2-81df-e16dd9270415 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'name': 'tempest-AttachVolumeShelveTestJSON-199949485-router', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207'}], 'enable_snat': True}, 'gw_port_id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:49:22Z', 'revision_number': 4, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'gw_port': {'id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:4a:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:12Z', 'updated_at': '2021-11-02T12:49:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': 'e3501cd6-2b83-4251-9681-b015fefeca51', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'floating_ip_address': '172.27.0.7', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'port_id': 'b2c052d8-c7f4-4790-afab-5f3766f86877', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 496, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'mac_address': 'fa:16:3e:94:a8:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1984910-3b5c-43f5-8727-1c65226b3983', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:54:15Z', 'updated_at': '2021-11-02T12:54:30Z', 'revision_number': 1, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '91fe3ff8-cdf3-4761-8b27-27e55f6f6690', 'name': '', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'mac_address': 'fa:16:3e:51:73:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:20Z', 'updated_at': '2021-11-02T12:49:34Z', 'revision_number': 5, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'subnets': [{'id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:54:32.036216 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-11e2c684-03a3-46e2-81df-e16dd9270415 None None] The sync data for ids ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'] in dv-cinder-816324-1-iscsi is: [{'id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'name': 'tempest-AttachVolumeShelveTestJSON-199949485-router', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207'}], 'enable_snat': True}, 'gw_port_id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:49:22Z', 'revision_number': 4, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'gw_port': {'id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:4a:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:12Z', 'updated_at': '2021-11-02T12:49:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': 'e3501cd6-2b83-4251-9681-b015fefeca51', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'floating_ip_address': '172.27.0.7', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'port_id': 'b2c052d8-c7f4-4790-afab-5f3766f86877', 'fixed_ip_address': '172.20.0.8', 'status': 'DOWN', 'standard_attr_id': 496, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'mac_address': 'fa:16:3e:94:a8:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a1984910-3b5c-43f5-8727-1c65226b3983', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:54:15Z', 'updated_at': '2021-11-02T12:54:30Z', 'revision_number': 1, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '91fe3ff8-cdf3-4761-8b27-27e55f6f6690', 'name': '', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'mac_address': 'fa:16:3e:51:73:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:20Z', 'updated_at': '2021-11-02T12:49:34Z', 'revision_number': 5, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'subnets': [{'id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:54:32.054841 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-07445706-219e-4f12-99a7-d037d7727d50 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:32.081007 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-07445706-219e-4f12-99a7-d037d7727d50 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:32.216404 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-07445706-219e-4f12-99a7-d037d7727d50 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:32.218975 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-07445706-219e-4f12-99a7-d037d7727d50 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:32.223724 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-07445706-219e-4f12-99a7-d037d7727d50 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/da40540d-31e6-41b7-a6fd-ad960fb7bc99 HTTP/1.1" status: 204 len: 168 time: 0.2219207 Nov 02 12:54:32.228902 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-07445706-219e-4f12-99a7-d037d7727d50 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=da40540d-31e6-41b7-a6fd-ad960fb7bc99,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:32.291310 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-798deb24-86a3-47e8-a14d-43ba80b8ab76 None None] New status for floating IP e3501cd6-2b83-4251-9681-b015fefeca51: ACTIVE {{(pid=108545) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 02 12:54:33.394708 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:37.331390 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 33570) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:37.441153 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f0ff036b-99a4-4ba6-b685-62484612a649 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:37.547300 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f0ff036b-99a4-4ba6-b685-62484612a649 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:37.623013 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f0ff036b-99a4-4ba6-b685-62484612a649 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:37.654610 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f0ff036b-99a4-4ba6-b685-62484612a649 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=9d6c5448-4a9b-47c5-9c86-19e0fabd714a,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:37.664757 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0ff036b-99a4-4ba6-b685-62484612a649 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:37.669078 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0ff036b-99a4-4ba6-b685-62484612a649 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:37.669078 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0ff036b-99a4-4ba6-b685-62484612a649 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:37.669078 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0ff036b-99a4-4ba6-b685-62484612a649 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:37.669078 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0ff036b-99a4-4ba6-b685-62484612a649 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:37.669078 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0ff036b-99a4-4ba6-b685-62484612a649 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:37.669078 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0ff036b-99a4-4ba6-b685-62484612a649 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:37.669078 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0ff036b-99a4-4ba6-b685-62484612a649 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:37.669078 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0ff036b-99a4-4ba6-b685-62484612a649 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:37.669078 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0ff036b-99a4-4ba6-b685-62484612a649 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:37.669078 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0ff036b-99a4-4ba6-b685-62484612a649 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:37.669078 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f0ff036b-99a4-4ba6-b685-62484612a649 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:54:37.684952 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 33578) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:37.685409 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-f0ff036b-99a4-4ba6-b685-62484612a649 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=8053d836f4914000b2a338a1f3239ba4&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3525312 Nov 02 12:54:37.709941 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 33580) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:37.739001 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-560d2562-9689-4ae2-8488-526d276fc1e7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:37.765209 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-560d2562-9689-4ae2-8488-526d276fc1e7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:37.824340 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f4939a4b-6935-43ff-989a-53127fe5a699 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:37.931822 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-560d2562-9689-4ae2-8488-526d276fc1e7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:37.934448 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-560d2562-9689-4ae2-8488-526d276fc1e7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:37.935619 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-560d2562-9689-4ae2-8488-526d276fc1e7 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/9d6c5448-4a9b-47c5-9c86-19e0fabd714a HTTP/1.1" status: 204 len: 168 time: 0.2496829 Nov 02 12:54:37.948786 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-560d2562-9689-4ae2-8488-526d276fc1e7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9d6c5448-4a9b-47c5-9c86-19e0fabd714a,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:37.992958 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f4939a4b-6935-43ff-989a-53127fe5a699 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:38.148602 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f4939a4b-6935-43ff-989a-53127fe5a699 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:38.188860 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-f4939a4b-6935-43ff-989a-53127fe5a699 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=b843f5c8d38a4742aa4781763f5d35ea&name=default HTTP/1.1" status: 200 len: 2996 time: 0.4775381 Nov 02 12:54:38.189653 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f4939a4b-6935-43ff-989a-53127fe5a699 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=d8ff9c38-5680-43e9-81f9-9bca42740bd9,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:38.192595 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 33586) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:38.246309 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bebf4046-ee39-49d1-a9ae-433723c188b1 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:38.268845 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bebf4046-ee39-49d1-a9ae-433723c188b1 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:38.417625 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bebf4046-ee39-49d1-a9ae-433723c188b1 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:38.421312 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bebf4046-ee39-49d1-a9ae-433723c188b1 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:38.422501 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-bebf4046-ee39-49d1-a9ae-433723c188b1 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/d8ff9c38-5680-43e9-81f9-9bca42740bd9 HTTP/1.1" status: 204 len: 168 time: 0.2285097 Nov 02 12:54:38.430845 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bebf4046-ee39-49d1-a9ae-433723c188b1 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=d8ff9c38-5680-43e9-81f9-9bca42740bd9,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:39.194620 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 33616) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:39.213066 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-762d4392-ec6f-4503-a04c-d45b00fd0258 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:39.293471 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-762d4392-ec6f-4503-a04c-d45b00fd0258 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:39.383051 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-762d4392-ec6f-4503-a04c-d45b00fd0258 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:39.427059 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-762d4392-ec6f-4503-a04c-d45b00fd0258 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=4e7ad3294b52456db932493247a2b837&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2307572 Nov 02 12:54:39.428012 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-762d4392-ec6f-4503-a04c-d45b00fd0258 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=afafa57c-b2e1-4bf8-9446-1c1114bf113a,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:39.430125 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 33620) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:39.494593 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-15eec6a9-ad84-44ba-93ff-a026e29df73a admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:39.517935 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-15eec6a9-ad84-44ba-93ff-a026e29df73a admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:39.714793 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-15eec6a9-ad84-44ba-93ff-a026e29df73a admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:39.717381 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-15eec6a9-ad84-44ba-93ff-a026e29df73a admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:39.718600 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-15eec6a9-ad84-44ba-93ff-a026e29df73a admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/afafa57c-b2e1-4bf8-9446-1c1114bf113a HTTP/1.1" status: 204 len: 168 time: 0.2862480 Nov 02 12:54:39.728442 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-15eec6a9-ad84-44ba-93ff-a026e29df73a admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=afafa57c-b2e1-4bf8-9446-1c1114bf113a,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:40.016791 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 33628) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:40.130741 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-6c894963-451f-4950-9ebc-f9addbf45bed admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:40.223548 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-6c894963-451f-4950-9ebc-f9addbf45bed admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:40.336348 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-6c894963-451f-4950-9ebc-f9addbf45bed admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:40.376345 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-6c894963-451f-4950-9ebc-f9addbf45bed admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=4b5826ded65a4a27abc7c661f4273261&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3584373 Nov 02 12:54:40.377453 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6c894963-451f-4950-9ebc-f9addbf45bed admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=70e497e0-27d9-48be-ba1b-c371fd68e5dc,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:40.379098 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 33640) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:54:40.435231 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c172d37e-ce2c-4f97-adae-b0e57f7663e0 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:40.457720 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c172d37e-ce2c-4f97-adae-b0e57f7663e0 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:40.619854 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c172d37e-ce2c-4f97-adae-b0e57f7663e0 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:40.619854 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c172d37e-ce2c-4f97-adae-b0e57f7663e0 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:40.619854 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-c172d37e-ce2c-4f97-adae-b0e57f7663e0 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/70e497e0-27d9-48be-ba1b-c371fd68e5dc HTTP/1.1" status: 204 len: 168 time: 0.2396846 Nov 02 12:54:40.628085 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c172d37e-ce2c-4f97-adae-b0e57f7663e0 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=70e497e0-27d9-48be-ba1b-c371fd68e5dc,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:54:53.495784 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c4c1161a-95e6-4743-be35-0248233409d4 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:55.470640 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:54:55.634174 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c4b3ecdb-3e06-4776-aa63-64485c459f8d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:56.897848 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:54:58.388310 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:00.902427 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:02.074193 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 33818) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:55:02.177621 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-5b599c71-5397-427a-afa7-025b1b4fb187 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:02.251227 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-5b599c71-5397-427a-afa7-025b1b4fb187 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:02.369583 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-5b599c71-5397-427a-afa7-025b1b4fb187 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:02.409251 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-5b599c71-5397-427a-afa7-025b1b4fb187 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=c5694ed000134661ac2cd1f22ec6bcde&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3328669 Nov 02 12:55:02.410047 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5b599c71-5397-427a-afa7-025b1b4fb187 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=34dc38bf-180b-42c3-9f6d-a78c606278f2,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:55:02.412197 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 33822) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:55:02.463489 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d29534b9-fc64-4418-8089-c94f845eb11c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:02.484897 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d29534b9-fc64-4418-8089-c94f845eb11c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:02.621719 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d29534b9-fc64-4418-8089-c94f845eb11c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:02.624411 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d29534b9-fc64-4418-8089-c94f845eb11c admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:02.625567 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-d29534b9-fc64-4418-8089-c94f845eb11c admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/34dc38bf-180b-42c3-9f6d-a78c606278f2 HTTP/1.1" status: 204 len: 168 time: 0.2123699 Nov 02 12:55:02.633787 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d29534b9-fc64-4418-8089-c94f845eb11c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=34dc38bf-180b-42c3-9f6d-a78c606278f2,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:55:03.348545 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:04.795327 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-41a85b92-a770-4078-967d-a5639cdf73fb req-d98b4f97-b9ea-4a71-886a-7424bfddbff5 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0528815 Nov 02 12:55:04.881346 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41a85b92-a770-4078-967d-a5639cdf73fb req-99486855-811b-4724-920a-4775ce345277 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:04.882882 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-41a85b92-a770-4078-967d-a5639cdf73fb req-99486855-811b-4724-920a-4775ce345277 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=d3bf5c9bdd7f479aa4cbc28f9a007c81&device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 1098 time: 0.0417836 Nov 02 12:55:04.988610 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41a85b92-a770-4078-967d-a5639cdf73fb req-89fe2996-7bf2-4af6-95a6-81782f6968fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:04.990090 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-41a85b92-a770-4078-967d-a5639cdf73fb req-89fe2996-7bf2-4af6-95a6-81782f6968fe service neutron] 10.222.0.90 "GET /v2.0/networks?id=adffa68a-25de-4006-9dcc-006cbedf32e3 HTTP/1.1" status: 200 len: 910 time: 0.0860600 Nov 02 12:55:05.059913 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-41a85b92-a770-4078-967d-a5639cdf73fb req-bf173014-9c76-49d8-bbfb-15fa01fcbce5 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=af83efde-b4cd-446b-9f74-15c631e4c45a HTTP/1.1" status: 200 len: 1000 time: 0.0619919 Nov 02 12:55:05.122344 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41a85b92-a770-4078-967d-a5639cdf73fb req-3d253ff1-9469-489c-a699-227152798ea7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:05.123956 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-41a85b92-a770-4078-967d-a5639cdf73fb req-3d253ff1-9469-489c-a699-227152798ea7 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=9a20b259-01c2-4b3f-8f92-0797a18ff7f7 HTTP/1.1" status: 200 len: 848 time: 0.0499310 Nov 02 12:55:05.171138 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41a85b92-a770-4078-967d-a5639cdf73fb req-63b4ce1c-b78e-4871-8391-d01ebfef9981 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:05.172674 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-41a85b92-a770-4078-967d-a5639cdf73fb req-63b4ce1c-b78e-4871-8391-d01ebfef9981 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=adffa68a-25de-4006-9dcc-006cbedf32e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0403857 Nov 02 12:55:05.269676 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-41a85b92-a770-4078-967d-a5639cdf73fb req-f5413b12-f9e7-4a9c-b394-eb0d85abbe00 service neutron] 10.222.0.90 "GET /v2.0/networks/adffa68a-25de-4006-9dcc-006cbedf32e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0870066 Nov 02 12:55:05.366128 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-41a85b92-a770-4078-967d-a5639cdf73fb req-61610150-dfff-4ea8-b50b-86b386406399 service neutron] 10.222.0.90 "GET /v2.0/networks/adffa68a-25de-4006-9dcc-006cbedf32e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0876834 Nov 02 12:55:11.828279 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-feca9f80-b5dc-4247-bd2e-e78cb2b882fd req-dcd710e3-4eaa-41b7-9530-11606d5750b3 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:11.830026 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-feca9f80-b5dc-4247-bd2e-e78cb2b882fd req-dcd710e3-4eaa-41b7-9530-11606d5750b3 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0546536 Nov 02 12:55:11.882726 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-feca9f80-b5dc-4247-bd2e-e78cb2b882fd req-5c043c6b-293a-49eb-ae3d-a6272ae98cf8 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457323 Nov 02 12:55:13.002777 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4d37a7d4-af62-4067-83fa-b833bfbb8f9e req-1d62331c-2b62-4ac4-92c5-cdb6cb4c40d6 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:13.004487 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4d37a7d4-af62-4067-83fa-b833bfbb8f9e req-1d62331c-2b62-4ac4-92c5-cdb6cb4c40d6 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0518081 Nov 02 12:55:13.054906 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4d37a7d4-af62-4067-83fa-b833bfbb8f9e req-900dd522-5876-411c-83ee-5cd44e6eb210 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440657 Nov 02 12:55:14.171868 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-475f45aa-820c-4967-95b9-bbc5512f0874 req-9fc315a1-6263-44a7-a6b8-2bbcd0a36125 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:14.173330 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-475f45aa-820c-4967-95b9-bbc5512f0874 req-9fc315a1-6263-44a7-a6b8-2bbcd0a36125 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0491900 Nov 02 12:55:14.227144 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-475f45aa-820c-4967-95b9-bbc5512f0874 req-ed54db59-6607-46ef-a55e-ec8fca602845 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0470080 Nov 02 12:55:14.819562 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 33942) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:55:14.926841 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f38207e7-47c6-4a8f-89a8-7233edacea2f admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:15.000429 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f38207e7-47c6-4a8f-89a8-7233edacea2f admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:15.125240 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f38207e7-47c6-4a8f-89a8-7233edacea2f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:15.164239 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-f38207e7-47c6-4a8f-89a8-7233edacea2f admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=1e04d34976a7426eb7abf12d8a747aa2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3435650 Nov 02 12:55:15.165112 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f38207e7-47c6-4a8f-89a8-7233edacea2f admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ed7ca467-07a2-4863-a24a-7a79e8102672,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:55:15.167040 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 33946) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:55:15.216253 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-18e40a84-d8e9-4d1a-9390-ab68e908ee31 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:15.238608 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-18e40a84-d8e9-4d1a-9390-ab68e908ee31 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:15.343531 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-05c0fc67-2218-4add-8bec-99db936937fc req-24ca13d9-c49c-409d-bedd-4bc8e6de19f9 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:15.344997 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-05c0fc67-2218-4add-8bec-99db936937fc req-24ca13d9-c49c-409d-bedd-4bc8e6de19f9 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0484540 Nov 02 12:55:15.390501 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-18e40a84-d8e9-4d1a-9390-ab68e908ee31 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:15.393058 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-18e40a84-d8e9-4d1a-9390-ab68e908ee31 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:15.394176 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-18e40a84-d8e9-4d1a-9390-ab68e908ee31 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/ed7ca467-07a2-4863-a24a-7a79e8102672 HTTP/1.1" status: 204 len: 168 time: 0.2261488 Nov 02 12:55:15.400515 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-05c0fc67-2218-4add-8bec-99db936937fc req-800bd6a9-4f6d-40bc-b065-788f7ffe45f6 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0489137 Nov 02 12:55:15.406968 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18e40a84-d8e9-4d1a-9390-ab68e908ee31 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ed7ca467-07a2-4863-a24a-7a79e8102672,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:55:16.523531 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-195ccfbd-a604-4155-8f32-0dd5b457b9e9 req-9f69d4cb-a419-4c40-8bf5-ab0530c41b8e tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:16.525183 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-195ccfbd-a604-4155-8f32-0dd5b457b9e9 req-9f69d4cb-a419-4c40-8bf5-ab0530c41b8e tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0543737 Nov 02 12:55:16.587380 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-195ccfbd-a604-4155-8f32-0dd5b457b9e9 req-17e7a095-640c-437f-a1f7-93a0faeca493 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0559826 Nov 02 12:55:17.279199 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fb2c8d4-740c-4fac-8579-6746145cde9c req-5b417975-3dc3-4370-8261-72155ee79506 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:17.279199 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1fb2c8d4-740c-4fac-8579-6746145cde9c req-5b417975-3dc3-4370-8261-72155ee79506 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0507102 Nov 02 12:55:17.320915 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1fb2c8d4-740c-4fac-8579-6746145cde9c req-3faea630-1565-4580-af4e-5ad2ab7289d3 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0421345 Nov 02 12:55:17.716253 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ab0e5c7b-c40e-472f-9572-be0014d97a8a req-38680b47-866b-46a8-b3e3-6c9a53620c84 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:17.717764 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ab0e5c7b-c40e-472f-9572-be0014d97a8a req-38680b47-866b-46a8-b3e3-6c9a53620c84 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0531290 Nov 02 12:55:17.767836 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ab0e5c7b-c40e-472f-9572-be0014d97a8a req-aaeae528-8083-40e3-a9e6-3e42023eb571 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435600 Nov 02 12:55:18.446646 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b113f9f-5581-495e-a8df-45855fc0216f req-11513c91-f77b-4806-9206-ac1faf9a3ca3 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:18.448037 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8b113f9f-5581-495e-a8df-45855fc0216f req-11513c91-f77b-4806-9206-ac1faf9a3ca3 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0507398 Nov 02 12:55:18.499693 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8b113f9f-5581-495e-a8df-45855fc0216f req-6683f1f6-cbba-420e-8ca9-d417a67137a3 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442910 Nov 02 12:55:18.884755 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22b9023d-4dba-4115-8101-e451077c14a5 req-c65d3b74-d325-4f59-ac68-9d8bc0f68287 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:18.886222 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-22b9023d-4dba-4115-8101-e451077c14a5 req-c65d3b74-d325-4f59-ac68-9d8bc0f68287 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0493162 Nov 02 12:55:18.940791 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-22b9023d-4dba-4115-8101-e451077c14a5 req-6494b331-4bb3-425c-9785-b16de0057ebf tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0485373 Nov 02 12:55:19.625861 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cb693aed-8e3f-4316-b9d8-20526fdedf17 req-5f69bfe5-8e1d-4113-9494-eeea01c19555 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:19.627486 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cb693aed-8e3f-4316-b9d8-20526fdedf17 req-5f69bfe5-8e1d-4113-9494-eeea01c19555 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0510290 Nov 02 12:55:19.681945 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cb693aed-8e3f-4316-b9d8-20526fdedf17 req-46b875b2-c0c3-4db0-9ac1-ca9194d95666 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0457175 Nov 02 12:55:20.060281 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3cccabd-29cb-47fe-8d3a-18531d822a27 req-cc4c608c-d3b4-4bf7-8f51-e5de343817d5 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:20.061812 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a3cccabd-29cb-47fe-8d3a-18531d822a27 req-cc4c608c-d3b4-4bf7-8f51-e5de343817d5 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0518928 Nov 02 12:55:20.117379 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a3cccabd-29cb-47fe-8d3a-18531d822a27 req-ad268965-a11c-4496-9201-847429bde1bd tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0496216 Nov 02 12:55:20.808286 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-512b39d6-775c-4612-b074-609973ebfa35 req-43f4f397-6497-487b-9b80-8490e28cb752 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:20.809972 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-512b39d6-775c-4612-b074-609973ebfa35 req-43f4f397-6497-487b-9b80-8490e28cb752 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0551839 Nov 02 12:55:20.860293 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-512b39d6-775c-4612-b074-609973ebfa35 req-b442e2f7-6fd2-4787-96dd-854cdf7bd160 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437846 Nov 02 12:55:21.233206 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f300216c-8918-4268-8cbd-a17717169d77 req-29142376-89e6-4741-823d-74c029e422d2 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:21.234682 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f300216c-8918-4268-8cbd-a17717169d77 req-29142376-89e6-4741-823d-74c029e422d2 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0496180 Nov 02 12:55:21.288651 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f300216c-8918-4268-8cbd-a17717169d77 req-64a4c09c-afad-4757-b0dc-9f6c39f177bf tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455887 Nov 02 12:55:21.985331 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98f3c4ce-115a-49bb-8692-d3a7e378f7aa req-ffff05c2-db7e-4d89-af7b-3195dfe659fd tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:21.986840 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-98f3c4ce-115a-49bb-8692-d3a7e378f7aa req-ffff05c2-db7e-4d89-af7b-3195dfe659fd tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0493894 Nov 02 12:55:22.040150 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-98f3c4ce-115a-49bb-8692-d3a7e378f7aa req-abcebdaa-efb2-49a3-a43d-abb08b8d4b63 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458622 Nov 02 12:55:22.132573 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3411d284-d916-48bc-91d8-a05128d1526f req-4da631eb-d73b-4472-a61a-0bcf23bfacc8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:22.134019 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-3411d284-d916-48bc-91d8-a05128d1526f req-4da631eb-d73b-4472-a61a-0bcf23bfacc8 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=d3bf5c9bdd7f479aa4cbc28f9a007c81&device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 1098 time: 0.0441966 Nov 02 12:55:22.230546 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3411d284-d916-48bc-91d8-a05128d1526f req-fd4590d1-170c-489f-b593-42043133d5fe service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:22.232142 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-3411d284-d916-48bc-91d8-a05128d1526f req-fd4590d1-170c-489f-b593-42043133d5fe service neutron] 10.222.0.90 "GET /v2.0/networks?id=adffa68a-25de-4006-9dcc-006cbedf32e3 HTTP/1.1" status: 200 len: 910 time: 0.0903203 Nov 02 12:55:22.301674 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-3411d284-d916-48bc-91d8-a05128d1526f req-f948f466-f557-4e2b-8158-8a96441b6325 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=af83efde-b4cd-446b-9f74-15c631e4c45a HTTP/1.1" status: 200 len: 1000 time: 0.0598321 Nov 02 12:55:22.361249 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3411d284-d916-48bc-91d8-a05128d1526f req-755478f3-1e0f-4327-91e9-520c580cddf8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:22.362878 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-3411d284-d916-48bc-91d8-a05128d1526f req-755478f3-1e0f-4327-91e9-520c580cddf8 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=9a20b259-01c2-4b3f-8f92-0797a18ff7f7 HTTP/1.1" status: 200 len: 848 time: 0.0531037 Nov 02 12:55:22.412598 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3411d284-d916-48bc-91d8-a05128d1526f req-036502c9-ae52-474e-8434-2f15e614a62e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:22.414219 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-3411d284-d916-48bc-91d8-a05128d1526f req-036502c9-ae52-474e-8434-2f15e614a62e service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=adffa68a-25de-4006-9dcc-006cbedf32e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0438313 Nov 02 12:55:22.418063 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9fd8fcdf-1abb-4877-856e-0623f9b1552e req-c3c56969-877f-4d06-a8a0-c94cc84e63fb tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:22.419670 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9fd8fcdf-1abb-4877-856e-0623f9b1552e req-c3c56969-877f-4d06-a8a0-c94cc84e63fb tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0567369 Nov 02 12:55:22.472997 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9fd8fcdf-1abb-4877-856e-0623f9b1552e req-b30c594f-2b69-45bd-8ec3-a9d00851574a tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0471768 Nov 02 12:55:22.511526 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-3411d284-d916-48bc-91d8-a05128d1526f req-2cf4e0ca-f04f-4877-b6a9-c729f3a358dc service neutron] 10.222.0.90 "GET /v2.0/networks/adffa68a-25de-4006-9dcc-006cbedf32e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0890620 Nov 02 12:55:22.611568 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-3411d284-d916-48bc-91d8-a05128d1526f req-971555ad-97f0-4ab7-8dae-62852d31955c service neutron] 10.222.0.90 "GET /v2.0/networks/adffa68a-25de-4006-9dcc-006cbedf32e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0920470 Nov 02 12:55:23.179188 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-38deac0b-4928-4ea2-b921-79a9699934fe req-f4fb546e-447a-4036-9d28-46697959f0a1 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:23.180959 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-38deac0b-4928-4ea2-b921-79a9699934fe req-f4fb546e-447a-4036-9d28-46697959f0a1 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0537136 Nov 02 12:55:23.231648 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-38deac0b-4928-4ea2-b921-79a9699934fe req-b3e1e125-e002-4cf1-8032-b4661d7bf603 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0443380 Nov 02 12:55:23.559100 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-6ed2b4ad-9b6c-476f-b42a-dbd7caf538fa None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:23.601361 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-256e793e-a983-4d63-8f9b-15c410b1f0ba req-e4a168ed-14f5-41e4-adf9-eaf6137a6296 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:23.603275 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-256e793e-a983-4d63-8f9b-15c410b1f0ba req-e4a168ed-14f5-41e4-adf9-eaf6137a6296 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0548122 Nov 02 12:55:23.660454 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-256e793e-a983-4d63-8f9b-15c410b1f0ba req-58e2b16b-f9df-4dcc-8eb0-10832c9669ff tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0504334 Nov 02 12:55:24.365732 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-454612fe-4b03-484b-bb66-74714cba8afd req-42f43e0c-5e57-4af8-b435-22bee545348f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:24.367430 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-454612fe-4b03-484b-bb66-74714cba8afd req-42f43e0c-5e57-4af8-b435-22bee545348f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0514126 Nov 02 12:55:24.418043 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-454612fe-4b03-484b-bb66-74714cba8afd req-d742e2e2-176a-4764-9392-cad6dc21c141 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427806 Nov 02 12:55:24.782640 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ee0d113-fec4-4d75-989a-0f3238957683 req-7007bf13-b669-4ff6-821b-4791f518229d tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:24.784103 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0ee0d113-fec4-4d75-989a-0f3238957683 req-7007bf13-b669-4ff6-821b-4791f518229d tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0534163 Nov 02 12:55:24.835304 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0ee0d113-fec4-4d75-989a-0f3238957683 req-c21ab20f-c3ce-4445-88f2-3d779b9185a9 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451689 Nov 02 12:55:25.544335 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-472d6c65-efc1-408e-bb83-c9bf33ccd5bc req-de514c6d-d95f-4a91-b6e2-27ee7dd02d8e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:25.545914 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-472d6c65-efc1-408e-bb83-c9bf33ccd5bc req-de514c6d-d95f-4a91-b6e2-27ee7dd02d8e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0525458 Nov 02 12:55:25.598837 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-472d6c65-efc1-408e-bb83-c9bf33ccd5bc req-8e6662bc-693d-44a1-9b34-d1104ec5fb75 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432107 Nov 02 12:55:25.623047 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-951d0a64-f503-4e18-a324-22e1f94051cb None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:25.951981 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-dde21792-b03f-4097-a9a3-ce3e17495d98 req-33e83920-88fb-4914-b3b9-23a7046ef17d tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:25.953565 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-dde21792-b03f-4097-a9a3-ce3e17495d98 req-33e83920-88fb-4914-b3b9-23a7046ef17d tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0508082 Nov 02 12:55:26.017773 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-dde21792-b03f-4097-a9a3-ce3e17495d98 req-500f5fd2-6a9f-4084-accd-4f931242777a tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0579839 Nov 02 12:55:26.471692 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4b0b90fa-a643-49f8-8955-273075d2b1e7 req-2fe0319b-5143-4d1e-b4cd-ce2d46098ec8 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:26.473238 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4b0b90fa-a643-49f8-8955-273075d2b1e7 req-2fe0319b-5143-4d1e-b4cd-ce2d46098ec8 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0507092 Nov 02 12:55:26.530180 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4b0b90fa-a643-49f8-8955-273075d2b1e7 req-6c16442b-5ec6-4692-97a8-8e0b209149bd tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476141 Nov 02 12:55:26.585958 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 34104) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:55:26.676793 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-8de64c80-c41e-451f-90fb-91d83c232985 req-4e2527c1-8c05-4dde-9cf2-f486f78a19ec service neutron] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0895929 Nov 02 12:55:26.686498 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [req-8de64c80-c41e-451f-90fb-91d83c232985 req-b5a274e6-d819-4049-879b-09ccf7ef4e30 service neutron] http://10.222.0.98:9696/v2.0/extensions returned with HTTP 200 {{(pid=108542) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 02 12:55:26.687775 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-8de64c80-c41e-451f-90fb-91d83c232985 req-b5a274e6-d819-4049-879b-09ccf7ef4e30 service neutron] 10.222.0.98 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13869 time: 0.0054276 Nov 02 12:55:26.727649 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45a28a9c-9bac-40e4-9b78-96dbb6f81bd3 req-964457dc-f937-4517-b537-300d42fb1991 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:26.729350 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-45a28a9c-9bac-40e4-9b78-96dbb6f81bd3 req-964457dc-f937-4517-b537-300d42fb1991 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0554211 Nov 02 12:55:26.778830 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-45a28a9c-9bac-40e4-9b78-96dbb6f81bd3 req-b3e33837-c899-4221-81d6-44cca26abeef tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428736 Nov 02 12:55:26.868667 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:27.650292 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62b7e9eb-53e7-4150-9df7-110fb19dec75 req-52594707-74cd-4fe7-a7b7-967d9057f56a tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:27.651785 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-62b7e9eb-53e7-4150-9df7-110fb19dec75 req-52594707-74cd-4fe7-a7b7-967d9057f56a tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0540211 Nov 02 12:55:27.707006 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-62b7e9eb-53e7-4150-9df7-110fb19dec75 req-52340d5e-9678-4759-943b-d0597573bf05 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0479162 Nov 02 12:55:27.901944 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-84656d4a-59f7-45af-a390-d54cfb383aa5 req-886c76da-cf5a-402c-869e-e8d68d72a6c8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:27.903471 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-84656d4a-59f7-45af-a390-d54cfb383aa5 req-886c76da-cf5a-402c-869e-e8d68d72a6c8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0509419 Nov 02 12:55:27.953240 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-84656d4a-59f7-45af-a390-d54cfb383aa5 req-921ce353-cc45-4892-a24d-7d2a35182886 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0434744 Nov 02 12:55:28.371106 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:28.823818 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac4a487f-1c77-4f8c-a7ab-823503d7a81c req-7f27e712-3647-49f3-a217-55614874193f tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:28.825189 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ac4a487f-1c77-4f8c-a7ab-823503d7a81c req-7f27e712-3647-49f3-a217-55614874193f tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0506525 Nov 02 12:55:28.892029 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ac4a487f-1c77-4f8c-a7ab-823503d7a81c req-dd15f9ce-08a4-4cd8-8d8a-f22160b7d615 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0606985 Nov 02 12:55:29.076045 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dc92e90-1109-4e87-b134-db2e82a92fa1 req-52695436-4271-46a2-aa7f-17a0f0155b54 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:29.077451 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1dc92e90-1109-4e87-b134-db2e82a92fa1 req-52695436-4271-46a2-aa7f-17a0f0155b54 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0501170 Nov 02 12:55:29.128548 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1dc92e90-1109-4e87-b134-db2e82a92fa1 req-c63c6a76-8fba-4c10-b1dd-db3de414e338 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449464 Nov 02 12:55:29.150825 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device af83efde-b4cd-446b-9f74-15c631e4c45a no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:55:29.243117 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:29.266726 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'af83efde-b4cd-446b-9f74-15c631e4c45a'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:55:29.269058 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-79863abb-a458-45aa-9bda-27473ba71175" -d '{"events": [{"server_uuid": "d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8", "name": "network-vif-unplugged", "status": "completed", "tag": "af83efde-b4cd-446b-9f74-15c631e4c45a"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:55:29.306399 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port af83efde-b4cd-446b-9f74-15c631e4c45a, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=af83efde-b4cd-446b-9f74-15c631e4c45a,segment=NetworkSegment(e206345e-67db-4144-84ee-50b4e5db5d75),segment_id=e206345e-67db-4144-84ee-50b4e5db5d75)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:55:29.428645 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 02 Nov 2021 12:55:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c879b2ff-3a32-4218-9b9c-fceea892b3bd x-openstack-request-id: req-c879b2ff-3a32-4218-9b9c-fceea892b3bd {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:55:29.429269 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8", "name": "network-vif-unplugged", "status": "completed", "tag": "af83efde-b4cd-446b-9f74-15c631e4c45a", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:55:29.429269 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-c879b2ff-3a32-4218-9b9c-fceea892b3bd {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:55:29.429575 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'af83efde-b4cd-446b-9f74-15c631e4c45a', 'code': 200} Nov 02 12:55:29.519320 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:29.571071 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=af83efde-b4cd-446b-9f74-15c631e4c45a,revision_number=6']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:55:29.578010 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:29.578357 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:29.578723 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:29.579062 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:29.579383 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:29.579790 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:29.580134 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:29.580533 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:29.580824 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:29.581149 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:29.581471 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:29.581791 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:29.832328 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8de64c80-c41e-451f-90fb-91d83c232985 req-44f909e0-1d58-4f6b-a917-cea25adf9d89 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:29.833804 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-8de64c80-c41e-451f-90fb-91d83c232985 req-44f909e0-1d58-4f6b-a917-cea25adf9d89 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8&tenant_id=d3bf5c9bdd7f479aa4cbc28f9a007c81 HTTP/1.1" status: 200 len: 1096 time: 0.0730691 Nov 02 12:55:29.896201 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8de64c80-c41e-451f-90fb-91d83c232985 req-41a4c795-b119-4414-a24b-fb8d3ac59db8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:29.898255 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-8de64c80-c41e-451f-90fb-91d83c232985 req-41a4c795-b119-4414-a24b-fb8d3ac59db8 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=d3bf5c9bdd7f479aa4cbc28f9a007c81&device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 1096 time: 0.0405986 Nov 02 12:55:29.992197 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8de64c80-c41e-451f-90fb-91d83c232985 req-4af1ac0a-2ff5-4527-ada3-9535ef00b0c2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:29.993667 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-8de64c80-c41e-451f-90fb-91d83c232985 req-4af1ac0a-2ff5-4527-ada3-9535ef00b0c2 service neutron] 10.222.0.90 "GET /v2.0/networks?id=adffa68a-25de-4006-9dcc-006cbedf32e3 HTTP/1.1" status: 200 len: 910 time: 0.0882902 Nov 02 12:55:30.008942 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8052cbdf-f634-4e53-b16f-7611725ef62c req-6a5e9978-a230-4173-b17f-6237a8ea9c00 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:30.010618 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8052cbdf-f634-4e53-b16f-7611725ef62c req-6a5e9978-a230-4173-b17f-6237a8ea9c00 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.0490725 Nov 02 12:55:30.059901 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8052cbdf-f634-4e53-b16f-7611725ef62c req-e95a0429-5166-4fec-80af-61f7e776548c tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0432982 Nov 02 12:55:30.063394 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-8de64c80-c41e-451f-90fb-91d83c232985 req-c462efcc-0f0d-42a8-9a94-5c3f9e932bec service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=af83efde-b4cd-446b-9f74-15c631e4c45a HTTP/1.1" status: 200 len: 998 time: 0.0614529 Nov 02 12:55:30.114446 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8de64c80-c41e-451f-90fb-91d83c232985 req-9a080732-0608-4035-b8bf-1b74a666a7c5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:30.116418 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-8de64c80-c41e-451f-90fb-91d83c232985 req-9a080732-0608-4035-b8bf-1b74a666a7c5 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=9a20b259-01c2-4b3f-8f92-0797a18ff7f7 HTTP/1.1" status: 200 len: 848 time: 0.0438504 Nov 02 12:55:30.163333 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8de64c80-c41e-451f-90fb-91d83c232985 req-ea4cc5fc-caa3-43e1-a926-767ac540f113 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:30.164836 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-8de64c80-c41e-451f-90fb-91d83c232985 req-ea4cc5fc-caa3-43e1-a926-767ac540f113 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=adffa68a-25de-4006-9dcc-006cbedf32e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0404091 Nov 02 12:55:30.256872 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8faff090-e546-4dcd-b2a6-6c363da02ee9 req-f27484c4-52f8-45de-b184-f1d491166ea5 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:30.259044 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8faff090-e546-4dcd-b2a6-6c363da02ee9 req-f27484c4-52f8-45de-b184-f1d491166ea5 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0541046 Nov 02 12:55:30.271252 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-8de64c80-c41e-451f-90fb-91d83c232985 req-30476ed1-31ce-45c3-908c-5ae8087d4294 service neutron] 10.222.0.90 "GET /v2.0/networks/adffa68a-25de-4006-9dcc-006cbedf32e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0969722 Nov 02 12:55:30.320340 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8faff090-e546-4dcd-b2a6-6c363da02ee9 req-ed36e407-fe8b-4cc1-99c5-f748341c6152 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0489895 Nov 02 12:55:30.370946 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-8de64c80-c41e-451f-90fb-91d83c232985 req-9ecf073e-6c18-4f01-8925-f3c2bdaffea0 service neutron] 10.222.0.90 "GET /v2.0/networks/adffa68a-25de-4006-9dcc-006cbedf32e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0879834 Nov 02 12:55:30.816391 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:31.174500 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87b2df99-31e4-4867-9a05-6daca2a41cc8 req-d6b53da0-1b57-4957-b319-567bc88e30df tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:31.176013 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-87b2df99-31e4-4867-9a05-6daca2a41cc8 req-d6b53da0-1b57-4957-b319-567bc88e30df tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.0496171 Nov 02 12:55:31.226465 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-87b2df99-31e4-4867-9a05-6daca2a41cc8 req-d954d374-7ec2-418f-886b-eb369e4efa23 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0442984 Nov 02 12:55:31.446203 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-282edf2a-cbc4-460d-b0b1-cf1a63836d77 req-a2a038c4-e2ff-445f-a096-30d8f693cbb7 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:31.447659 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-282edf2a-cbc4-460d-b0b1-cf1a63836d77 req-a2a038c4-e2ff-445f-a096-30d8f693cbb7 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0530212 Nov 02 12:55:31.496167 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-282edf2a-cbc4-460d-b0b1-cf1a63836d77 req-d3a46bde-9da3-4634-a6bd-61873e0f30b7 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425599 Nov 02 12:55:32.339335 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e19d4da8-5531-4f40-b1a8-7386f17388c4 req-f358ae96-ea6b-4dee-b9d6-41d0426937a5 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:32.340809 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e19d4da8-5531-4f40-b1a8-7386f17388c4 req-f358ae96-ea6b-4dee-b9d6-41d0426937a5 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.0490468 Nov 02 12:55:32.394337 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e19d4da8-5531-4f40-b1a8-7386f17388c4 req-1a93c6d9-0dc6-4d68-98d0-81279eb5f0fa tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477018 Nov 02 12:55:32.469214 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:55:32.613509 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cf113539-1bec-4157-b786-e9f987d82254 req-5ff74e0f-23b0-4521-9403-547712ba7de3 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:32.614402 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cf113539-1bec-4157-b786-e9f987d82254 req-5ff74e0f-23b0-4521-9403-547712ba7de3 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0477524 Nov 02 12:55:32.670349 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cf113539-1bec-4157-b786-e9f987d82254 req-9bbbcff2-b93d-4129-8ed5-e5a85a2ecfa0 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477822 Nov 02 12:55:33.353485 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:33.508104 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea5e8aa9-5940-4771-a7c0-4e98fbfd1e46 req-9e93718a-3c52-4cd4-af96-375d5e09adb7 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:33.509545 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ea5e8aa9-5940-4771-a7c0-4e98fbfd1e46 req-9e93718a-3c52-4cd4-af96-375d5e09adb7 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.0499144 Nov 02 12:55:33.559105 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ea5e8aa9-5940-4771-a7c0-4e98fbfd1e46 req-e78908ac-7c16-47b1-8c32-d2ec30a2aa7d tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435381 Nov 02 12:55:33.788872 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1057cbf2-5573-4f51-98a6-422c430bb7f3 req-7c6ebefb-a4da-4832-b834-b1b3afeace1a tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:33.790321 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1057cbf2-5573-4f51-98a6-422c430bb7f3 req-7c6ebefb-a4da-4832-b834-b1b3afeace1a tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0489488 Nov 02 12:55:33.837801 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1057cbf2-5573-4f51-98a6-422c430bb7f3 req-0a5b4ce4-0bb9-493e-8477-4711192917f6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412853 Nov 02 12:55:34.675281 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ead9b229-dfe3-49b2-a427-5be81c9d8525 req-0c46bcfd-e7c4-4fda-9820-be16d2a1aa39 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:34.676751 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ead9b229-dfe3-49b2-a427-5be81c9d8525 req-0c46bcfd-e7c4-4fda-9820-be16d2a1aa39 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.0522399 Nov 02 12:55:34.727517 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ead9b229-dfe3-49b2-a427-5be81c9d8525 req-e484d848-c255-4556-ae35-0637cc62bdc7 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433009 Nov 02 12:55:34.958092 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ebab424-0120-4b73-b69f-2f54e071c3a4 req-87dde879-df39-4ec8-ae46-e9b30c2c3a1b tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:34.959605 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9ebab424-0120-4b73-b69f-2f54e071c3a4 req-87dde879-df39-4ec8-ae46-e9b30c2c3a1b tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0495961 Nov 02 12:55:35.008132 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9ebab424-0120-4b73-b69f-2f54e071c3a4 req-64753e1e-a6c9-4ba0-9f61-e640cb25da7d tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423694 Nov 02 12:55:35.162813 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device b2c052d8-c7f4-4790-afab-5f3766f86877 details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 12:55:35.260295 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port b2c052d8-c7f4-4790-afab-5f3766f86877, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=b2c052d8-c7f4-4790-afab-5f3766f86877,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:55:35.271297 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': 'b2c052d8-c7f4-4790-afab-5f3766f86877', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'port_id': 'b2c052d8-c7f4-4790-afab-5f3766f86877', 'mac_address': 'fa:16:3e:94:a8:39', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 854, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 12:55:35.308737 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:35.321061 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: ACTIVE current_port_status: BUILD port_id b2c052d8-c7f4-4790-afab-5f3766f86877 {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:55:35.341303 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port b2c052d8-c7f4-4790-afab-5f3766f86877, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=b2c052d8-c7f4-4790-afab-5f3766f86877,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:55:35.450526 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:35.503231 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=b2c052d8-c7f4-4790-afab-5f3766f86877,revision_number=6']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:55:35.543797 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['b2c052d8-c7f4-4790-afab-5f3766f86877'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:55:35.848981 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3817c391-7b5c-44b4-abc7-e816feb5878b req-c9975075-0826-4cc9-9398-41f68e073e9e tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:35.850518 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3817c391-7b5c-44b4-abc7-e816feb5878b req-c9975075-0826-4cc9-9398-41f68e073e9e tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.0524800 Nov 02 12:55:35.903794 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3817c391-7b5c-44b4-abc7-e816feb5878b req-fab832b1-2efc-4605-8848-bbb232c823a6 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0473559 Nov 02 12:55:36.132194 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e1a02500-74ca-4aee-b668-4978f526665f req-150a1d1e-5569-4468-bf18-1f165f6063d5 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:36.134307 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e1a02500-74ca-4aee-b668-4978f526665f req-150a1d1e-5569-4468-bf18-1f165f6063d5 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 944 time: 0.0500154 Nov 02 12:55:36.181610 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e1a02500-74ca-4aee-b668-4978f526665f req-8f1cf1d1-57a3-4581-ad26-130deb8e42d6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412872 Nov 02 12:55:37.021014 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9b31c113-df66-4b55-a832-5b9097f8fd34 req-dfcf2b41-203d-4216-b6ad-57ee1f9577a2 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:37.022552 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9b31c113-df66-4b55-a832-5b9097f8fd34 req-dfcf2b41-203d-4216-b6ad-57ee1f9577a2 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.0501571 Nov 02 12:55:37.078941 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9b31c113-df66-4b55-a832-5b9097f8fd34 req-a4d5ee22-42a4-41b1-8431-4c19739f6b6c tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0499637 Nov 02 12:55:37.176360 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device b2c052d8-c7f4-4790-afab-5f3766f86877 up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:55:37.225542 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port b2c052d8-c7f4-4790-afab-5f3766f86877 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:55:37.225917 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:37.308912 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ddc6ccb6-22f7-4961-9df0-264d56859599 req-f309d24b-4cfd-44f7-add1-f94b57de4434 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:37.309613 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:37.310479 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ddc6ccb6-22f7-4961-9df0-264d56859599 req-f309d24b-4cfd-44f7-add1-f94b57de4434 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 944 time: 0.0527923 Nov 02 12:55:37.333223 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a1984910-3b5c-43f5-8727-1c65226b3983', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b2c052d8-c7f4-4790-afab-5f3766f86877'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:55:37.335455 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d0eeacb3-26a7-49fb-b8ac-6b5e48b366ee" -d '{"events": [{"server_uuid": "a1984910-3b5c-43f5-8727-1c65226b3983", "name": "network-vif-plugged", "status": "completed", "tag": "b2c052d8-c7f4-4790-afab-5f3766f86877"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:55:37.348513 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port b2c052d8-c7f4-4790-afab-5f3766f86877, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=b2c052d8-c7f4-4790-afab-5f3766f86877,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:55:37.360251 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ddc6ccb6-22f7-4961-9df0-264d56859599 req-457f54f1-d10c-4ef2-9817-55a8e8a606b8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429101 Nov 02 12:55:37.383467 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:55:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8ed2cc62-e6f0-4aac-a74f-cf5b44f1eaf5 x-openstack-request-id: req-8ed2cc62-e6f0-4aac-a74f-cf5b44f1eaf5 {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:55:37.383766 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a1984910-3b5c-43f5-8727-1c65226b3983", "name": "network-vif-plugged", "status": "completed", "tag": "b2c052d8-c7f4-4790-afab-5f3766f86877", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:55:37.384023 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-8ed2cc62-e6f0-4aac-a74f-cf5b44f1eaf5 {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:55:37.384626 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a1984910-3b5c-43f5-8727-1c65226b3983', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b2c052d8-c7f4-4790-afab-5f3766f86877', 'code': 200} Nov 02 12:55:37.462327 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:37.536007 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=b2c052d8-c7f4-4790-afab-5f3766f86877,revision_number=7']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:55:38.207307 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b1aa1952-024c-4652-95d6-e9e2a1601dac req-dc93ff4f-23ee-4d42-aae0-29a6bb134d2e tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:38.216447 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b1aa1952-024c-4652-95d6-e9e2a1601dac req-dc93ff4f-23ee-4d42-aae0-29a6bb134d2e tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.0609999 Nov 02 12:55:38.267040 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b1aa1952-024c-4652-95d6-e9e2a1601dac req-3f4936d0-03b5-423c-a371-ff889003c639 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0493624 Nov 02 12:55:38.508690 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74197d9a-132a-4b25-a55b-b0707f75502b req-f8067d7d-48e2-4810-a686-4477a6a3f514 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:38.514860 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-74197d9a-132a-4b25-a55b-b0707f75502b req-f8067d7d-48e2-4810-a686-4477a6a3f514 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0736516 Nov 02 12:55:38.572866 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-74197d9a-132a-4b25-a55b-b0707f75502b req-65c4d419-34b6-42f2-ba6f-b5c5559976b9 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0561583 Nov 02 12:55:38.962737 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ccd6d4e-ece5-4461-84a9-fdf5f98a2602 req-6ecc7d95-4701-44a0-9eb7-48f5f448d55c tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:38.970548 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0ccd6d4e-ece5-4461-84a9-fdf5f98a2602 req-6ecc7d95-4701-44a0-9eb7-48f5f448d55c tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 945 time: 0.0604339 Nov 02 12:55:39.021164 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0ccd6d4e-ece5-4461-84a9-fdf5f98a2602 req-7e06d95b-07ed-42f7-b8ad-2b67cf50bc55 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0494251 Nov 02 12:55:39.415979 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4808ed7d-e6d4-4d21-b6c4-059677436813 req-e8a470d2-e5df-4d7f-a1cc-9769f9590ed5 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:39.417559 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4808ed7d-e6d4-4d21-b6c4-059677436813 req-e8a470d2-e5df-4d7f-a1cc-9769f9590ed5 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.0672631 Nov 02 12:55:39.491205 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4808ed7d-e6d4-4d21-b6c4-059677436813 req-333ecec9-6566-4b7d-a402-ee428960bdd6 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0672956 Nov 02 12:55:39.733248 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c7dd70ad-8065-4cfb-acf3-fdd88072b984 req-dc9648c7-47bd-47f9-a2c6-e3ae7560a1fc tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:39.734981 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c7dd70ad-8065-4cfb-acf3-fdd88072b984 req-dc9648c7-47bd-47f9-a2c6-e3ae7560a1fc tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0695410 Nov 02 12:55:39.797716 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c7dd70ad-8065-4cfb-acf3-fdd88072b984 req-a8fbf345-beba-4fb4-a6f5-7cba6e41f7f6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0562799 Nov 02 12:55:40.162272 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9a11848b-66e4-4e06-8dce-965ca1dd71ee req-37206b80-2c34-4434-8b37-aa221a227a07 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:40.166395 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9a11848b-66e4-4e06-8dce-965ca1dd71ee req-37206b80-2c34-4434-8b37-aa221a227a07 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 945 time: 0.0608845 Nov 02 12:55:40.232379 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9a11848b-66e4-4e06-8dce-965ca1dd71ee req-3d86da2c-cd35-44dc-af4f-a50514b5f5af tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0613787 Nov 02 12:55:40.611326 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fd3b2f54-f620-4a38-9955-b42904a0b455 req-c4eb19c7-6895-4920-8dfe-da0bc2d9948e tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:40.612855 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fd3b2f54-f620-4a38-9955-b42904a0b455 req-c4eb19c7-6895-4920-8dfe-da0bc2d9948e tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.0518501 Nov 02 12:55:40.663190 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fd3b2f54-f620-4a38-9955-b42904a0b455 req-c8bccb67-e984-4aec-b146-74264278d3a8 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0437350 Nov 02 12:55:40.926828 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bd6b29ba-64f5-4e48-8ce1-7aef56e87344 req-5971390c-1479-42da-9b23-923f5d806193 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:40.928612 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bd6b29ba-64f5-4e48-8ce1-7aef56e87344 req-5971390c-1479-42da-9b23-923f5d806193 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0517201 Nov 02 12:55:40.984535 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bd6b29ba-64f5-4e48-8ce1-7aef56e87344 req-f7549f25-77f9-4f8f-ac88-2159602070d8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0487123 Nov 02 12:55:41.367525 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e13805ce-3fba-4f7c-8cc6-a246ab8c768a req-b0460cd5-b4c0-440b-9cba-db0704b62a5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:41.373232 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e13805ce-3fba-4f7c-8cc6-a246ab8c768a req-b0460cd5-b4c0-440b-9cba-db0704b62a5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 945 time: 0.0603242 Nov 02 12:55:41.434946 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e13805ce-3fba-4f7c-8cc6-a246ab8c768a req-8ff5ce0b-7476-4328-8786-a128dad27952 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0582252 Nov 02 12:55:41.797228 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d87ef457-cde6-4571-a526-70d88865f12c req-5288d397-adfa-49bb-b4d8-fa9f77095a39 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:41.799051 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d87ef457-cde6-4571-a526-70d88865f12c req-5288d397-adfa-49bb-b4d8-fa9f77095a39 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.0536537 Nov 02 12:55:41.858571 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d87ef457-cde6-4571-a526-70d88865f12c req-4793e8b6-3651-4149-a936-9571765509ef tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0533123 Nov 02 12:55:42.125056 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a91e097-7076-4c8c-867e-573c4fb17505 req-7a3c565d-b3b1-4423-b3db-d19e8e686659 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:42.127169 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7a91e097-7076-4c8c-867e-573c4fb17505 req-7a3c565d-b3b1-4423-b3db-d19e8e686659 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0581963 Nov 02 12:55:42.185619 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7a91e097-7076-4c8c-867e-573c4fb17505 req-c04af8d8-1034-477e-b77c-80d9e29add78 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0523100 Nov 02 12:55:42.568463 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f279987b-d0cd-48a4-b5ea-982b3ec19185 req-b01694fc-dbb0-4e04-8e43-e2cb088d9127 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:42.570075 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f279987b-d0cd-48a4-b5ea-982b3ec19185 req-b01694fc-dbb0-4e04-8e43-e2cb088d9127 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 945 time: 0.0531361 Nov 02 12:55:42.629251 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f279987b-d0cd-48a4-b5ea-982b3ec19185 req-4137485b-aa6b-44e9-8c14-3c297863796a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0518875 Nov 02 12:55:42.979815 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-99c96b9c-0238-4554-973a-e0b70d4c2e6e req-e074122f-91c7-41de-a823-ef7ac6cc6488 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:42.988505 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-99c96b9c-0238-4554-973a-e0b70d4c2e6e req-e074122f-91c7-41de-a823-ef7ac6cc6488 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.0597293 Nov 02 12:55:43.041222 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-99c96b9c-0238-4554-973a-e0b70d4c2e6e req-ee131f45-0c11-4135-b2ca-55cd8c568acb tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0517938 Nov 02 12:55:43.324461 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-18d3d22b-109d-448d-8276-4b04897e6bb8 req-9cd08ffb-6025-498d-a140-90bf46b8b93e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:43.325951 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-18d3d22b-109d-448d-8276-4b04897e6bb8 req-9cd08ffb-6025-498d-a140-90bf46b8b93e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0572600 Nov 02 12:55:43.380647 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-18d3d22b-109d-448d-8276-4b04897e6bb8 req-d08f649f-6ebc-478c-95fb-5f5a91417ec3 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0485129 Nov 02 12:55:43.753054 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b41a899-410d-4475-80a4-57bfee717bbd req-78ced362-3a8c-4931-84d6-51cb6e622133 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:43.754562 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5b41a899-410d-4475-80a4-57bfee717bbd req-78ced362-3a8c-4931-84d6-51cb6e622133 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 945 time: 0.0530496 Nov 02 12:55:43.805685 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5b41a899-410d-4475-80a4-57bfee717bbd req-5e920f6b-b7b1-4a88-b78c-8824af5250bf tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444102 Nov 02 12:55:44.161445 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-448ede87-414f-40c3-979b-8e652f518d29 req-a6f9b255-5690-4ebe-a107-39b0f500e1dc tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:44.162928 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-448ede87-414f-40c3-979b-8e652f518d29 req-a6f9b255-5690-4ebe-a107-39b0f500e1dc tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.0516298 Nov 02 12:55:44.215445 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-448ede87-414f-40c3-979b-8e652f518d29 req-a53562fa-c063-4fd7-a3b1-a2226c014d53 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461140 Nov 02 12:55:44.519282 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a362c4fc-bcae-45f5-9796-c62db9cd0376 req-d60147a6-0d79-433f-a0d9-38ea94bed937 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:44.520939 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a362c4fc-bcae-45f5-9796-c62db9cd0376 req-d60147a6-0d79-433f-a0d9-38ea94bed937 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0611644 Nov 02 12:55:44.576402 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a362c4fc-bcae-45f5-9796-c62db9cd0376 req-99861769-6408-4de7-a5d7-41c166341a56 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461025 Nov 02 12:55:44.937553 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b0205e91-c59a-44fd-9713-079fc41a9051 req-18479d43-bfee-4419-b0cd-ac1b03b253c2 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:44.939107 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b0205e91-c59a-44fd-9713-079fc41a9051 req-18479d43-bfee-4419-b0cd-ac1b03b253c2 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 945 time: 0.0523272 Nov 02 12:55:44.995678 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b0205e91-c59a-44fd-9713-079fc41a9051 req-4a4dc343-0838-455a-ae80-99450751463e tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0482097 Nov 02 12:55:45.639180 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f608287-47a8-4250-aa14-10cacc3f630b req-5705ac7f-4c1f-4017-ab20-ed5ee3fd979d tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:45.640730 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7f608287-47a8-4250-aa14-10cacc3f630b req-5705ac7f-4c1f-4017-ab20-ed5ee3fd979d tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.3352172 Nov 02 12:55:45.725509 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7f608287-47a8-4250-aa14-10cacc3f630b req-3708b822-f38a-4ef0-b01e-2e3833bab0db tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0767820 Nov 02 12:55:45.746184 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9b3536c-e821-4c18-af8c-cc29a7ed85ba req-002abe48-84d5-49bf-b719-413ccebfe73f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:45.748194 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b9b3536c-e821-4c18-af8c-cc29a7ed85ba req-002abe48-84d5-49bf-b719-413ccebfe73f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0772362 Nov 02 12:55:45.803385 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b9b3536c-e821-4c18-af8c-cc29a7ed85ba req-69424239-a087-41c3-9f34-cb7aabd05b50 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481849 Nov 02 12:55:46.116852 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad707d82-40ff-4c5d-be3d-5d2a90d5eb42 req-83d3e665-f4c8-4b0e-812f-51909046b3d8 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:46.118424 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ad707d82-40ff-4c5d-be3d-5d2a90d5eb42 req-83d3e665-f4c8-4b0e-812f-51909046b3d8 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 945 time: 0.0534072 Nov 02 12:55:46.182705 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ad707d82-40ff-4c5d-be3d-5d2a90d5eb42 req-4129bf78-4cd1-4774-a19c-48e8a3366a08 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0565853 Nov 02 12:55:46.877468 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c012e4c8-9ef4-46b2-b079-2042b0ec18e9 req-8498488c-cce6-4e82-949c-0c930214251b tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:46.879021 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c012e4c8-9ef4-46b2-b079-2042b0ec18e9 req-8498488c-cce6-4e82-949c-0c930214251b tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.0626924 Nov 02 12:55:46.973347 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c012e4c8-9ef4-46b2-b079-2042b0ec18e9 req-77174ce7-85b4-4c9d-a495-33bb3d0f20d9 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0859883 Nov 02 12:55:46.981863 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ecbc1d49-5782-4f59-9dd7-bfdaddf2647d req-73c60fed-09ea-4d6b-b7b1-12b1bb2c28d8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:46.983370 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ecbc1d49-5782-4f59-9dd7-bfdaddf2647d req-73c60fed-09ea-4d6b-b7b1-12b1bb2c28d8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0790715 Nov 02 12:55:47.042820 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ecbc1d49-5782-4f59-9dd7-bfdaddf2647d req-0da26576-70f7-4b22-afcf-cd7ec2c45eff tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0504150 Nov 02 12:55:47.304559 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43c165b7-c80c-4279-95ad-321a675fe385 req-2fbb73b2-fc51-4b27-980e-58a144f084ba tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:47.306027 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-43c165b7-c80c-4279-95ad-321a675fe385 req-2fbb73b2-fc51-4b27-980e-58a144f084ba tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 945 time: 0.0520794 Nov 02 12:55:47.359835 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-43c165b7-c80c-4279-95ad-321a675fe385 req-ad9800a1-ce65-4a72-82b1-6ef799c4c1b4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449629 Nov 02 12:55:48.092122 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-73a2d4aa-a015-4e44-a934-77da1c2057e8 req-fd662a0c-fab9-4374-b087-c75913f8caa5 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:48.092122 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-73a2d4aa-a015-4e44-a934-77da1c2057e8 req-fd662a0c-fab9-4374-b087-c75913f8caa5 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.0497379 Nov 02 12:55:48.194124 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-73a2d4aa-a015-4e44-a934-77da1c2057e8 req-95e80de9-a0c3-4632-8771-9ae74023d586 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0949490 Nov 02 12:55:48.224447 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-43ff29db-0472-4288-ab93-8ad7d8b441e7 req-d3de648a-54a0-4e1b-bd74-2516f0ad688e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:48.226522 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-43ff29db-0472-4288-ab93-8ad7d8b441e7 req-d3de648a-54a0-4e1b-bd74-2516f0ad688e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0950899 Nov 02 12:55:48.285954 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-43ff29db-0472-4288-ab93-8ad7d8b441e7 req-bbcd8322-21ed-4ebc-aa16-1fe715dfebc3 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0523481 Nov 02 12:55:48.509266 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4f7e8159-aabc-4094-9847-1e1f995ebd3b req-1b84bb9b-775f-4be7-a030-396e907c090e tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:48.516872 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4f7e8159-aabc-4094-9847-1e1f995ebd3b req-1b84bb9b-775f-4be7-a030-396e907c090e tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 945 time: 0.0757034 Nov 02 12:55:48.568957 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4f7e8159-aabc-4094-9847-1e1f995ebd3b req-08eb0898-4883-4f31-8fee-374a22637419 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0490687 Nov 02 12:55:49.312041 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e14feaef-68ef-4f5d-a4e9-0a47c7427e9b req-87d3fb8a-7edc-4540-8efd-14472ef8d9ed tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:49.313276 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e14feaef-68ef-4f5d-a4e9-0a47c7427e9b req-87d3fb8a-7edc-4540-8efd-14472ef8d9ed tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.0502448 Nov 02 12:55:49.368401 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e14feaef-68ef-4f5d-a4e9-0a47c7427e9b req-654bd5fd-81f1-4dd3-8e1a-5845a15678a8 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0489929 Nov 02 12:55:49.435845 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cd6b883-a172-4534-b240-f54ca364943a req-007ba4fd-95d0-49ea-9416-73608f7a7cfd tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:49.437367 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0cd6b883-a172-4534-b240-f54ca364943a req-007ba4fd-95d0-49ea-9416-73608f7a7cfd tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0511208 Nov 02 12:55:49.486415 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0cd6b883-a172-4534-b240-f54ca364943a req-f815f509-a8ec-4eeb-9684-6ab7acd22025 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429087 Nov 02 12:55:49.693761 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-014ad787-6472-4aae-bf23-a0b09049cb14 req-67cfdd36-8f94-4d92-ae08-1aea6b9f7b4c tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:49.695357 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-014ad787-6472-4aae-bf23-a0b09049cb14 req-67cfdd36-8f94-4d92-ae08-1aea6b9f7b4c tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 945 time: 0.0501301 Nov 02 12:55:49.732459 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 34358) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:55:49.747990 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-014ad787-6472-4aae-bf23-a0b09049cb14 req-50fef383-95dd-45c7-85ab-b6529838b615 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0461826 Nov 02 12:55:49.838129 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-19added0-1005-4b3b-87d7-422f98c89795 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:49.911767 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-19added0-1005-4b3b-87d7-422f98c89795 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:50.056302 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-19added0-1005-4b3b-87d7-422f98c89795 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:50.095531 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-19added0-1005-4b3b-87d7-422f98c89795 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=2cf9ab41ee38421796ed1727f8f0852c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3619175 Nov 02 12:55:50.096183 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-19added0-1005-4b3b-87d7-422f98c89795 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=95a8c28b-9155-49c4-9e34-29ff1d8d31bf,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:55:50.098482 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 34362) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:55:50.103483 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19added0-1005-4b3b-87d7-422f98c89795 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:50.103823 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19added0-1005-4b3b-87d7-422f98c89795 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:50.104166 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19added0-1005-4b3b-87d7-422f98c89795 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:50.104572 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19added0-1005-4b3b-87d7-422f98c89795 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:50.104899 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19added0-1005-4b3b-87d7-422f98c89795 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:50.105223 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19added0-1005-4b3b-87d7-422f98c89795 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:50.105545 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19added0-1005-4b3b-87d7-422f98c89795 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:50.105868 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19added0-1005-4b3b-87d7-422f98c89795 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:50.106185 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19added0-1005-4b3b-87d7-422f98c89795 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:50.106531 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19added0-1005-4b3b-87d7-422f98c89795 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:50.106845 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19added0-1005-4b3b-87d7-422f98c89795 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:50.107157 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-19added0-1005-4b3b-87d7-422f98c89795 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:50.152202 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-9f8faecd-fdb2-4f78-be99-c1d2b8ae2c2b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:50.176100 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-9f8faecd-fdb2-4f78-be99-c1d2b8ae2c2b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:50.341863 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-9f8faecd-fdb2-4f78-be99-c1d2b8ae2c2b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:50.344713 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-9f8faecd-fdb2-4f78-be99-c1d2b8ae2c2b admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:50.345941 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-9f8faecd-fdb2-4f78-be99-c1d2b8ae2c2b admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/95a8c28b-9155-49c4-9e34-29ff1d8d31bf HTTP/1.1" status: 204 len: 168 time: 0.2464478 Nov 02 12:55:50.354200 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9f8faecd-fdb2-4f78-be99-c1d2b8ae2c2b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=95a8c28b-9155-49c4-9e34-29ff1d8d31bf,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:55:50.361321 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f8faecd-fdb2-4f78-be99-c1d2b8ae2c2b admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:50.361672 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f8faecd-fdb2-4f78-be99-c1d2b8ae2c2b admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:50.362014 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f8faecd-fdb2-4f78-be99-c1d2b8ae2c2b admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:50.362350 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f8faecd-fdb2-4f78-be99-c1d2b8ae2c2b admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:50.362715 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f8faecd-fdb2-4f78-be99-c1d2b8ae2c2b admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:50.363047 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f8faecd-fdb2-4f78-be99-c1d2b8ae2c2b admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:50.363494 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f8faecd-fdb2-4f78-be99-c1d2b8ae2c2b admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:50.363857 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f8faecd-fdb2-4f78-be99-c1d2b8ae2c2b admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:50.364217 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f8faecd-fdb2-4f78-be99-c1d2b8ae2c2b admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:50.364542 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f8faecd-fdb2-4f78-be99-c1d2b8ae2c2b admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:50.364865 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f8faecd-fdb2-4f78-be99-c1d2b8ae2c2b admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:50.365208 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-9f8faecd-fdb2-4f78-be99-c1d2b8ae2c2b admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:55:50.488322 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f3534755-b106-40c1-b2b0-69541d2aafb9 req-3bda3bc5-97af-4825-9de5-1e4aa0e9afee tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:50.489762 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f3534755-b106-40c1-b2b0-69541d2aafb9 req-3bda3bc5-97af-4825-9de5-1e4aa0e9afee tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.0503511 Nov 02 12:55:50.547761 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f3534755-b106-40c1-b2b0-69541d2aafb9 req-028594a8-8111-4498-bee0-4f8f34530837 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0501516 Nov 02 12:55:50.616766 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5fdaf5ad-2dbe-4b18-adde-f241072198b0 req-89c39ec9-1260-4363-9733-73589a7f1ed0 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:50.618421 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5fdaf5ad-2dbe-4b18-adde-f241072198b0 req-89c39ec9-1260-4363-9733-73589a7f1ed0 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0526607 Nov 02 12:55:50.668532 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5fdaf5ad-2dbe-4b18-adde-f241072198b0 req-552403ab-c9d8-4dc3-afcc-7d9122fb3731 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0433905 Nov 02 12:55:50.863558 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41055983-2322-4800-958e-aa562963de31 req-21c5cfde-d41d-4b4a-ba18-64447594e73e tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:50.865015 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-41055983-2322-4800-958e-aa562963de31 req-21c5cfde-d41d-4b4a-ba18-64447594e73e tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 945 time: 0.0488734 Nov 02 12:55:50.915608 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-41055983-2322-4800-958e-aa562963de31 req-48fc09db-5b09-40cd-9c21-49128ae450b8 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437927 Nov 02 12:55:51.400312 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 34390) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:55:51.504576 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-e3413e99-b63a-4dc1-bfd6-f0af6b7494e8 admin admin] Request body: {'network': {'name': 'tempest-VolumesSnapshotTestJSON-62162564-network', 'tenant_id': '577cab8b312e435c94d7b8d6c6f1929d'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:55:51.561821 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57b8169c-e05d-4d90-a170-be1baa98c9e5 req-3ba81413-92c3-4ce8-afb5-b9ed116da76b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:51.563378 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-57b8169c-e05d-4d90-a170-be1baa98c9e5 req-3ba81413-92c3-4ce8-afb5-b9ed116da76b service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=aaddc046689441b8ab3641f2afd07c0e&device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 1098 time: 0.0501540 Nov 02 12:55:51.647158 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-e3413e99-b63a-4dc1-bfd6-f0af6b7494e8 admin admin] Made reservation on behalf of 577cab8b312e435c94d7b8d6c6f1929d for: {'network': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:55:51.649464 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e3413e99-b63a-4dc1-bfd6-f0af6b7494e8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for network, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:51.662584 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e3413e99-b63a-4dc1-bfd6-f0af6b7494e8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:51.690833 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57b8169c-e05d-4d90-a170-be1baa98c9e5 req-f21b4120-8295-47d6-be8d-18ab75cd7801 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:51.692297 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-57b8169c-e05d-4d90-a170-be1baa98c9e5 req-f21b4120-8295-47d6-be8d-18ab75cd7801 service neutron] 10.222.0.90 "GET /v2.0/networks?id=c468f0e1-3636-49b9-90c6-b90c643ed7d1 HTTP/1.1" status: 200 len: 917 time: 0.1212819 Nov 02 12:55:51.692581 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-257e3235-e766-4e7c-a12f-a0bbf0aeb559 req-4de50e47-eee2-47db-aec9-b2f9f63a0dbc tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:51.695862 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-257e3235-e766-4e7c-a12f-a0bbf0aeb559 req-4de50e47-eee2-47db-aec9-b2f9f63a0dbc tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.0729566 Nov 02 12:55:51.769606 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-257e3235-e766-4e7c-a12f-a0bbf0aeb559 req-2519113d-ad4c-4daa-87bd-e8c6da6babc4 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0673144 Nov 02 12:55:51.791993 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-57b8169c-e05d-4d90-a170-be1baa98c9e5 req-4d6659ba-4096-4909-bb0e-f6d7fbd4c6d7 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b2c052d8-c7f4-4790-afab-5f3766f86877 HTTP/1.1" status: 200 len: 999 time: 0.0875771 Nov 02 12:55:51.811427 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85d6c06f-c2b7-49ed-a99d-6b2de7095591 req-7c907e17-8306-4abf-b6cc-bd5dde6b61d0 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:51.813179 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-85d6c06f-c2b7-49ed-a99d-6b2de7095591 req-7c907e17-8306-4abf-b6cc-bd5dde6b61d0 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0581720 Nov 02 12:55:51.857349 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e3413e99-b63a-4dc1-bfd6-f0af6b7494e8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:51.865270 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57b8169c-e05d-4d90-a170-be1baa98c9e5 req-48c55ac3-af76-484f-a529-9acb9aa6b595 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:51.866771 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-57b8169c-e05d-4d90-a170-be1baa98c9e5 req-48c55ac3-af76-484f-a529-9acb9aa6b595 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=ec48fe57-a1cd-4e7c-874f-073624f71f4b HTTP/1.1" status: 200 len: 855 time: 0.0663803 Nov 02 12:55:51.869321 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-85d6c06f-c2b7-49ed-a99d-6b2de7095591 req-1caf0d7f-45a1-4d40-8c69-33e438baa949 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0496988 Nov 02 12:55:51.929366 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-57b8169c-e05d-4d90-a170-be1baa98c9e5 req-c36fdefa-0332-4cd9-95be-3ac7afc36533 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:51.932156 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-57b8169c-e05d-4d90-a170-be1baa98c9e5 req-c36fdefa-0332-4cd9-95be-3ac7afc36533 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=c468f0e1-3636-49b9-90c6-b90c643ed7d1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0503809 Nov 02 12:55:51.963441 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e3413e99-b63a-4dc1-bfd6-f0af6b7494e8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:52.028351 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-e3413e99-b63a-4dc1-bfd6-f0af6b7494e8 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 863} {{(pid=108542) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 02 12:55:52.037915 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-58505679-37e1-41eb-8cf5-757750a59143 req-f698a456-9d84-4260-9d7a-52122b77288e tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:52.039555 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-58505679-37e1-41eb-8cf5-757750a59143 req-f698a456-9d84-4260-9d7a-52122b77288e tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 945 time: 0.0523407 Nov 02 12:55:52.045533 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3413e99-b63a-4dc1-bfd6-f0af6b7494e8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:55:52.053561 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e3413e99-b63a-4dc1-bfd6-f0af6b7494e8 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:52.053870 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.db.segments_db [None req-e3413e99-b63a-4dc1-bfd6-f0af6b7494e8 admin admin] Added segment e33ebaf8-f9b3-489e-9197-c5c63e968f23 of type vlan for network 8e873280-f41f-4e9c-a802-c6eb6e9e490f Nov 02 12:55:52.091505 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-58505679-37e1-41eb-8cf5-757750a59143 req-d68b1b2c-762b-467c-b7c9-dd9b97c67cff tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0453024 Nov 02 12:55:52.095031 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-57b8169c-e05d-4d90-a170-be1baa98c9e5 req-42feeb83-92a3-4960-a44c-8988e0cd6c04 service neutron] 10.222.0.90 "GET /v2.0/networks/c468f0e1-3636-49b9-90c6-b90c643ed7d1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1553957 Nov 02 12:55:52.114817 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e3413e99-b63a-4dc1-bfd6-f0af6b7494e8 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738449409639'] for network, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:52.208651 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-57b8169c-e05d-4d90-a170-be1baa98c9e5 req-85901001-0921-456f-a518-dc132196f8f3 service neutron] 10.222.0.90 "GET /v2.0/networks/c468f0e1-3636-49b9-90c6-b90c643ed7d1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1026158 Nov 02 12:55:52.278757 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e3413e99-b63a-4dc1-bfd6-f0af6b7494e8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for network, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:52.279734 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-e3413e99-b63a-4dc1-bfd6-f0af6b7494e8 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:52.280326 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e3413e99-b63a-4dc1-bfd6-f0af6b7494e8 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:52.342348 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e3413e99-b63a-4dc1-bfd6-f0af6b7494e8 admin admin] Pushing event updated for resources: {'Network': ['ID=8e873280-f41f-4e9c-a802-c6eb6e9e490f,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:55:52.352434 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Network 8e873280-f41f-4e9c-a802-c6eb6e9e490f details requested by agent ovs-agent-dv-cinder-816324-1-iscsi with host dv-cinder-816324-1-iscsi {{(pid=108544) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 02 12:55:52.412984 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-e3413e99-b63a-4dc1-bfd6-f0af6b7494e8 admin admin] 10.222.0.98 "POST /v2.0/networks HTTP/1.1" status: 201 len: 885 time: 1.0114236 Nov 02 12:55:52.416077 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 34400) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:55:52.425264 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-839c9f80-4e9f-4416-b6cf-d58680da1735 admin admin] Request body: {'subnet': {'network_id': '8e873280-f41f-4e9c-a802-c6eb6e9e490f', 'cidr': '172.20.0.0/28', 'name': 'tempest-VolumesSnapshotTestJSON-62162564-subnet', 'tenant_id': '577cab8b312e435c94d7b8d6c6f1929d', 'enable_dhcp': False, 'ip_version': 4}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:55:52.557393 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-839c9f80-4e9f-4416-b6cf-d58680da1735 admin admin] Made reservation on behalf of 577cab8b312e435c94d7b8d6c6f1929d for: {'subnet': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:55:52.559822 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-839c9f80-4e9f-4416-b6cf-d58680da1735 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126244823'] for subnet, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:52.843665 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-839c9f80-4e9f-4416-b6cf-d58680da1735 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126393185', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126244837'] for subnet, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:52.932702 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-839c9f80-4e9f-4416-b6cf-d58680da1735 admin admin] Pushing event updated for resources: {'Subnet': ['ID=c76b8d78-f8d1-4c53-8f06-2a9d4330c04a,revision_number=0']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:55:52.954585 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-15a6e69a-7b08-4a9c-938d-cdf1bf1c6e9f req-123462ee-a77e-41a2-bb52-cff596811d89 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:52.956079 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-15a6e69a-7b08-4a9c-938d-cdf1bf1c6e9f req-123462ee-a77e-41a2-bb52-cff596811d89 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 943 time: 0.1043863 Nov 02 12:55:52.958928 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-839c9f80-4e9f-4416-b6cf-d58680da1735 admin admin] Checking segment: {'id': 'e33ebaf8-f9b3-489e-9197-c5c63e968f23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': '8e873280-f41f-4e9c-a802-c6eb6e9e490f'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108543) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:55:52.959281 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-839c9f80-4e9f-4416-b6cf-d58680da1735 admin admin] Network hostable DHCP agents. Network: 8e873280-f41f-4e9c-a802-c6eb6e9e490f, hostable agents: ['1b947f40-f8bf-4088-a5dc-35ee29d90d78'], hosted agents: [] {{(pid=108543) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 02 12:55:53.048149 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2c23d41-0f68-4ade-b254-0618afa58674 req-64fc1307-0ec9-4a25-82f0-945e978f21a2 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:53.049618 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e2c23d41-0f68-4ade-b254-0618afa58674 req-64fc1307-0ec9-4a25-82f0-945e978f21a2 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 945 time: 0.0926874 Nov 02 12:55:53.053669 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-15a6e69a-7b08-4a9c-938d-cdf1bf1c6e9f req-c57ef891-ba7f-4d7d-8bfb-1c443b0a537f tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0841396 Nov 02 12:55:53.097729 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-839c9f80-4e9f-4416-b6cf-d58680da1735 admin admin] Network 8e873280-f41f-4e9c-a802-c6eb6e9e490f is scheduled to be hosted by DHCP agent 1b947f40-f8bf-4088-a5dc-35ee29d90d78 with binding_index 1 {{(pid=108543) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 02 12:55:53.103810 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e2c23d41-0f68-4ade-b254-0618afa58674 req-462e68ba-8651-436c-a24e-f48f1f8699a6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482495 Nov 02 12:55:53.205848 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3d14afd-3f22-46f5-b56a-a3d3f8cb0d62 req-f5c3f618-5d6f-4f93-9cbe-ec1e1f29b2f5 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:53.207337 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a3d14afd-3f22-46f5-b56a-a3d3f8cb0d62 req-f5c3f618-5d6f-4f93-9cbe-ec1e1f29b2f5 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 945 time: 0.0493479 Nov 02 12:55:53.257819 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a3d14afd-3f22-46f5-b56a-a3d3f8cb0d62 req-4b9f2965-cfa2-41a3-ad46-75477a898489 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0445702 Nov 02 12:55:53.258884 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [None req-839c9f80-4e9f-4416-b6cf-d58680da1735 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816324-1-iscsi, 8e873280-f41f-4e9c-a802-c6eb6e9e490f) {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:55:53.264190 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-839c9f80-4e9f-4416-b6cf-d58680da1735 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:53.265386 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-839c9f80-4e9f-4416-b6cf-d58680da1735 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for subnet, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:53.268468 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7c5ba07e-0eaa-4b36-bb85-280e7cbfee54 None None] Network 8e873280-f41f-4e9c-a802-c6eb6e9e490f requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:55:53.321820 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device af83efde-b4cd-446b-9f74-15c631e4c45a details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 12:55:53.324216 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device b2c052d8-c7f4-4790-afab-5f3766f86877 no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:55:53.372439 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-839c9f80-4e9f-4416-b6cf-d58680da1735 admin admin] 10.222.0.98 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 849 time: 0.9551876 Nov 02 12:55:53.530088 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2ce60bb-2e29-4ced-af3d-648010985f71 None None] Network 8e873280-f41f-4e9c-a802-c6eb6e9e490f requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:55:53.610405 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-9b12b51b-49c3-44a9-a422-e6c5390424d6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:53.611774 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:53.614997 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port af83efde-b4cd-446b-9f74-15c631e4c45a, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=af83efde-b4cd-446b-9f74-15c631e4c45a,segment=NetworkSegment(e206345e-67db-4144-84ee-50b4e5db5d75),segment_id=e206345e-67db-4144-84ee-50b4e5db5d75)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:55:53.770563 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': 'af83efde-b4cd-446b-9f74-15c631e4c45a', 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3', 'port_id': 'af83efde-b4cd-446b-9f74-15c631e4c45a', 'mac_address': 'fa:16:3e:85:c9:af', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 874, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '9a20b259-01c2-4b3f-8f92-0797a18ff7f7', 'ip_address': '172.20.0.7'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 12:55:53.794009 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a1984910-3b5c-43f5-8727-1c65226b3983', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'b2c052d8-c7f4-4790-afab-5f3766f86877'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:55:53.796304 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c58bba3f-6124-4d54-b90a-70abe37ce1d5" -d '{"events": [{"server_uuid": "a1984910-3b5c-43f5-8727-1c65226b3983", "name": "network-vif-unplugged", "status": "completed", "tag": "b2c052d8-c7f4-4790-afab-5f3766f86877"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:55:53.838171 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port b2c052d8-c7f4-4790-afab-5f3766f86877, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=b2c052d8-c7f4-4790-afab-5f3766f86877,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:55:53.838171 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 185 Content-Type: application/json Date: Tue, 02 Nov 2021 12:55:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-61d91a88-839e-4ed7-9a9e-2edf149a538e x-openstack-request-id: req-61d91a88-839e-4ed7-9a9e-2edf149a538e {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:55:53.838171 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a1984910-3b5c-43f5-8727-1c65226b3983", "name": "network-vif-unplugged", "status": "completed", "tag": "b2c052d8-c7f4-4790-afab-5f3766f86877", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:55:53.838171 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-61d91a88-839e-4ed7-9a9e-2edf149a538e {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:55:53.838171 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a1984910-3b5c-43f5-8727-1c65226b3983', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': 'b2c052d8-c7f4-4790-afab-5f3766f86877', 'code': 200} Nov 02 12:55:53.883012 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:53.896261 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id af83efde-b4cd-446b-9f74-15c631e4c45a {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:55:53.915648 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port af83efde-b4cd-446b-9f74-15c631e4c45a, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=af83efde-b4cd-446b-9f74-15c631e4c45a,segment=NetworkSegment(e206345e-67db-4144-84ee-50b4e5db5d75),segment_id=e206345e-67db-4144-84ee-50b4e5db5d75)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:55:53.964926 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:53.999284 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:54.019741 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=b2c052d8-c7f4-4790-afab-5f3766f86877,revision_number=8']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:55:54.069769 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=af83efde-b4cd-446b-9f74-15c631e4c45a,revision_number=7']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:55:54.171085 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9792d2bb-1ef9-40fd-ab17-7be04b1833d2 req-2a0c07ef-4443-4731-9479-1123f8efb473 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:54.172585 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9792d2bb-1ef9-40fd-ab17-7be04b1833d2 req-2a0c07ef-4443-4731-9479-1123f8efb473 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 944 time: 0.0507727 Nov 02 12:55:54.265819 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cae3c7cd-61fd-436b-8015-61374c5a58e0 req-3b18454a-a4d0-4a07-ba87-2b094abb9d25 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:54.267396 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cae3c7cd-61fd-436b-8015-61374c5a58e0 req-3b18454a-a4d0-4a07-ba87-2b094abb9d25 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 943 time: 0.0863137 Nov 02 12:55:54.270183 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['af83efde-b4cd-446b-9f74-15c631e4c45a'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:55:54.271399 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9792d2bb-1ef9-40fd-ab17-7be04b1833d2 req-b2bf2cc6-155d-4951-9736-b8d52aad7dfd tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0929999 Nov 02 12:55:54.344061 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cae3c7cd-61fd-436b-8015-61374c5a58e0 req-bc91f35c-62ac-4fa2-abf4-8987a0e9023e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0682468 Nov 02 12:55:54.402160 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12dd5210-2a40-4b47-a6d4-eb4803b67f35 req-6af96400-7745-44c7-a4b1-cb6130e4003a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:54.411378 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-12dd5210-2a40-4b47-a6d4-eb4803b67f35 req-6af96400-7745-44c7-a4b1-cb6130e4003a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 945 time: 0.0656276 Nov 02 12:55:54.467147 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-12dd5210-2a40-4b47-a6d4-eb4803b67f35 req-d4784dd7-e639-48ad-ba71-12f0ad664a9e tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0548544 Nov 02 12:55:55.317283 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device af83efde-b4cd-446b-9f74-15c631e4c45a up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:55:55.379370 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port af83efde-b4cd-446b-9f74-15c631e4c45a triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:55:55.381761 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:55.406917 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-724877e1-1a95-4f46-93fd-2669d5e572c8 req-a29bfc2f-415a-4dc6-a470-b63391d00fd1 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:55.406917 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-724877e1-1a95-4f46-93fd-2669d5e572c8 req-a29bfc2f-415a-4dc6-a470-b63391d00fd1 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 944 time: 0.0598536 Nov 02 12:55:55.468350 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:55.477637 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-724877e1-1a95-4f46-93fd-2669d5e572c8 req-7fe6ccf0-bc58-4588-ba89-eb5704efede4 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0693407 Nov 02 12:55:55.498442 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba6954cc-0454-46d1-a271-287217d8fcea req-7eca088a-32c5-4dd5-8224-0e5f85e1fd21 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:55.500364 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ba6954cc-0454-46d1-a271-287217d8fcea req-7eca088a-32c5-4dd5-8224-0e5f85e1fd21 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 943 time: 0.0656030 Nov 02 12:55:55.509220 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port af83efde-b4cd-446b-9f74-15c631e4c45a, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=af83efde-b4cd-446b-9f74-15c631e4c45a,segment=NetworkSegment(e206345e-67db-4144-84ee-50b4e5db5d75),segment_id=e206345e-67db-4144-84ee-50b4e5db5d75)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:55:55.577389 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ba6954cc-0454-46d1-a271-287217d8fcea req-0a8a8557-7057-44fc-8368-5b5cb877a879 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0618639 Nov 02 12:55:55.610192 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:55.611105 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 3023afb1-be90-4a32-980f-5f0fb88dc7be no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:55:55.617718 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9774a511-fb0e-4ae9-9bb3-53e7f2d47351 req-fbb3fecc-f76b-496e-87de-54973538524b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:55.619423 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9774a511-fb0e-4ae9-9bb3-53e7f2d47351 req-fbb3fecc-f76b-496e-87de-54973538524b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 945 time: 0.0607476 Nov 02 12:55:55.689760 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=af83efde-b4cd-446b-9f74-15c631e4c45a,revision_number=8']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:55:55.704516 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9774a511-fb0e-4ae9-9bb3-53e7f2d47351 req-db308edb-95c2-48ac-be37-4498d20ce955 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0766902 Nov 02 12:55:55.727312 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5601a55a-619c-4fcb-a0bb-9dd8a541de5a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:55.743656 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:55.783263 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 3023afb1-be90-4a32-980f-5f0fb88dc7be, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=3023afb1-be90-4a32-980f-5f0fb88dc7be,segment=NetworkSegment(c8ecb7dc-9cc8-47a7-94e7-62f066a97c10),segment_id=c8ecb7dc-9cc8-47a7-94e7-62f066a97c10)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:55:55.795662 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-527af99a-7594-437e-b871-d06db1b6d641 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:55.797233 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-527af99a-7594-437e-b871-d06db1b6d641 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/networks?id=8e873280-f41f-4e9c-a802-c6eb6e9e490f HTTP/1.1" status: 200 len: 812 time: 0.1219966 Nov 02 12:55:55.816180 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-a263b7b5-5173-4266-bea6-3f17d6c54ebf tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/quotas/577cab8b312e435c94d7b8d6c6f1929d HTTP/1.1" status: 200 len: 375 time: 0.0095630 Nov 02 12:55:55.839325 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'af83efde-b4cd-446b-9f74-15c631e4c45a'}, {'server_uuid': '23093020-2f8f-4aae-9657-27e0ea5d79b5', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '3023afb1-be90-4a32-980f-5f0fb88dc7be'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:55:55.841892 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-89723f7c-b679-40f0-89d3-4bc1ca20cf77" -d '{"events": [{"server_uuid": "d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8", "name": "network-vif-plugged", "status": "completed", "tag": "af83efde-b4cd-446b-9f74-15c631e4c45a"}, {"server_uuid": "23093020-2f8f-4aae-9657-27e0ea5d79b5", "name": "network-vif-unplugged", "status": "completed", "tag": "3023afb1-be90-4a32-980f-5f0fb88dc7be"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:55:55.847032 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-05516050-1d64-4741-8a84-f3d315fa240c tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?tenant_id=577cab8b312e435c94d7b8d6c6f1929d&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0273952 Nov 02 12:55:55.866153 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:55.866913 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device b2c052d8-c7f4-4790-afab-5f3766f86877 no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:55:55.944383 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=3023afb1-be90-4a32-980f-5f0fb88dc7be,revision_number=6']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:55:55.996901 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-3193c554-f8b1-4163-97bd-e0deab9cbb47 service neutron] 10.222.0.98 "GET /v2.0/networks/8e873280-f41f-4e9c-a802-c6eb6e9e490f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1428204 Nov 02 12:55:56.093213 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-107af546-c533-4b52-b9bb-65c11d037b87 service neutron] 10.222.0.98 "GET /v2.0/networks/8e873280-f41f-4e9c-a802-c6eb6e9e490f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0900028 Nov 02 12:55:56.449167 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 356 Content-Type: application/json Date: Tue, 02 Nov 2021 12:55:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bacc5e74-adf7-4685-9d7d-287d0b647244 x-openstack-request-id: req-bacc5e74-adf7-4685-9d7d-287d0b647244 {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:55:56.449655 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8", "name": "network-vif-plugged", "status": "completed", "tag": "af83efde-b4cd-446b-9f74-15c631e4c45a", "code": 200}, {"server_uuid": "23093020-2f8f-4aae-9657-27e0ea5d79b5", "name": "network-vif-unplugged", "status": "completed", "tag": "3023afb1-be90-4a32-980f-5f0fb88dc7be", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:55:56.449981 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-bacc5e74-adf7-4685-9d7d-287d0b647244 {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:55:56.450689 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'af83efde-b4cd-446b-9f74-15c631e4c45a', 'code': 200} Nov 02 12:55:56.451036 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '23093020-2f8f-4aae-9657-27e0ea5d79b5', 'name': 'network-vif-unplugged', 'status': 'completed', 'tag': '3023afb1-be90-4a32-980f-5f0fb88dc7be', 'code': 200} Nov 02 12:55:56.510080 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ddf45830-ecd1-4786-aa39-aadf0ede5819 req-cb0b6061-f70a-43b2-b10a-a8ce289a29f8 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 210 time: 0.0290937 Nov 02 12:55:56.617432 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-12cfe564-3745-4090-be89-9e68d29b5a58 req-4eeea814-87cc-44d1-b4d2-4f4fa3cc80fb tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:56.619009 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-12cfe564-3745-4090-be89-9e68d29b5a58 req-4eeea814-87cc-44d1-b4d2-4f4fa3cc80fb tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0506511 Nov 02 12:55:56.670436 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-12cfe564-3745-4090-be89-9e68d29b5a58 req-03937954-7b37-4eb0-9df0-c63b6962eb39 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446191 Nov 02 12:55:56.827592 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3ce3ad3-16a3-47eb-8a3f-4b90d0edf63f req-2ded9c1d-4de4-4b03-86b9-f21262a2fd8b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:56.829116 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c3ce3ad3-16a3-47eb-8a3f-4b90d0edf63f req-2ded9c1d-4de4-4b03-86b9-f21262a2fd8b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 943 time: 0.0540507 Nov 02 12:55:56.885642 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c3ce3ad3-16a3-47eb-8a3f-4b90d0edf63f req-92099f43-e03a-406f-a1b8-56195da2fd62 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0502567 Nov 02 12:55:56.891903 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9b84cad-f870-4a80-86aa-543e9c18d0f7 req-261972b2-c069-4904-9245-f64484b20741 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:56.893474 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-e9b84cad-f870-4a80-86aa-543e9c18d0f7 req-261972b2-c069-4904-9245-f64484b20741 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 1098 time: 0.0423248 Nov 02 12:55:56.907321 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:57.221292 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-e9b84cad-f870-4a80-86aa-543e9c18d0f7 req-e8ab6650-2fbe-4023-852e-fd9e21a7c5ea service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.3143704 Nov 02 12:55:57.592872 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4b27fb0d-b2e0-455b-ab47-1bec5106e383 req-39d8fd5f-3519-4956-99e5-69eb2ab5525c tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 210 time: 0.0270476 Nov 02 12:55:57.794409 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aa0e5d89-3701-40e7-a8e3-35972eaea516 req-596bce9b-372f-4d81-8b27-3b1908ce5fbe tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:57.795893 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-aa0e5d89-3701-40e7-a8e3-35972eaea516 req-596bce9b-372f-4d81-8b27-3b1908ce5fbe tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0505362 Nov 02 12:55:57.846989 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-aa0e5d89-3701-40e7-a8e3-35972eaea516 req-d82f98e4-4e94-41c4-a875-beac85841800 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451777 Nov 02 12:55:57.927268 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1fb8b0a9-7e92-45a6-8bd1-546adaf7d89b req-4be08e7f-7eaf-42bc-94db-ed41bcd3207f tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:57.933947 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-1fb8b0a9-7e92-45a6-8bd1-546adaf7d89b req-4be08e7f-7eaf-42bc-94db-ed41bcd3207f tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.90 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 943 time: 0.0490613 Nov 02 12:55:58.009187 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-032b48d9-b7b1-4ae3-a90b-1c52a649e390 req-8360595b-6ad2-44d2-952f-bf67690bac10 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:58.011079 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-032b48d9-b7b1-4ae3-a90b-1c52a649e390 req-8360595b-6ad2-44d2-952f-bf67690bac10 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 943 time: 0.0559008 Nov 02 12:55:58.038497 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [req-1fb8b0a9-7e92-45a6-8bd1-546adaf7d89b req-e26f5d80-ae46-4063-90c2-23b14990aee4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Deleting port 3023afb1-be90-4a32-980f-5f0fb88dc7be {{(pid=108542) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:55:58.038842 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-1fb8b0a9-7e92-45a6-8bd1-546adaf7d89b req-e26f5d80-ae46-4063-90c2-23b14990aee4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:58.073715 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-032b48d9-b7b1-4ae3-a90b-1c52a649e390 req-e78ae7d6-3a31-4978-9df4-45936fa53b7d tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0565226 Nov 02 12:55:58.148780 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [req-1fb8b0a9-7e92-45a6-8bd1-546adaf7d89b req-e26f5d80-ae46-4063-90c2-23b14990aee4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] For port 3023afb1-be90-4a32-980f-5f0fb88dc7be, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=3023afb1-be90-4a32-980f-5f0fb88dc7be,segment=NetworkSegment(c8ecb7dc-9cc8-47a7-94e7-62f066a97c10),segment_id=c8ecb7dc-9cc8-47a7-94e7-62f066a97c10)] {{(pid=108542) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:55:58.149146 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-1fb8b0a9-7e92-45a6-8bd1-546adaf7d89b req-e26f5d80-ae46-4063-90c2-23b14990aee4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:58.329829 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-1fb8b0a9-7e92-45a6-8bd1-546adaf7d89b req-e26f5d80-ae46-4063-90c2-23b14990aee4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:58.330184 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-1fb8b0a9-7e92-45a6-8bd1-546adaf7d89b req-e26f5d80-ae46-4063-90c2-23b14990aee4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1594992'] for floatingip, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:58.330535 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.db.l3_db [req-1fb8b0a9-7e92-45a6-8bd1-546adaf7d89b req-e26f5d80-ae46-4063-90c2-23b14990aee4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Floating IP bff9f016-a411-4056-a280-4f387caba2b4 disassociated. External IP: 172.27.0.129, port: 3023afb1-be90-4a32-980f-5f0fb88dc7be. Nov 02 12:55:58.330905 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [req-1fb8b0a9-7e92-45a6-8bd1-546adaf7d89b req-e26f5d80-ae46-4063-90c2-23b14990aee4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Calling delete_port for 3023afb1-be90-4a32-980f-5f0fb88dc7be owned by compute:nova {{(pid=108542) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:55:58.347914 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:58.424505 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ed90c4cd-a0f2-4959-9683-2dbf392ded25 req-1b40ef11-fe75-4c21-a727-c89f381424b6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:58.426131 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ed90c4cd-a0f2-4959-9683-2dbf392ded25 req-1b40ef11-fe75-4c21-a727-c89f381424b6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 943 time: 0.0548079 Nov 02 12:55:58.492812 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ed90c4cd-a0f2-4959-9683-2dbf392ded25 req-49dd2707-9626-4587-a7d2-52994906ad46 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0578783 Nov 02 12:55:58.609243 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-1fb8b0a9-7e92-45a6-8bd1-546adaf7d89b req-e26f5d80-ae46-4063-90c2-23b14990aee4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:58.640093 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e26f5d80-ae46-4063-90c2-23b14990aee4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Pushing event deleted for resources: {'Port': ['ID=3023afb1-be90-4a32-980f-5f0fb88dc7be,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:55:58.710233 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-010fe433-fd87-4528-875a-2354523db466 req-57da3adb-25b4-4a1d-bdcd-b39b3f64ffd0 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 210 time: 0.0271449 Nov 02 12:55:58.792845 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.l3_agent_scheduler [req-1fb8b0a9-7e92-45a6-8bd1-546adaf7d89b req-e26f5d80-ae46-4063-90c2-23b14990aee4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108542) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 12:55:58.904579 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-1fb8b0a9-7e92-45a6-8bd1-546adaf7d89b req-e26f5d80-ae46-4063-90c2-23b14990aee4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108542) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:55:58.921933 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2effb810-6d74-4553-902b-1c24ba62d07b None None] Sync routers for ids ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'] in dv-cinder-816324-1-iscsi {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:55:58.935594 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2effb810-6d74-4553-902b-1c24ba62d07b None None] Routers {'2a2f63fd-e512-4ad2-9007-46e6ab6e8134'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:55:58.936245 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-2effb810-6d74-4553-902b-1c24ba62d07b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:55:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:55:58.954682 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [req-1fb8b0a9-7e92-45a6-8bd1-546adaf7d89b req-e26f5d80-ae46-4063-90c2-23b14990aee4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] No DVR routers for this DVR port 3023afb1-be90-4a32-980f-5f0fb88dc7be on host hv-cinder-81632 {{(pid=108542) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 12:55:58.957340 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-1fb8b0a9-7e92-45a6-8bd1-546adaf7d89b req-e26f5d80-ae46-4063-90c2-23b14990aee4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:58.960998 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-1fb8b0a9-7e92-45a6-8bd1-546adaf7d89b req-e26f5d80-ae46-4063-90c2-23b14990aee4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.90 "DELETE /v2.0/ports/3023afb1-be90-4a32-980f-5f0fb88dc7be HTTP/1.1" status: 204 len: 173 time: 1.0182028 Nov 02 12:55:58.969766 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '23093020-2f8f-4aae-9657-27e0ea5d79b5', 'name': 'network-vif-deleted', 'tag': '3023afb1-be90-4a32-980f-5f0fb88dc7be'}] {{(pid=108542) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:55:58.972071 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8fdc2194739644bb754d6b187539f80d2eba7dc5c5d5392f1a2d22d03c0a316c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-557854a0-14bd-4710-aae3-32def2449fe4" -d '{"events": [{"server_uuid": "23093020-2f8f-4aae-9657-27e0ea5d79b5", "name": "network-vif-deleted", "tag": "3023afb1-be90-4a32-980f-5f0fb88dc7be"}]}' {{(pid=108542) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:55:58.990408 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17f6a383-3691-435a-85c6-4cdcda18b837 req-64996c62-60dd-4610-b4e7-fa537ce84287 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:58.990408 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-17f6a383-3691-435a-85c6-4cdcda18b837 req-64996c62-60dd-4610-b4e7-fa537ce84287 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0595095 Nov 02 12:55:59.032152 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-107718ff-b5dd-4ef6-aabe-0d49aef068a4 req-869d0023-55b3-4f88-9069-05d422099d49 service neutron] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983&fields=id&fields=resource_request HTTP/1.1" status: 200 len: 255 time: 0.0786874 Nov 02 12:55:59.065665 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-2effb810-6d74-4553-902b-1c24ba62d07b None None] Set router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:55:59.133758 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-17f6a383-3691-435a-85c6-4cdcda18b837 req-13e349b8-4a2a-4dd1-a0d4-2c23e5808602 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1321890 Nov 02 12:55:59.160274 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:55:58 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-f1cf2c41-82a8-4031-a2cb-08863c89d318 x-openstack-request-id: req-f1cf2c41-82a8-4031-a2cb-08863c89d318 {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:55:59.160567 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "23093020-2f8f-4aae-9657-27e0ea5d79b5", "name": "network-vif-deleted", "tag": "3023afb1-be90-4a32-980f-5f0fb88dc7be", "status": "completed", "code": 200}]} {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:55:59.160818 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-f1cf2c41-82a8-4031-a2cb-08863c89d318 {{(pid=108542) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:55:59.161209 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '23093020-2f8f-4aae-9657-27e0ea5d79b5', 'name': 'network-vif-deleted', 'tag': '3023afb1-be90-4a32-980f-5f0fb88dc7be', 'status': 'completed', 'code': 200} Nov 02 12:55:59.250182 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-70fa2f5d-0426-4660-b8cb-db7125e19ea0 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:59.252020 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-70fa2f5d-0426-4660-b8cb-db7125e19ea0 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.90 "GET /v2.0/networks?id=8e873280-f41f-4e9c-a802-c6eb6e9e490f HTTP/1.1" status: 200 len: 812 time: 0.2075620 Nov 02 12:55:59.268211 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-4c303b56-ac28-4825-a023-7f4292e908ba tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Request body: {'port': {'device_id': '2e690c84-aca7-422c-9e29-cbb8b30d170f', 'network_id': '8e873280-f41f-4e9c-a802-c6eb6e9e490f', 'admin_state_up': True, 'tenant_id': '577cab8b312e435c94d7b8d6c6f1929d'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:55:59.289001 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4f79a7f8-0249-4c0a-81ae-1a1388cbffe7 req-49db1ce3-6b46-4152-857d-14f7ff34559c tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 210 time: 0.0730643 Nov 02 12:55:59.407202 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-2effb810-6d74-4553-902b-1c24ba62d07b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port': {'id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:1f:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:31Z', 'updated_at': '2021-11-02T12:51:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '80a55893-6272-4299-8834-e840aa37d37b', 'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'tenant_id': '697de566c0334435b902950f6f31da45', 'mac_address': 'fa:16:3e:64:ef:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_interface', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:48Z', 'updated_at': '2021-11-02T12:52:07Z', 'revision_number': 5, 'project_id': '697de566c0334435b902950f6f31da45', 'subnets': [{'id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:55:59.438830 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2effb810-6d74-4553-902b-1c24ba62d07b None None] Checking router: 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 for host: dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:55:59.447998 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2effb810-6d74-4553-902b-1c24ba62d07b None None] Routers {'2a2f63fd-e512-4ad2-9007-46e6ab6e8134'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:55:59.449156 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-2effb810-6d74-4553-902b-1c24ba62d07b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:55:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:55:59.518904 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-4c303b56-ac28-4825-a023-7f4292e908ba tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Made reservation on behalf of 577cab8b312e435c94d7b8d6c6f1929d for: {'port': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:55:59.522604 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-4c303b56-ac28-4825-a023-7f4292e908ba tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:55:59.580856 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-2effb810-6d74-4553-902b-1c24ba62d07b None None] Set router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:55:59.691243 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_common [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-4c303b56-ac28-4825-a023-7f4292e908ba tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Allocated IP 172.20.0.3 (8e873280-f41f-4e9c-a802-c6eb6e9e490f/c76b8d78-f8d1-4c53-8f06-2a9d4330c04a/ca5c5f21-fa79-4114-ab42-264c76de67e3) {{(pid=108542) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:55:59.695203 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d3b97d5f-013f-4070-998c-19407531ff06 req-33ad1c50-9101-4695-8435-e3e8103d00f5 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:55:59.697091 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d3b97d5f-013f-4070-998c-19407531ff06 req-33ad1c50-9101-4695-8435-e3e8103d00f5 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 943 time: 0.0784540 Nov 02 12:55:59.758314 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d3b97d5f-013f-4070-998c-19407531ff06 req-9d6d48f1-92bb-48bd-8745-41cd712c4f4a tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0545762 Nov 02 12:55:59.826761 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-2effb810-6d74-4553-902b-1c24ba62d07b None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port': {'id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:1f:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:31Z', 'updated_at': '2021-11-02T12:51:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '80a55893-6272-4299-8834-e840aa37d37b', 'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'tenant_id': '697de566c0334435b902950f6f31da45', 'mac_address': 'fa:16:3e:64:ef:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_interface', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:48Z', 'updated_at': '2021-11-02T12:52:07Z', 'revision_number': 5, 'project_id': '697de566c0334435b902950f6f31da45', 'subnets': [{'id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:55:59.839442 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8bbd5f75-b8fe-4fd1-af9f-d22bfc33d56d req-7cdb5aa3-85c0-4b71-8b5f-e2604be2afc7 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 210 time: 0.0343869 Nov 02 12:55:59.858163 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2effb810-6d74-4553-902b-1c24ba62d07b None None] The sync data for ids ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'] in dv-cinder-816324-1-iscsi is: [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port': {'id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:1f:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:31Z', 'updated_at': '2021-11-02T12:51:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '80a55893-6272-4299-8834-e840aa37d37b', 'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'tenant_id': '697de566c0334435b902950f6f31da45', 'mac_address': 'fa:16:3e:64:ef:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_interface', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:48Z', 'updated_at': '2021-11-02T12:52:07Z', 'revision_number': 5, 'project_id': '697de566c0334435b902950f6f31da45', 'subnets': [{'id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:55:59.879037 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-4c303b56-ac28-4825-a023-7f4292e908ba tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Publish callbacks [] for port, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:00.089259 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-50289fe6-953b-4976-86c1-0f8b4bd1983c None None] New status for floating IP bff9f016-a411-4056-a280-4f387caba2b4: DOWN {{(pid=108545) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 02 12:56:00.169768 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-4c303b56-ac28-4825-a023-7f4292e908ba tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:00.215995 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-4c303b56-ac28-4825-a023-7f4292e908ba tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Network 8e873280-f41f-4e9c-a802-c6eb6e9e490f is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:56:00.221389 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-4c303b56-ac28-4825-a023-7f4292e908ba tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:56:00.223925 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-4c303b56-ac28-4825-a023-7f4292e908ba tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Received port after_create {{(pid=108542) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:56:00.249665 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4c303b56-ac28-4825-a023-7f4292e908ba tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Pushing event updated for resources: {'Port': ['ID=ca5c5f21-fa79-4114-ab42-264c76de67e3,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:56:00.280779 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-4c303b56-ac28-4825-a023-7f4292e908ba tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:00.281660 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-4c303b56-ac28-4825-a023-7f4292e908ba tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:00.409283 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7517445b-1664-461c-84b7-bbb896670959 req-c431bc17-1951-4c42-8253-74b1637f09f1 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=23093020-2f8f-4aae-9657-27e0ea5d79b5 HTTP/1.1" status: 200 len: 210 time: 0.0276241 Nov 02 12:56:00.424173 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-4c303b56-ac28-4825-a023-7f4292e908ba tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.1600723 Nov 02 12:56:00.439063 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-a7e8bb24-13eb-4992-99ad-35f5d0823cbe service neutron] Request body: {'port': {'device_id': '2e690c84-aca7-422c-9e29-cbb8b30d170f', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81632'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:56:00.496079 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-a7e8bb24-13eb-4992-99ad-35f5d0823cbe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:00.773926 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.notifiers.nova [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-a7e8bb24-13eb-4992-99ad-35f5d0823cbe service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ca5c5f21-fa79-4114-ab42-264c76de67e3 {{(pid=108542) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:56:00.782274 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-a7e8bb24-13eb-4992-99ad-35f5d0823cbe service neutron] Publish callbacks [] for port, precommit_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:00.798927 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.provisioning_blocks [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-a7e8bb24-13eb-4992-99ad-35f5d0823cbe service neutron] Transition to ACTIVE for port object ca5c5f21-fa79-4114-ab42-264c76de67e3 will not be triggered until provisioned by entity L2. {{(pid=108542) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 02 12:56:00.860347 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:00.895000 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61ec1e70-8841-433f-970a-9bd6237218bb req-2092e36d-1940-425a-b47e-e41d476cb724 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:00.896547 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-61ec1e70-8841-433f-970a-9bd6237218bb req-2092e36d-1940-425a-b47e-e41d476cb724 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 943 time: 0.0556891 Nov 02 12:56:00.917333 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-a7e8bb24-13eb-4992-99ad-35f5d0823cbe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126476609'] for port, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:00.980075 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7e8bb24-13eb-4992-99ad-35f5d0823cbe service neutron] Pushing event updated for resources: {'Port': ['ID=ca5c5f21-fa79-4114-ab42-264c76de67e3,revision_number=2']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:56:00.980298 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-61ec1e70-8841-433f-970a-9bd6237218bb req-f623bf3c-a169-4c4d-b12a-3c691820a6fd tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0743215 Nov 02 12:56:00.989564 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6997e461-d0d8-4e4e-890b-c9e7c0686226 req-4ebf603e-97af-4dda-a24c-d017d3b4f950 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:00.993213 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6997e461-d0d8-4e4e-890b-c9e7c0686226 req-4ebf603e-97af-4dda-a24c-d017d3b4f950 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 943 time: 0.0831735 Nov 02 12:56:01.043744 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6997e461-d0d8-4e4e-890b-c9e7c0686226 req-c6e23b3e-1981-4f2e-a876-339c47a88905 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457182 Nov 02 12:56:01.044186 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.managers [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-a7e8bb24-13eb-4992-99ad-35f5d0823cbe service neutron] Attempting to bind port ca5c5f21-fa79-4114-ab42-264c76de67e3 on host hv-cinder-81632 for vnic_type normal with profile {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:56:01.044522 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.managers [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-a7e8bb24-13eb-4992-99ad-35f5d0823cbe service neutron] Attempting to bind port ca5c5f21-fa79-4114-ab42-264c76de67e3 by drivers openvswitch,hyperv on host hv-cinder-81632 at level 0 using segments [{'id': 'e33ebaf8-f9b3-489e-9197-c5c63e968f23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': '8e873280-f41f-4e9c-a802-c6eb6e9e490f'}] {{(pid=108542) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:56:01.044851 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-a7e8bb24-13eb-4992-99ad-35f5d0823cbe service neutron] Attempting to bind port ca5c5f21-fa79-4114-ab42-264c76de67e3 on network 8e873280-f41f-4e9c-a802-c6eb6e9e490f {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:56:01.049261 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-a7e8bb24-13eb-4992-99ad-35f5d0823cbe service neutron] Port ca5c5f21-fa79-4114-ab42-264c76de67e3 on network 8e873280-f41f-4e9c-a802-c6eb6e9e490f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81632 {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 02 12:56:01.049581 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-a7e8bb24-13eb-4992-99ad-35f5d0823cbe service neutron] Attempting to bind port ca5c5f21-fa79-4114-ab42-264c76de67e3 on network 8e873280-f41f-4e9c-a802-c6eb6e9e490f {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:56:01.054326 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-a7e8bb24-13eb-4992-99ad-35f5d0823cbe service neutron] Checking agent: {'id': '0d57fa42-4660-4f08-b7dc-53a872c3c01c', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81632', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'started_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 55, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:56:01.054738 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-a7e8bb24-13eb-4992-99ad-35f5d0823cbe service neutron] Checking segment: {'id': 'e33ebaf8-f9b3-489e-9197-c5c63e968f23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': '8e873280-f41f-4e9c-a802-c6eb6e9e490f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108542) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:56:01.055066 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-a7e8bb24-13eb-4992-99ad-35f5d0823cbe service neutron] Bound using segment: {'id': 'e33ebaf8-f9b3-489e-9197-c5c63e968f23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': '8e873280-f41f-4e9c-a802-c6eb6e9e490f'} {{(pid=108542) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:56:01.055538 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.managers [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-a7e8bb24-13eb-4992-99ad-35f5d0823cbe service neutron] Bound port: ca5c5f21-fa79-4114-ab42-264c76de67e3, host: hv-cinder-81632, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e33ebaf8-f9b3-489e-9197-c5c63e968f23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': '8e873280-f41f-4e9c-a802-c6eb6e9e490f'}}] {{(pid=108542) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:56:01.055895 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-a7e8bb24-13eb-4992-99ad-35f5d0823cbe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:01.121824 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-a7e8bb24-13eb-4992-99ad-35f5d0823cbe service neutron] For port ca5c5f21-fa79-4114-ab42-264c76de67e3, host hv-cinder-81632, cleared binding levels {{(pid=108542) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:56:01.124760 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-a7e8bb24-13eb-4992-99ad-35f5d0823cbe service neutron] For port ca5c5f21-fa79-4114-ab42-264c76de67e3, host hv-cinder-81632, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=ca5c5f21-fa79-4114-ab42-264c76de67e3,segment=NetworkSegment(e33ebaf8-f9b3-489e-9197-c5c63e968f23),segment_id=e33ebaf8-f9b3-489e-9197-c5c63e968f23)] {{(pid=108542) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:56:01.279104 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-a7e8bb24-13eb-4992-99ad-35f5d0823cbe service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126476609'] for port, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:01.314340 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-a7e8bb24-13eb-4992-99ad-35f5d0823cbe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:01.315030 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-a7e8bb24-13eb-4992-99ad-35f5d0823cbe service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:01.316412 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-a7e8bb24-13eb-4992-99ad-35f5d0823cbe service neutron] 10.222.0.90 "PUT /v2.0/ports/ca5c5f21-fa79-4114-ab42-264c76de67e3 HTTP/1.1" status: 200 len: 1093 time: 0.8815906 Nov 02 12:56:01.317458 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '2e690c84-aca7-422c-9e29-cbb8b30d170f', 'tag': 'ca5c5f21-fa79-4114-ab42-264c76de67e3'}] {{(pid=108542) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:56:01.319167 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8fdc2194739644bb754d6b187539f80d2eba7dc5c5d5392f1a2d22d03c0a316c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-eed81b37-8d00-4663-b703-22d053bb19da" -d '{"events": [{"name": "network-changed", "server_uuid": "2e690c84-aca7-422c-9e29-cbb8b30d170f", "tag": "ca5c5f21-fa79-4114-ab42-264c76de67e3"}]}' {{(pid=108542) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:56:01.344642 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a7e8bb24-13eb-4992-99ad-35f5d0823cbe service neutron] Pushing event updated for resources: {'Port': ['ID=ca5c5f21-fa79-4114-ab42-264c76de67e3,revision_number=3']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:56:01.358465 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:56:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7331c86b-3d76-4a25-a10e-dfd9d9b57b68 x-openstack-request-id: req-7331c86b-3d76-4a25-a10e-dfd9d9b57b68 {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:56:01.358757 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "2e690c84-aca7-422c-9e29-cbb8b30d170f", "tag": "ca5c5f21-fa79-4114-ab42-264c76de67e3", "status": "completed", "code": 200}]} {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:56:01.359009 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-7331c86b-3d76-4a25-a10e-dfd9d9b57b68 {{(pid=108542) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:56:01.359404 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '2e690c84-aca7-422c-9e29-cbb8b30d170f', 'tag': 'ca5c5f21-fa79-4114-ab42-264c76de67e3', 'status': 'completed', 'code': 200} Nov 02 12:56:01.438446 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eed81b37-8d00-4663-b703-22d053bb19da req-846e43d3-7bb9-402c-bdbe-49e6f6eff0d3 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:01.438968 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-107718ff-b5dd-4ef6-aabe-0d49aef068a4 req-a896acf8-7790-42c8-a9d0-ee93f53f5714 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:01.440563 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-107718ff-b5dd-4ef6-aabe-0d49aef068a4 req-a896acf8-7790-42c8-a9d0-ee93f53f5714 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983&tenant_id=aaddc046689441b8ab3641f2afd07c0e HTTP/1.1" status: 200 len: 1096 time: 0.0467076 Nov 02 12:56:01.440862 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-eed81b37-8d00-4663-b703-22d053bb19da req-846e43d3-7bb9-402c-bdbe-49e6f6eff0d3 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=577cab8b312e435c94d7b8d6c6f1929d&device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 1096 time: 0.0462737 Nov 02 12:56:01.507879 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-107718ff-b5dd-4ef6-aabe-0d49aef068a4 req-371b1cea-5143-482a-a115-01188a09e768 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:01.509391 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-107718ff-b5dd-4ef6-aabe-0d49aef068a4 req-371b1cea-5143-482a-a115-01188a09e768 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=aaddc046689441b8ab3641f2afd07c0e&device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 1096 time: 0.0429988 Nov 02 12:56:01.562521 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eed81b37-8d00-4663-b703-22d053bb19da req-d75cc436-1783-4170-912f-863fd0f07557 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:01.564052 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-eed81b37-8d00-4663-b703-22d053bb19da req-d75cc436-1783-4170-912f-863fd0f07557 service neutron] 10.222.0.90 "GET /v2.0/networks?tenant_id=577cab8b312e435c94d7b8d6c6f1929d&shared=False HTTP/1.1" status: 200 len: 913 time: 0.1103888 Nov 02 12:56:01.607887 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-107718ff-b5dd-4ef6-aabe-0d49aef068a4 req-5e955f40-bf45-4456-8214-4ed69b9baa82 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:01.609478 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-107718ff-b5dd-4ef6-aabe-0d49aef068a4 req-5e955f40-bf45-4456-8214-4ed69b9baa82 service neutron] 10.222.0.90 "GET /v2.0/networks?id=c468f0e1-3636-49b9-90c6-b90c643ed7d1 HTTP/1.1" status: 200 len: 917 time: 0.0923007 Nov 02 12:56:01.679379 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-107718ff-b5dd-4ef6-aabe-0d49aef068a4 req-1f34567d-098f-4150-ae95-4ae841e1d642 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b2c052d8-c7f4-4790-afab-5f3766f86877 HTTP/1.1" status: 200 len: 997 time: 0.0624084 Nov 02 12:56:01.697543 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-eed81b37-8d00-4663-b703-22d053bb19da req-3af36c1c-0fd7-4ac1-ac11-136911cb5f71 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:01.699621 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-eed81b37-8d00-4663-b703-22d053bb19da req-3af36c1c-0fd7-4ac1-ac11-136911cb5f71 service neutron] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1283755 Nov 02 12:56:01.713377 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-30f60c5b-7d28-4289-9558-5c6ebb217fb0 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-167174139&fields=id&tenant_id=697de566c0334435b902950f6f31da45 HTTP/1.1" status: 200 len: 267 time: 0.0682611 Nov 02 12:56:01.737207 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-107718ff-b5dd-4ef6-aabe-0d49aef068a4 req-437eefa1-22b0-4f4d-bf2d-f727fd8f2c69 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:01.738710 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-107718ff-b5dd-4ef6-aabe-0d49aef068a4 req-437eefa1-22b0-4f4d-bf2d-f727fd8f2c69 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=ec48fe57-a1cd-4e7c-874f-073624f71f4b HTTP/1.1" status: 200 len: 855 time: 0.0507283 Nov 02 12:56:01.785718 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-107718ff-b5dd-4ef6-aabe-0d49aef068a4 req-efebee8b-5c35-463d-b0a9-bdd3461bde4c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:01.787286 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-107718ff-b5dd-4ef6-aabe-0d49aef068a4 req-efebee8b-5c35-463d-b0a9-bdd3461bde4c service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=c468f0e1-3636-49b9-90c6-b90c643ed7d1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0405395 Nov 02 12:56:01.841747 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-edbc005a-2fe1-4c38-9214-46feda0c77b4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:01.843204 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-edbc005a-2fe1-4c38-9214-46feda0c77b4 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=577cab8b312e435c94d7b8d6c6f1929d&device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 1096 time: 0.0922813 Nov 02 12:56:01.865090 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-af7b04e6-815a-466e-9f13-ea508a6c52f6 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:01.866593 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-af7b04e6-815a-466e-9f13-ea508a6c52f6 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/networks?id=89f406ae-1b9f-4be7-8881-87075d7c5aa1 HTTP/1.1" status: 200 len: 812 time: 0.1453552 Nov 02 12:56:01.886178 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-107718ff-b5dd-4ef6-aabe-0d49aef068a4 req-bc349927-c80a-41df-9d57-99f0314865c4 service neutron] 10.222.0.90 "GET /v2.0/networks/c468f0e1-3636-49b9-90c6-b90c643ed7d1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0916207 Nov 02 12:56:01.908614 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-ae2c1385-48ff-4da3-9096-595722221de2 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.3&port_id=ca5c5f21-fa79-4114-ab42-264c76de67e3 HTTP/1.1" status: 200 len: 217 time: 0.0563600 Nov 02 12:56:01.911000 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-cfe4d8cf-f84a-4592-a66b-c21511f1799c tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/quotas/697de566c0334435b902950f6f31da45 HTTP/1.1" status: 200 len: 375 time: 0.0112486 Nov 02 12:56:01.981989 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-107718ff-b5dd-4ef6-aabe-0d49aef068a4 req-6fab1800-61be-42b6-b4b5-0a17a64e128e service neutron] 10.222.0.90 "GET /v2.0/networks/c468f0e1-3636-49b9-90c6-b90c643ed7d1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0886617 Nov 02 12:56:01.988113 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-80b2542b-e996-40ec-b643-7419522e93c4 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:01.989544 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-80b2542b-e996-40ec-b643-7419522e93c4 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=c76b8d78-f8d1-4c53-8f06-2a9d4330c04a HTTP/1.1" status: 200 len: 852 time: 0.0746403 Nov 02 12:56:02.014550 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-eabfebb1-89cb-47ce-88d6-6fb18bec2327 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?tenant_id=697de566c0334435b902950f6f31da45&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0909698 Nov 02 12:56:02.030516 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-daa27c86-06bf-4d76-80a4-2bd6708b3561 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=8e873280-f41f-4e9c-a802-c6eb6e9e490f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0338163 Nov 02 12:56:02.208583 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-3f89f831-f811-422b-8680-dd2d94fc3589 service neutron] 10.222.0.98 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1803644 Nov 02 12:56:02.233865 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-7e31815b-204d-481b-8e30-39f26c809863 service neutron] 10.222.0.90 "GET /v2.0/networks/8e873280-f41f-4e9c-a802-c6eb6e9e490f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1953866 Nov 02 12:56:02.249751 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ceeea7b-1559-43a5-9333-581ba056ebde req-5ade99fd-a173-4f7d-8776-64b26779f25c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:02.251237 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3ceeea7b-1559-43a5-9333-581ba056ebde req-5ade99fd-a173-4f7d-8776-64b26779f25c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 943 time: 0.1790388 Nov 02 12:56:02.413445 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3ceeea7b-1559-43a5-9333-581ba056ebde req-06ef568e-29e0-429f-8596-54a1aaebfbf9 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1478882 Nov 02 12:56:02.438467 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-ceaa43dc-f3e5-4b36-9f32-96df0c332e32 service neutron] 10.222.0.98 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.2112472 Nov 02 12:56:02.438467 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d4288ec7-3fdd-4db2-b237-feb038dd51ff req-90fd282a-1a86-43a5-85ec-fbd4b5f70bf8 service neutron] 10.222.0.90 "GET /v2.0/networks/8e873280-f41f-4e9c-a802-c6eb6e9e490f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1823509 Nov 02 12:56:02.536928 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-31b5dd87-e549-4561-b7bc-f96396a77ee3 req-71d79423-a355-4e47-ac71-bb6e954f793b tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:02.538574 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-31b5dd87-e549-4561-b7bc-f96396a77ee3 req-71d79423-a355-4e47-ac71-bb6e954f793b tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 943 time: 0.0623934 Nov 02 12:56:02.593808 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-31b5dd87-e549-4561-b7bc-f96396a77ee3 req-0c1baad4-9d7a-4bb1-9dd6-6df4daed1241 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0473835 Nov 02 12:56:03.311035 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a9e43d85-8535-421f-b817-2c21a9ce279e req-db6b4a7b-7202-448a-8fe7-e062b687428b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 210 time: 0.0626674 Nov 02 12:56:03.353060 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:03.549727 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3cabf16b-e825-4edc-9dc4-1aa961c4abc8 req-660ed1fa-120d-4218-a62e-743389a44cd9 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:03.551338 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3cabf16b-e825-4edc-9dc4-1aa961c4abc8 req-660ed1fa-120d-4218-a62e-743389a44cd9 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 943 time: 0.0558612 Nov 02 12:56:03.601101 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3cabf16b-e825-4edc-9dc4-1aa961c4abc8 req-dc99752c-f47a-4e79-842b-c97a740b66a1 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435226 Nov 02 12:56:03.733536 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-40648fad-4a3c-4db6-a456-2ed5c66d0116 req-4ad09b87-941b-4104-b837-216d60aec251 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:03.735133 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-40648fad-4a3c-4db6-a456-2ed5c66d0116 req-4ad09b87-941b-4104-b837-216d60aec251 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 943 time: 0.0533783 Nov 02 12:56:03.787953 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-40648fad-4a3c-4db6-a456-2ed5c66d0116 req-32f6cfd1-3962-48c4-be57-112a790bf09d tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0464654 Nov 02 12:56:04.400557 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a9e4a991-8cb7-45cf-89ca-def4ebcfe5e5 req-fe5e766d-6f93-47e6-886c-f1ee5a406351 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 210 time: 0.0266900 Nov 02 12:56:04.748709 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1897fc87-23b0-49be-b0f1-123a7ffd5453 req-211ea509-2ced-40e3-9aaa-ff5a9db41027 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:04.750282 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1897fc87-23b0-49be-b0f1-123a7ffd5453 req-211ea509-2ced-40e3-9aaa-ff5a9db41027 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 943 time: 0.0575004 Nov 02 12:56:04.801677 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1897fc87-23b0-49be-b0f1-123a7ffd5453 req-b087dea4-b14d-45ab-a926-4561fa382207 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0453804 Nov 02 12:56:04.920357 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3e3fdd4f-68fb-4031-84de-39bf380c9f0c req-0c16d72d-4e29-4501-95c2-74209e55afce tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:04.921824 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3e3fdd4f-68fb-4031-84de-39bf380c9f0c req-0c16d72d-4e29-4501-95c2-74209e55afce tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 943 time: 0.0535548 Nov 02 12:56:04.973901 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3e3fdd4f-68fb-4031-84de-39bf380c9f0c req-6c8927da-9245-4c33-ab45-c79d2db31ae4 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0450804 Nov 02 12:56:05.496624 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c9c1adcb-910d-4f8d-af98-51337fe4723e req-2b7ed89b-37ab-467e-9e86-f954cf038c24 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 210 time: 0.0275145 Nov 02 12:56:05.929664 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-44992c0c-1648-4566-8429-b10f456e560e req-862b4914-d9e6-45d8-bb2c-7c9b3ad300ba tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:05.931629 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-44992c0c-1648-4566-8429-b10f456e560e req-862b4914-d9e6-45d8-bb2c-7c9b3ad300ba tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 943 time: 0.0552158 Nov 02 12:56:05.982632 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-44992c0c-1648-4566-8429-b10f456e560e req-bb148cfd-dc49-4836-9cca-078e698219d0 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440331 Nov 02 12:56:06.101448 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68139da7-6d71-44ec-9d11-410fd7353be8 req-b30e9a37-e54c-435f-b63a-46f4c2019d50 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:06.102883 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-68139da7-6d71-44ec-9d11-410fd7353be8 req-b30e9a37-e54c-435f-b63a-46f4c2019d50 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 943 time: 0.0507798 Nov 02 12:56:06.153307 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-68139da7-6d71-44ec-9d11-410fd7353be8 req-9a8c0588-1487-48e5-b6b2-d8ca0d8f26bd tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0433273 Nov 02 12:56:06.600617 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2cc6e1ea-8f53-41a6-aa96-e35e6444b004 req-25d2f7c9-793d-4f41-b1f8-10451355da27 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 210 time: 0.0320008 Nov 02 12:56:07.110510 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d34cb2b6-9cbe-4948-94df-3736a33cb29d req-eb99b65e-95ae-47af-b796-d4b7a327d82d tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:07.112024 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d34cb2b6-9cbe-4948-94df-3736a33cb29d req-eb99b65e-95ae-47af-b796-d4b7a327d82d tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 943 time: 0.0530138 Nov 02 12:56:07.163620 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d34cb2b6-9cbe-4948-94df-3736a33cb29d req-f2985aa5-71fa-44fa-9056-64f0dad169d5 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455923 Nov 02 12:56:07.292843 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cf9bc11-8d3e-4a5c-8bf6-a937e4d82648 req-9c80171e-77dd-4e35-b2a6-aec43b832aef tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:07.294340 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8cf9bc11-8d3e-4a5c-8bf6-a937e4d82648 req-9c80171e-77dd-4e35-b2a6-aec43b832aef tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 943 time: 0.0558636 Nov 02 12:56:07.345381 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8cf9bc11-8d3e-4a5c-8bf6-a937e4d82648 req-8a36b9f7-fdb3-441f-8e17-aa72bb465f2f tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451319 Nov 02 12:56:07.697838 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0e1a22e9-604a-4dd6-b270-cc63b55b5678 req-09e51105-81da-45cc-8db6-d512d19a6625 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 210 time: 0.0275366 Nov 02 12:56:08.293794 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4e7caa7a-9300-44e8-8cec-11af64c676c7 req-dc7c208e-42d1-4070-8b2c-c9bb1cf31a41 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:08.295321 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4e7caa7a-9300-44e8-8cec-11af64c676c7 req-dc7c208e-42d1-4070-8b2c-c9bb1cf31a41 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 943 time: 0.0543604 Nov 02 12:56:08.348992 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4e7caa7a-9300-44e8-8cec-11af64c676c7 req-78ba7333-09f8-43d1-9c15-40166cec424a tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0476089 Nov 02 12:56:08.467339 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-db85b2e5-bf44-4d90-bd7b-6d005f3098d7 req-c650f004-8289-439a-aa4e-bcc0a3e6affb tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:08.468827 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-db85b2e5-bf44-4d90-bd7b-6d005f3098d7 req-c650f004-8289-439a-aa4e-bcc0a3e6affb tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 943 time: 0.0549328 Nov 02 12:56:08.522692 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-db85b2e5-bf44-4d90-bd7b-6d005f3098d7 req-721f4cf7-d559-4a37-b02f-8f9920e86b16 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0478184 Nov 02 12:56:08.796274 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c344594d-3255-45f6-b153-59f9b77cb0d2 req-079af817-769f-4447-a103-a1101859beb9 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 210 time: 0.0272117 Nov 02 12:56:09.468618 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:56:09.485693 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-74405120-84cd-477a-8d0d-e96b4f6c26a1 req-fb0455c6-75e5-4572-b8fc-f6d5526183cf tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:09.486925 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-74405120-84cd-477a-8d0d-e96b4f6c26a1 req-fb0455c6-75e5-4572-b8fc-f6d5526183cf tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 943 time: 0.0635436 Nov 02 12:56:09.543161 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-74405120-84cd-477a-8d0d-e96b4f6c26a1 req-69207ee6-7307-4851-9158-9e3b2a591cf1 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0472105 Nov 02 12:56:09.644859 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d7ad4e9-f463-46eb-a3a7-ce3212944f56 req-7241889a-21f1-4bcb-904f-8f0975b5aca7 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:09.646358 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7d7ad4e9-f463-46eb-a3a7-ce3212944f56 req-7241889a-21f1-4bcb-904f-8f0975b5aca7 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 943 time: 0.0517707 Nov 02 12:56:09.701211 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7d7ad4e9-f463-46eb-a3a7-ce3212944f56 req-45cc8f05-fedf-41d9-8710-87ef69b794e6 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0457227 Nov 02 12:56:09.913417 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-df57aa23-726a-46f3-bbeb-274facb81b42 req-97cac888-e717-417b-8ebb-de7a77378d44 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 210 time: 0.0391293 Nov 02 12:56:10.694087 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b5dea143-a8db-437f-9ad7-d121b5c900f6 req-cfb3ce85-52fc-4316-ac9c-8c50beb427de tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:10.695672 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b5dea143-a8db-437f-9ad7-d121b5c900f6 req-cfb3ce85-52fc-4316-ac9c-8c50beb427de tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 943 time: 0.0653801 Nov 02 12:56:10.750886 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b5dea143-a8db-437f-9ad7-d121b5c900f6 req-7595fd6f-622a-4f98-a396-25f1e617ca9f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0468686 Nov 02 12:56:10.835442 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de157b0e-f8b1-49e8-99e5-dcd1b53916e9 req-93a09f91-2256-45e1-bdcd-2810d826d7bf tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:10.836870 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-de157b0e-f8b1-49e8-99e5-dcd1b53916e9 req-93a09f91-2256-45e1-bdcd-2810d826d7bf tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 943 time: 0.0532014 Nov 02 12:56:10.890748 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-de157b0e-f8b1-49e8-99e5-dcd1b53916e9 req-8124e64f-99b6-4f47-a179-2c3bb349b4b4 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0470228 Nov 02 12:56:11.005775 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6db828fc-6030-4429-a306-b1263cd802f4 req-cfe30326-7365-4264-bd6e-d1aca0806928 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 210 time: 0.0261452 Nov 02 12:56:11.883401 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-96597eb7-4795-4612-b480-67098b32dedc req-b6bfe286-edad-401c-8ec7-f89cabd37008 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:11.884952 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-96597eb7-4795-4612-b480-67098b32dedc req-b6bfe286-edad-401c-8ec7-f89cabd37008 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 943 time: 0.0550177 Nov 02 12:56:11.950006 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-96597eb7-4795-4612-b480-67098b32dedc req-f7178d3b-663b-4b8f-bfec-128f2dfde807 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0563881 Nov 02 12:56:12.018041 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85629d16-2f37-4409-bf21-f8e426704298 req-b4982095-6840-4ffb-be2f-e84acf7598e0 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:12.019548 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-85629d16-2f37-4409-bf21-f8e426704298 req-b4982095-6840-4ffb-be2f-e84acf7598e0 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 943 time: 0.0552666 Nov 02 12:56:12.070859 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-85629d16-2f37-4409-bf21-f8e426704298 req-6e7862e4-abbc-44a3-9eff-a3f864d2831c tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0453680 Nov 02 12:56:12.110072 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-58106083-ce4f-41b0-8d86-eeacf8f93650 req-c629717d-3f94-4ae5-a123-8dd25150f4b7 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 210 time: 0.0290370 Nov 02 12:56:13.084123 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1482fcd0-6b52-4a44-8e1a-f9c76b5070c7 req-2753d8fd-b5af-42ae-b82c-8d10d0e0198c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:13.085638 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1482fcd0-6b52-4a44-8e1a-f9c76b5070c7 req-2753d8fd-b5af-42ae-b82c-8d10d0e0198c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 943 time: 0.0628116 Nov 02 12:56:13.136599 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1482fcd0-6b52-4a44-8e1a-f9c76b5070c7 req-8a16ddf1-0606-46cd-8516-95d89c22ce16 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0449610 Nov 02 12:56:13.198073 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c070e3d-9194-4ddc-98a2-a6e65b2e29c9 req-4bee93fb-adcc-4610-8554-e27801bc6942 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:13.200333 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8c070e3d-9194-4ddc-98a2-a6e65b2e29c9 req-4bee93fb-adcc-4610-8554-e27801bc6942 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 943 time: 0.0529940 Nov 02 12:56:13.244434 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-60c41149-2050-4caa-8a8e-8c8359fdec5b req-9abb5005-20c3-4994-95fe-1fcafb146dd4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 210 time: 0.0360789 Nov 02 12:56:13.275812 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8c070e3d-9194-4ddc-98a2-a6e65b2e29c9 req-607ca4df-307e-4e39-a66c-203d502bacf1 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0693259 Nov 02 12:56:13.914846 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c888089-6ff7-4179-8543-cd654dbe13ad req-f9f7d0eb-561c-423c-a48d-4576042642a5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:13.916310 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2c888089-6ff7-4179-8543-cd654dbe13ad req-f9f7d0eb-561c-423c-a48d-4576042642a5 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=aaddc046689441b8ab3641f2afd07c0e&device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 1096 time: 0.0422843 Nov 02 12:56:14.024419 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c888089-6ff7-4179-8543-cd654dbe13ad req-b8b8fa56-cb32-4ef0-b0b8-c6d20dceb5d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:14.025901 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2c888089-6ff7-4179-8543-cd654dbe13ad req-b8b8fa56-cb32-4ef0-b0b8-c6d20dceb5d7 service neutron] 10.222.0.90 "GET /v2.0/networks?id=c468f0e1-3636-49b9-90c6-b90c643ed7d1 HTTP/1.1" status: 200 len: 917 time: 0.0877488 Nov 02 12:56:14.095276 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2c888089-6ff7-4179-8543-cd654dbe13ad req-206fa920-c01b-46ff-a62e-3fbf9cc282b6 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=b2c052d8-c7f4-4790-afab-5f3766f86877 HTTP/1.1" status: 200 len: 997 time: 0.0606780 Nov 02 12:56:14.153827 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c888089-6ff7-4179-8543-cd654dbe13ad req-77813e0f-66a9-4d83-a146-d9f1e155586c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:14.155285 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2c888089-6ff7-4179-8543-cd654dbe13ad req-77813e0f-66a9-4d83-a146-d9f1e155586c service neutron] 10.222.0.90 "GET /v2.0/subnets?id=ec48fe57-a1cd-4e7c-874f-073624f71f4b HTTP/1.1" status: 200 len: 855 time: 0.0436554 Nov 02 12:56:14.207227 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2c888089-6ff7-4179-8543-cd654dbe13ad req-ecb88974-a8a3-4642-9799-563fee8fa546 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:14.208856 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2c888089-6ff7-4179-8543-cd654dbe13ad req-ecb88974-a8a3-4642-9799-563fee8fa546 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=c468f0e1-3636-49b9-90c6-b90c643ed7d1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0435097 Nov 02 12:56:14.570084 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3ae3931a-1344-4fe9-b483-d7c14ca2e309 req-8c7c3084-81fb-4fc8-8bf6-07f942285de6 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 210 time: 0.0603037 Nov 02 12:56:14.596759 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-308cbb8f-1726-4c18-86c9-944267c3d64e req-af5d1beb-3324-4e44-b3a7-496a056fec0f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:14.598289 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-308cbb8f-1726-4c18-86c9-944267c3d64e req-af5d1beb-3324-4e44-b3a7-496a056fec0f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 943 time: 0.3867531 Nov 02 12:56:14.642907 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2c888089-6ff7-4179-8543-cd654dbe13ad req-458d85f2-c744-422c-85fd-16cbe2b59cbf service neutron] 10.222.0.90 "GET /v2.0/networks/c468f0e1-3636-49b9-90c6-b90c643ed7d1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.4065487 Nov 02 12:56:14.745149 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-308cbb8f-1726-4c18-86c9-944267c3d64e req-d5e8669b-a11d-42ee-a6af-2bc310972cbc tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1400163 Nov 02 12:56:14.766851 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2984f97f-82f2-410c-9c60-db0e174251bd req-c150ce48-cbc4-44af-980b-bd035caa6355 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:14.768356 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2984f97f-82f2-410c-9c60-db0e174251bd req-c150ce48-cbc4-44af-980b-bd035caa6355 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 943 time: 0.1396117 Nov 02 12:56:14.807216 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2c888089-6ff7-4179-8543-cd654dbe13ad req-ae453813-377a-489b-bb10-5e9307d9b3d6 service neutron] 10.222.0.90 "GET /v2.0/networks/c468f0e1-3636-49b9-90c6-b90c643ed7d1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1463838 Nov 02 12:56:14.831335 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2984f97f-82f2-410c-9c60-db0e174251bd req-f0994192-913c-4d84-927a-17574015d180 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0561469 Nov 02 12:56:15.142538 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-8adda7b1-f5cf-46c8-a8b3-b8ba353ff98e tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:15.144721 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-8adda7b1-f5cf-46c8-a8b3-b8ba353ff98e tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.90 "GET /v2.0/networks?id=89f406ae-1b9f-4be7-8881-87075d7c5aa1 HTTP/1.1" status: 200 len: 812 time: 0.1032968 Nov 02 12:56:15.217328 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-aa9c6f89-8388-4a67-88d8-f9f30146884c tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.90 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=697de566c0334435b902950f6f31da45 HTTP/1.1" status: 200 len: 379 time: 0.0617864 Nov 02 12:56:15.231641 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-9125458e-3177-428c-95ce-8a80d30039f3 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Request body: {'port': {'device_id': '93ad83e9-3682-4f82-b83f-f511d5942f94', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'admin_state_up': True, 'tenant_id': '697de566c0334435b902950f6f31da45', 'security_groups': ['9bcd6e2d-4fff-4ee2-aaee-41104c05def3']}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:56:15.455612 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-9125458e-3177-428c-95ce-8a80d30039f3 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Made reservation on behalf of 697de566c0334435b902950f6f31da45 for: {'port': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:56:15.459378 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-9125458e-3177-428c-95ce-8a80d30039f3 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:15.588641 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-9125458e-3177-428c-95ce-8a80d30039f3 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Allocated IP 172.20.0.13 (89f406ae-1b9f-4be7-8881-87075d7c5aa1/ae24c2fe-abba-48cd-9d91-28a628d2ef95/a7cd13fe-71ea-4598-9aff-764b7f736afe) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:56:15.705398 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-99efee48-3255-439d-b894-71d9194b6423 req-9ee38c5b-ecea-4fec-95e5-adc819979b96 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 210 time: 0.0604463 Nov 02 12:56:15.757666 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-9125458e-3177-428c-95ce-8a80d30039f3 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:15.867179 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-641aad05-140e-4d63-b449-33e9d10bcc5a req-37ff6463-b2ea-4ef0-9a7a-4e8724e237ff tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:15.868860 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-641aad05-140e-4d63-b449-33e9d10bcc5a req-37ff6463-b2ea-4ef0-9a7a-4e8724e237ff tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 943 time: 0.0501435 Nov 02 12:56:15.898014 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-9125458e-3177-428c-95ce-8a80d30039f3 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:15.988464 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-9125458e-3177-428c-95ce-8a80d30039f3 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Network 89f406ae-1b9f-4be7-8881-87075d7c5aa1 is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:56:15.996614 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-641aad05-140e-4d63-b449-33e9d10bcc5a req-e031d113-b48e-4098-b925-e21825a90671 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1202903 Nov 02 12:56:16.003832 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-9125458e-3177-428c-95ce-8a80d30039f3 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:56:16.006710 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-9125458e-3177-428c-95ce-8a80d30039f3 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:56:16.013176 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9125458e-3177-428c-95ce-8a80d30039f3 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Pushing event updated for resources: {'Port': ['ID=a7cd13fe-71ea-4598-9aff-764b7f736afe,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:56:16.063922 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2a64b5f6-13d0-4acc-a467-2e7bef021721 req-e22df9b2-043a-4d9f-893b-c9c00649e904 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:16.065533 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2a64b5f6-13d0-4acc-a467-2e7bef021721 req-e22df9b2-043a-4d9f-893b-c9c00649e904 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 943 time: 0.1607311 Nov 02 12:56:16.090135 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-9125458e-3177-428c-95ce-8a80d30039f3 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:16.090792 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-9125458e-3177-428c-95ce-8a80d30039f3 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:16.138548 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2a64b5f6-13d0-4acc-a467-2e7bef021721 req-cd720480-72bc-43e3-9283-7ff5ebb4c854 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0649452 Nov 02 12:56:16.218326 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-9125458e-3177-428c-95ce-8a80d30039f3 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9906316 Nov 02 12:56:16.235317 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-a1f160ae-f927-492b-8a3d-20ec2a0a05da None None] Provisioning complete for port a7cd13fe-71ea-4598-9aff-764b7f736afe triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:56:16.235918 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-a1f160ae-f927-492b-8a3d-20ec2a0a05da None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:16.238169 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-997adcb8-34f4-491a-94f5-863ee21d0102 service neutron] Request body: {'port': {'device_id': '93ad83e9-3682-4f82-b83f-f511d5942f94', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81632'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:56:16.273567 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-a1f160ae-f927-492b-8a3d-20ec2a0a05da None None] Port a7cd13fe-71ea-4598-9aff-764b7f736afe cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:56:16.296512 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-997adcb8-34f4-491a-94f5-863ee21d0102 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:16.557954 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-997adcb8-34f4-491a-94f5-863ee21d0102 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id a7cd13fe-71ea-4598-9aff-764b7f736afe {{(pid=108543) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:56:16.566317 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-997adcb8-34f4-491a-94f5-863ee21d0102 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:16.578543 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.provisioning_blocks [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-997adcb8-34f4-491a-94f5-863ee21d0102 service neutron] Transition to ACTIVE for port object a7cd13fe-71ea-4598-9aff-764b7f736afe will not be triggered until provisioned by entity L2. {{(pid=108543) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 02 12:56:16.711008 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-997adcb8-34f4-491a-94f5-863ee21d0102 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:16.762546 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-997adcb8-34f4-491a-94f5-863ee21d0102 service neutron] Pushing event updated for resources: {'Port': ['ID=a7cd13fe-71ea-4598-9aff-764b7f736afe,revision_number=2']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:56:16.875277 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-997adcb8-34f4-491a-94f5-863ee21d0102 service neutron] Attempting to bind port a7cd13fe-71ea-4598-9aff-764b7f736afe on host hv-cinder-81632 for vnic_type normal with profile {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:56:16.875619 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-997adcb8-34f4-491a-94f5-863ee21d0102 service neutron] Attempting to bind port a7cd13fe-71ea-4598-9aff-764b7f736afe by drivers openvswitch,hyperv on host hv-cinder-81632 at level 0 using segments [{'id': 'c8ecb7dc-9cc8-47a7-94e7-62f066a97c10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1'}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:56:16.875956 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-997adcb8-34f4-491a-94f5-863ee21d0102 service neutron] Attempting to bind port a7cd13fe-71ea-4598-9aff-764b7f736afe on network 89f406ae-1b9f-4be7-8881-87075d7c5aa1 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:56:16.882888 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-997adcb8-34f4-491a-94f5-863ee21d0102 service neutron] Port a7cd13fe-71ea-4598-9aff-764b7f736afe on network 89f406ae-1b9f-4be7-8881-87075d7c5aa1 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81632 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 02 12:56:16.883272 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-997adcb8-34f4-491a-94f5-863ee21d0102 service neutron] Attempting to bind port a7cd13fe-71ea-4598-9aff-764b7f736afe on network 89f406ae-1b9f-4be7-8881-87075d7c5aa1 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:56:16.892448 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-744f4160-7047-41ca-9510-eafd45c4dc22 req-3017dd68-f882-42a7-ab69-74dfd5fa2a87 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:16.894003 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-744f4160-7047-41ca-9510-eafd45c4dc22 req-3017dd68-f882-42a7-ab69-74dfd5fa2a87 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 944 time: 0.0817521 Nov 02 12:56:16.899671 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-997adcb8-34f4-491a-94f5-863ee21d0102 service neutron] Checking agent: {'id': '0d57fa42-4660-4f08-b7dc-53a872c3c01c', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81632', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'started_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 56, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:56:16.900100 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-997adcb8-34f4-491a-94f5-863ee21d0102 service neutron] Checking segment: {'id': 'c8ecb7dc-9cc8-47a7-94e7-62f066a97c10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108543) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:56:16.900562 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-997adcb8-34f4-491a-94f5-863ee21d0102 service neutron] Bound using segment: {'id': 'c8ecb7dc-9cc8-47a7-94e7-62f066a97c10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1'} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:56:16.901082 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-997adcb8-34f4-491a-94f5-863ee21d0102 service neutron] Bound port: a7cd13fe-71ea-4598-9aff-764b7f736afe, host: hv-cinder-81632, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c8ecb7dc-9cc8-47a7-94e7-62f066a97c10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1'}}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:56:16.901442 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-997adcb8-34f4-491a-94f5-863ee21d0102 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:16.986967 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-744f4160-7047-41ca-9510-eafd45c4dc22 req-efc89031-ea49-4350-bb6a-e7c8132d48e5 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0830948 Nov 02 12:56:17.006718 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-997adcb8-34f4-491a-94f5-863ee21d0102 service neutron] For port a7cd13fe-71ea-4598-9aff-764b7f736afe, host hv-cinder-81632, cleared binding levels {{(pid=108543) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:56:17.011178 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-997adcb8-34f4-491a-94f5-863ee21d0102 service neutron] For port a7cd13fe-71ea-4598-9aff-764b7f736afe, host hv-cinder-81632, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=a7cd13fe-71ea-4598-9aff-764b7f736afe,segment=NetworkSegment(c8ecb7dc-9cc8-47a7-94e7-62f066a97c10),segment_id=c8ecb7dc-9cc8-47a7-94e7-62f066a97c10)] {{(pid=108543) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:56:17.115099 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-997adcb8-34f4-491a-94f5-863ee21d0102 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:17.130580 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-47533922-4969-4bdb-bfc8-ca1d40fd79a9 req-6b8e1af8-3cbc-4a44-a03d-e417f78938e7 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:17.132051 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-47533922-4969-4bdb-bfc8-ca1d40fd79a9 req-6b8e1af8-3cbc-4a44-a03d-e417f78938e7 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 943 time: 0.0616438 Nov 02 12:56:17.172928 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-997adcb8-34f4-491a-94f5-863ee21d0102 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:17.173552 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-997adcb8-34f4-491a-94f5-863ee21d0102 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:17.174979 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-997adcb8-34f4-491a-94f5-863ee21d0102 service neutron] 10.222.0.90 "PUT /v2.0/ports/a7cd13fe-71ea-4598-9aff-764b7f736afe HTTP/1.1" status: 200 len: 1094 time: 0.9413006 Nov 02 12:56:17.177177 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '93ad83e9-3682-4f82-b83f-f511d5942f94', 'tag': 'a7cd13fe-71ea-4598-9aff-764b7f736afe'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:56:17.179481 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-896850a5-6d19-4145-a30a-8858d17e2e33" -d '{"events": [{"name": "network-changed", "server_uuid": "93ad83e9-3682-4f82-b83f-f511d5942f94", "tag": "a7cd13fe-71ea-4598-9aff-764b7f736afe"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:56:17.221151 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-997adcb8-34f4-491a-94f5-863ee21d0102 service neutron] Pushing event updated for resources: {'Port': ['ID=a7cd13fe-71ea-4598-9aff-764b7f736afe,revision_number=3']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:56:17.241242 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-47533922-4969-4bdb-bfc8-ca1d40fd79a9 req-efae9bff-c7bb-41f4-a36d-975eecf38687 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0909142 Nov 02 12:56:17.288327 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6ad5de3e-1688-449a-82a9-1b3204fa25b1 req-1a4919ed-b6c1-49db-9e51-a47bf229b9a5 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:17.289978 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6ad5de3e-1688-449a-82a9-1b3204fa25b1 req-1a4919ed-b6c1-49db-9e51-a47bf229b9a5 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 943 time: 0.0700569 Nov 02 12:56:17.363821 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:56:17 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-6ac558bd-4704-474f-923e-5fd0975f347d x-openstack-request-id: req-6ac558bd-4704-474f-923e-5fd0975f347d {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:56:17.364116 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "93ad83e9-3682-4f82-b83f-f511d5942f94", "tag": "a7cd13fe-71ea-4598-9aff-764b7f736afe", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:56:17.364370 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-6ac558bd-4704-474f-923e-5fd0975f347d {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:56:17.364771 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '93ad83e9-3682-4f82-b83f-f511d5942f94', 'tag': 'a7cd13fe-71ea-4598-9aff-764b7f736afe', 'status': 'completed', 'code': 200} Nov 02 12:56:17.379378 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6ad5de3e-1688-449a-82a9-1b3204fa25b1 req-459f1321-32d5-4598-8211-56ce6352b522 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0804129 Nov 02 12:56:17.384865 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-cd543b93-509f-4cdc-a891-7849f74d780f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:17.386534 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-cd543b93-509f-4cdc-a891-7849f74d780f service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=697de566c0334435b902950f6f31da45&device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 1097 time: 0.0689790 Nov 02 12:56:17.421999 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device b2c052d8-c7f4-4790-afab-5f3766f86877 details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 12:56:17.432827 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-8ba6a74e-bdaf-41da-bedf-6372da666fc4 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=a7cd13fe-71ea-4598-9aff-764b7f736afe HTTP/1.1" status: 200 len: 217 time: 0.0361123 Nov 02 12:56:17.483965 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-a465542e-0d6a-4f16-bbef-d2d8d488ec09 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:17.485462 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-a465542e-0d6a-4f16-bbef-d2d8d488ec09 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=ae24c2fe-abba-48cd-9d91-28a628d2ef95 HTTP/1.1" status: 200 len: 851 time: 0.0447128 Nov 02 12:56:17.529814 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port b2c052d8-c7f4-4790-afab-5f3766f86877, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=b2c052d8-c7f4-4790-afab-5f3766f86877,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:56:17.536227 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-17b10101-bf75-4504-9396-460cefd3358e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:17.537733 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-17b10101-bf75-4504-9396-460cefd3358e service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=89f406ae-1b9f-4be7-8881-87075d7c5aa1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0445528 Nov 02 12:56:17.541276 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': 'b2c052d8-c7f4-4790-afab-5f3766f86877', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'port_id': 'b2c052d8-c7f4-4790-afab-5f3766f86877', 'mac_address': 'fa:16:3e:94:a8:39', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 854, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 12:56:17.578917 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:17.592558 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id b2c052d8-c7f4-4790-afab-5f3766f86877 {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:56:17.611703 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port b2c052d8-c7f4-4790-afab-5f3766f86877, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=b2c052d8-c7f4-4790-afab-5f3766f86877,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:56:17.628744 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-6bdbdfd8-b53b-4b84-8a46-b55ceda27c35 service neutron] 10.222.0.90 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0838413 Nov 02 12:56:17.718591 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:17.719288 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device ca5c5f21-fa79-4114-ab42-264c76de67e3 details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 12:56:17.724355 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ccf4a67e-54d6-4d2a-8ea4-55924832c849 req-69264ad2-a7ba-4b0d-91d6-e4e2977afc7e service neutron] 10.222.0.90 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0866418 Nov 02 12:56:17.788585 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=b2c052d8-c7f4-4790-afab-5f3766f86877,revision_number=9']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:56:17.853868 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port ca5c5f21-fa79-4114-ab42-264c76de67e3, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=ca5c5f21-fa79-4114-ab42-264c76de67e3,segment=NetworkSegment(e33ebaf8-f9b3-489e-9197-c5c63e968f23),segment_id=e33ebaf8-f9b3-489e-9197-c5c63e968f23)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:56:17.865161 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': 'ca5c5f21-fa79-4114-ab42-264c76de67e3', 'network_id': '8e873280-f41f-4e9c-a802-c6eb6e9e490f', 'port_id': 'ca5c5f21-fa79-4114-ab42-264c76de67e3', 'mac_address': 'fa:16:3e:5e:46:6a', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 863, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c76b8d78-f8d1-4c53-8f06-2a9d4330c04a', 'ip_address': '172.20.0.3'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 12:56:17.881784 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-896850a5-6d19-4145-a30a-8858d17e2e33 req-c73940e6-ab13-4ab9-bf0e-1a7c62cf1a96 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:17.883314 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-896850a5-6d19-4145-a30a-8858d17e2e33 req-c73940e6-ab13-4ab9-bf0e-1a7c62cf1a96 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=697de566c0334435b902950f6f31da45&device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 1097 time: 0.0444207 Nov 02 12:56:17.904130 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:17.917300 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ca5c5f21-fa79-4114-ab42-264c76de67e3 {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:56:17.937168 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port ca5c5f21-fa79-4114-ab42-264c76de67e3, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=ca5c5f21-fa79-4114-ab42-264c76de67e3,segment=NetworkSegment(e33ebaf8-f9b3-489e-9197-c5c63e968f23),segment_id=e33ebaf8-f9b3-489e-9197-c5c63e968f23)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:56:17.980118 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-896850a5-6d19-4145-a30a-8858d17e2e33 req-f40d7dba-da56-43d8-88c0-5786b123a470 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:17.981614 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-896850a5-6d19-4145-a30a-8858d17e2e33 req-f40d7dba-da56-43d8-88c0-5786b123a470 service neutron] 10.222.0.90 "GET /v2.0/networks?id=89f406ae-1b9f-4be7-8881-87075d7c5aa1 HTTP/1.1" status: 200 len: 913 time: 0.0895238 Nov 02 12:56:18.025531 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-896850a5-6d19-4145-a30a-8858d17e2e33 req-dd49375d-4617-4172-adcc-eb35ad518c18 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=a7cd13fe-71ea-4598-9aff-764b7f736afe HTTP/1.1" status: 200 len: 217 time: 0.0348809 Nov 02 12:56:18.060998 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:18.105030 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-896850a5-6d19-4145-a30a-8858d17e2e33 req-02ba4293-df71-42ef-8383-634978e5f1b6 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:18.106565 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-896850a5-6d19-4145-a30a-8858d17e2e33 req-02ba4293-df71-42ef-8383-634978e5f1b6 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=ae24c2fe-abba-48cd-9d91-28a628d2ef95 HTTP/1.1" status: 200 len: 851 time: 0.0711408 Nov 02 12:56:18.131244 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d389de4c-9524-40dc-90e4-a7deef2932ba req-dbbecf1b-f133-4d3d-8a42-1248317204ad tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:18.132802 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d389de4c-9524-40dc-90e4-a7deef2932ba req-dbbecf1b-f133-4d3d-8a42-1248317204ad tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 944 time: 0.0714891 Nov 02 12:56:18.204283 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-896850a5-6d19-4145-a30a-8858d17e2e33 req-46ffc989-039c-47c2-9ab4-e5e30eb9c6b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:18.205774 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-896850a5-6d19-4145-a30a-8858d17e2e33 req-46ffc989-039c-47c2-9ab4-e5e30eb9c6b0 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=89f406ae-1b9f-4be7-8881-87075d7c5aa1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0909102 Nov 02 12:56:18.215496 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d389de4c-9524-40dc-90e4-a7deef2932ba req-5b4853aa-9611-404c-8c25-18dfcb7ccc12 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0602045 Nov 02 12:56:18.248668 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=ca5c5f21-fa79-4114-ab42-264c76de67e3,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:56:18.302876 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-896850a5-6d19-4145-a30a-8858d17e2e33 req-1b6e558c-92db-4c74-b117-90619c2c2f9d service neutron] 10.222.0.90 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0863898 Nov 02 12:56:18.319878 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['b2c052d8-c7f4-4790-afab-5f3766f86877'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:56:18.322600 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['ca5c5f21-fa79-4114-ab42-264c76de67e3'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:56:18.420216 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c80b3fdc-7c89-4502-badb-fa97bfa58f0e req-73982837-52bb-4a79-84fd-151f2e5662be tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:18.421778 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c80b3fdc-7c89-4502-badb-fa97bfa58f0e req-73982837-52bb-4a79-84fd-151f2e5662be tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 944 time: 0.1029863 Nov 02 12:56:18.455068 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-896850a5-6d19-4145-a30a-8858d17e2e33 req-2dbeb610-1a92-4925-96b2-f71447870fb9 service neutron] 10.222.0.90 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1445482 Nov 02 12:56:18.514982 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c80b3fdc-7c89-4502-badb-fa97bfa58f0e req-b69490a5-d9cf-4fc0-ab3f-4de086b53775 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0841911 Nov 02 12:56:18.531643 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bfae5ee2-b15d-45d0-a327-9e9cb35b0b2b req-ccf2042a-37ea-478c-8c2e-d25f46c7b354 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:18.533135 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bfae5ee2-b15d-45d0-a327-9e9cb35b0b2b req-ccf2042a-37ea-478c-8c2e-d25f46c7b354 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 944 time: 0.0734365 Nov 02 12:56:18.581914 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bfae5ee2-b15d-45d0-a327-9e9cb35b0b2b req-a5bb3aea-c75e-4bf7-9215-c68fac1e8d12 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0423956 Nov 02 12:56:19.344640 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b2448ea0-9bf6-4536-9b40-64905eddb6f3 req-09fbb636-b69c-492c-a459-18f00f523c0e tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:19.346161 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b2448ea0-9bf6-4536-9b40-64905eddb6f3 req-09fbb636-b69c-492c-a459-18f00f523c0e tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 944 time: 0.0500424 Nov 02 12:56:19.396642 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b2448ea0-9bf6-4536-9b40-64905eddb6f3 req-7c079f6e-5ab4-4032-9fad-b9820e44e38b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0444093 Nov 02 12:56:19.437199 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device ca5c5f21-fa79-4114-ab42-264c76de67e3 up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:56:19.569563 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning for port ca5c5f21-fa79-4114-ab42-264c76de67e3 completed by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 02 12:56:19.573724 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port ca5c5f21-fa79-4114-ab42-264c76de67e3 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:56:19.574784 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:19.639631 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0519cbca-be96-4210-93ec-f5bcef0a6267 req-62583ce7-c673-41a6-9d6c-5b647ec4d4ca tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:19.641367 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0519cbca-be96-4210-93ec-f5bcef0a6267 req-62583ce7-c673-41a6-9d6c-5b647ec4d4ca tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 944 time: 0.0531013 Nov 02 12:56:19.660236 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:19.683985 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2e690c84-aca7-422c-9e29-cbb8b30d170f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ca5c5f21-fa79-4114-ab42-264c76de67e3'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:56:19.686536 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0203fcd0-369e-4d36-905d-72831cb3a5bb" -d '{"events": [{"server_uuid": "2e690c84-aca7-422c-9e29-cbb8b30d170f", "name": "network-vif-plugged", "status": "completed", "tag": "ca5c5f21-fa79-4114-ab42-264c76de67e3"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:56:19.700470 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port ca5c5f21-fa79-4114-ab42-264c76de67e3, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=ca5c5f21-fa79-4114-ab42-264c76de67e3,segment=NetworkSegment(e33ebaf8-f9b3-489e-9197-c5c63e968f23),segment_id=e33ebaf8-f9b3-489e-9197-c5c63e968f23)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:56:19.727340 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0519cbca-be96-4210-93ec-f5bcef0a6267 req-4109eefa-da22-40fa-a999-fdcf7719654b tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0796793 Nov 02 12:56:19.745033 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-45510a94-9e23-4f5f-b659-012d48717b4f req-580b9b5f-1afe-4c30-9731-201dfd08f3b8 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:19.745033 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-45510a94-9e23-4f5f-b659-012d48717b4f req-580b9b5f-1afe-4c30-9731-201dfd08f3b8 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 944 time: 0.0752435 Nov 02 12:56:19.775713 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:56:19 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-60704655-fe4e-4548-881a-238c898ab9ce x-openstack-request-id: req-60704655-fe4e-4548-881a-238c898ab9ce {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:56:19.775713 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2e690c84-aca7-422c-9e29-cbb8b30d170f", "name": "network-vif-plugged", "status": "completed", "tag": "ca5c5f21-fa79-4114-ab42-264c76de67e3", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:56:19.775939 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-60704655-fe4e-4548-881a-238c898ab9ce {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:56:19.776222 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2e690c84-aca7-422c-9e29-cbb8b30d170f', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ca5c5f21-fa79-4114-ab42-264c76de67e3', 'code': 200} Nov 02 12:56:19.793595 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-45510a94-9e23-4f5f-b659-012d48717b4f req-e0d017ab-ffc3-4e48-8c5a-8b37b8cad3f3 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0438175 Nov 02 12:56:19.838785 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:19.839644 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device b2c052d8-c7f4-4790-afab-5f3766f86877 up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:56:19.916661 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=ca5c5f21-fa79-4114-ab42-264c76de67e3,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:56:19.930363 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port b2c052d8-c7f4-4790-afab-5f3766f86877 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:56:19.930761 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:20.010867 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:20.043582 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port b2c052d8-c7f4-4790-afab-5f3766f86877, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=b2c052d8-c7f4-4790-afab-5f3766f86877,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:56:20.107315 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:20.119659 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c277f8ff-6b0d-4e1c-afe2-2d6a853435b8 req-36da6a80-36b8-4060-bccb-ce1252d1224e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:20.121183 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c277f8ff-6b0d-4e1c-afe2-2d6a853435b8 req-36da6a80-36b8-4060-bccb-ce1252d1224e service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 1098 time: 0.0407505 Nov 02 12:56:20.155259 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=b2c052d8-c7f4-4790-afab-5f3766f86877,revision_number=10']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:56:20.168974 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c277f8ff-6b0d-4e1c-afe2-2d6a853435b8 req-5ea7a01e-ffa4-48e2-a58a-71c09003d6d5 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0394168 Nov 02 12:56:20.516392 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9530ff82-534e-4aea-a55d-f8bcccb8eabc req-0c50ba5e-b3c9-42b0-b4a6-8b818e14f594 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:20.517842 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9530ff82-534e-4aea-a55d-f8bcccb8eabc req-0c50ba5e-b3c9-42b0-b4a6-8b818e14f594 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 944 time: 0.0517843 Nov 02 12:56:20.567081 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9530ff82-534e-4aea-a55d-f8bcccb8eabc req-0bdd2a88-50a1-4aff-8d50-a227869a31e6 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432680 Nov 02 12:56:20.849202 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6e66b95-aaec-4ed6-967b-51679b0777ce req-a21bf773-1265-4f9a-9608-5be249085efa tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:20.850706 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b6e66b95-aaec-4ed6-967b-51679b0777ce req-a21bf773-1265-4f9a-9608-5be249085efa tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 946 time: 0.0491331 Nov 02 12:56:20.928619 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b6e66b95-aaec-4ed6-967b-51679b0777ce req-d714e591-711a-4a55-a91c-ea2e4b836bc8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0718553 Nov 02 12:56:20.941924 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b36572a8-1f68-4ad3-b66e-1186618d2a65 req-6d95ec0e-bfbb-48fd-b669-ee6f3d2d5138 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:20.943413 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b36572a8-1f68-4ad3-b66e-1186618d2a65 req-6d95ec0e-bfbb-48fd-b669-ee6f3d2d5138 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 945 time: 0.0808582 Nov 02 12:56:20.990491 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b36572a8-1f68-4ad3-b66e-1186618d2a65 req-246f6311-5999-45bc-9181-df683d18c1b9 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0403750 Nov 02 12:56:21.683609 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3fc30bfe-1508-4e4c-8b9a-a29c6a17aa15 req-c0258adf-6d55-498a-9085-4b59aebdb101 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:21.685088 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3fc30bfe-1508-4e4c-8b9a-a29c6a17aa15 req-c0258adf-6d55-498a-9085-4b59aebdb101 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 944 time: 0.0497954 Nov 02 12:56:21.738255 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3fc30bfe-1508-4e4c-8b9a-a29c6a17aa15 req-dddebf99-b1fb-4e43-b027-885a901e5f51 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0437427 Nov 02 12:56:21.777735 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a1984910-3b5c-43f5-8727-1c65226b3983', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b2c052d8-c7f4-4790-afab-5f3766f86877'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:56:21.780159 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6e79902d-98a0-4231-8686-cf9ad54ffd5c" -d '{"events": [{"server_uuid": "a1984910-3b5c-43f5-8727-1c65226b3983", "name": "network-vif-plugged", "status": "completed", "tag": "b2c052d8-c7f4-4790-afab-5f3766f86877"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:56:21.820606 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:56:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-34f1911a-eccd-4d3b-8cb0-0b8ba7de738d x-openstack-request-id: req-34f1911a-eccd-4d3b-8cb0-0b8ba7de738d {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:56:21.820899 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a1984910-3b5c-43f5-8727-1c65226b3983", "name": "network-vif-plugged", "status": "completed", "tag": "b2c052d8-c7f4-4790-afab-5f3766f86877", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:56:21.821152 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-34f1911a-eccd-4d3b-8cb0-0b8ba7de738d {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:56:21.821535 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a1984910-3b5c-43f5-8727-1c65226b3983', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'b2c052d8-c7f4-4790-afab-5f3766f86877', 'code': 200} Nov 02 12:56:22.054519 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-91c35eb6-0aeb-4341-b601-1d2cd50fc32e req-0759821e-fe7b-4a85-91a4-a1c108bfcb2e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:22.056177 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-91c35eb6-0aeb-4341-b601-1d2cd50fc32e req-0759821e-fe7b-4a85-91a4-a1c108bfcb2e tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 946 time: 0.0505557 Nov 02 12:56:22.141090 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4e1b5f3-46ab-4b10-adbf-153ce93b38d6 req-a8169435-1644-45ca-807f-71d06c2e954e tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:22.142564 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b4e1b5f3-46ab-4b10-adbf-153ce93b38d6 req-a8169435-1644-45ca-807f-71d06c2e954e tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 945 time: 0.0824199 Nov 02 12:56:22.145917 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-91c35eb6-0aeb-4341-b601-1d2cd50fc32e req-ffca4535-a4fd-4f9c-9bab-72bcc5c2c6d2 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0773931 Nov 02 12:56:22.218655 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d4b1f116-f202-4969-ba58-6b11ffefb3c1 req-5a55a824-49b7-4864-9db6-49c2c6159b43 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:22.220017 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d4b1f116-f202-4969-ba58-6b11ffefb3c1 req-5a55a824-49b7-4864-9db6-49c2c6159b43 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 1099 time: 0.0717573 Nov 02 12:56:22.224503 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b4e1b5f3-46ab-4b10-adbf-153ce93b38d6 req-0ccb1efc-a13e-4212-bd0a-39b52912e345 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0689790 Nov 02 12:56:22.269062 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d4b1f116-f202-4969-ba58-6b11ffefb3c1 req-e3dd3d95-fa62-4207-b0ea-cb8cffd923d1 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412083 Nov 02 12:56:22.864089 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0ba3ceb4-bc0d-4e4d-877a-e252dc83f9c5 req-88dbfd92-29fc-4a49-afbd-491d082f929d tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:22.865579 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0ba3ceb4-bc0d-4e4d-877a-e252dc83f9c5 req-88dbfd92-29fc-4a49-afbd-491d082f929d tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 944 time: 0.0533147 Nov 02 12:56:22.916576 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0ba3ceb4-bc0d-4e4d-877a-e252dc83f9c5 req-237ad6c1-bbf4-46e9-9ba0-e553d3941cae tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0449533 Nov 02 12:56:23.271241 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3b1afdb-1e49-44ce-88f4-4eaab97823fe req-fe536d32-e26c-4725-92be-923c77966cdd tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:23.272716 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a3b1afdb-1e49-44ce-88f4-4eaab97823fe req-fe536d32-e26c-4725-92be-923c77966cdd tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 946 time: 0.0487792 Nov 02 12:56:23.320651 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a3b1afdb-1e49-44ce-88f4-4eaab97823fe req-76cafbfe-9515-40d7-9655-6f7002376b10 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0415928 Nov 02 12:56:23.554526 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-2866fa01-8893-4d60-8329-88b3a95f5187 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:24.036020 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a3c29599-1fce-4d24-b9b2-ff7467ffada0 req-6555db33-8e2a-4a16-acfe-b2f87947c9bb tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:24.037505 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a3c29599-1fce-4d24-b9b2-ff7467ffada0 req-6555db33-8e2a-4a16-acfe-b2f87947c9bb tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 944 time: 0.0516701 Nov 02 12:56:24.093978 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a3c29599-1fce-4d24-b9b2-ff7467ffada0 req-fb0f0eef-8880-46e7-a5da-4b79dc9d9d4e tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0498376 Nov 02 12:56:24.447995 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-646b0fa9-f020-41fc-a06c-deb51bbe978d req-27e2ef9b-0a2b-482b-9f24-f4bf217949a6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:24.449455 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-646b0fa9-f020-41fc-a06c-deb51bbe978d req-27e2ef9b-0a2b-482b-9f24-f4bf217949a6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 946 time: 0.0501719 Nov 02 12:56:24.497611 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-646b0fa9-f020-41fc-a06c-deb51bbe978d req-6e4ae746-7d58-41f1-9901-da652c1a5e32 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418031 Nov 02 12:56:25.210651 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8c0a3105-fdfc-4238-80f9-8bd643d43f93 req-828ab451-3e39-4b86-b113-536f4e8f58a8 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:25.212147 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8c0a3105-fdfc-4238-80f9-8bd643d43f93 req-828ab451-3e39-4b86-b113-536f4e8f58a8 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 944 time: 0.0509360 Nov 02 12:56:25.263651 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8c0a3105-fdfc-4238-80f9-8bd643d43f93 req-7f0c1532-e715-440d-b4c2-6d1753972b39 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0447755 Nov 02 12:56:25.627835 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-33756671-b5e8-4b1e-8764-8469421b0ed3 req-27bd59eb-738d-4052-89a4-db19c16eae10 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:25.629313 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-33756671-b5e8-4b1e-8764-8469421b0ed3 req-27bd59eb-738d-4052-89a4-db19c16eae10 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 946 time: 0.0537071 Nov 02 12:56:25.639147 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-ecb79886-a4b1-4515-9e7f-a9913573b822 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:25.677056 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-33756671-b5e8-4b1e-8764-8469421b0ed3 req-02d882bd-a4fe-4bad-8873-062a65497138 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416200 Nov 02 12:56:26.379235 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c79a1e26-0f1c-45cb-bd2e-f3e1cb39335c req-8f543f6a-9505-4ecf-9f6c-f625a5784192 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:26.380913 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c79a1e26-0f1c-45cb-bd2e-f3e1cb39335c req-8f543f6a-9505-4ecf-9f6c-f625a5784192 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 944 time: 0.0492547 Nov 02 12:56:26.432118 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c79a1e26-0f1c-45cb-bd2e-f3e1cb39335c req-d954e432-c8b9-4aee-936e-4d5116c7f46a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0439847 Nov 02 12:56:26.855317 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:27.469334 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device a7cd13fe-71ea-4598-9aff-764b7f736afe details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 12:56:27.560588 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-650dceec-8cf9-4e8f-9e52-0adf8c192f3a req-bfe93876-63b0-4b4a-b25f-888ce259eddd tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:27.562580 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-650dceec-8cf9-4e8f-9e52-0adf8c192f3a req-bfe93876-63b0-4b4a-b25f-888ce259eddd tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 944 time: 0.0574276 Nov 02 12:56:27.573364 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port a7cd13fe-71ea-4598-9aff-764b7f736afe, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=a7cd13fe-71ea-4598-9aff-764b7f736afe,segment=NetworkSegment(c8ecb7dc-9cc8-47a7-94e7-62f066a97c10),segment_id=c8ecb7dc-9cc8-47a7-94e7-62f066a97c10)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:56:27.585849 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': 'a7cd13fe-71ea-4598-9aff-764b7f736afe', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'port_id': 'a7cd13fe-71ea-4598-9aff-764b7f736afe', 'mac_address': 'fa:16:3e:e9:fc:c4', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 892, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'ip_address': '172.20.0.13'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 12:56:27.612603 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-650dceec-8cf9-4e8f-9e52-0adf8c192f3a req-2c1c913a-7562-4da9-a096-3c17fb4fc422 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0440347 Nov 02 12:56:27.626028 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:27.642258 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id a7cd13fe-71ea-4598-9aff-764b7f736afe {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:56:27.662243 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port a7cd13fe-71ea-4598-9aff-764b7f736afe, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=a7cd13fe-71ea-4598-9aff-764b7f736afe,segment=NetworkSegment(c8ecb7dc-9cc8-47a7-94e7-62f066a97c10),segment_id=c8ecb7dc-9cc8-47a7-94e7-62f066a97c10)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:56:27.746743 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:27.795127 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=a7cd13fe-71ea-4598-9aff-764b7f736afe,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:56:28.005104 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['a7cd13fe-71ea-4598-9aff-764b7f736afe'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:56:28.351163 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:28.732110 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-907aed41-7b6e-425a-9677-e90769b91450 req-12d16c87-e596-4598-bbf6-99d1ed9cf062 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:28.733563 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-907aed41-7b6e-425a-9677-e90769b91450 req-12d16c87-e596-4598-bbf6-99d1ed9cf062 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 945 time: 0.0507061 Nov 02 12:56:28.783521 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-907aed41-7b6e-425a-9677-e90769b91450 req-13ac9c0a-50e9-4aad-9fb0-bd320803fcf7 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0438049 Nov 02 12:56:29.492257 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device a7cd13fe-71ea-4598-9aff-764b7f736afe up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:56:29.616106 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning for port a7cd13fe-71ea-4598-9aff-764b7f736afe completed by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 02 12:56:29.620959 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port a7cd13fe-71ea-4598-9aff-764b7f736afe triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:56:29.621401 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:29.699056 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:29.721682 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '93ad83e9-3682-4f82-b83f-f511d5942f94', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a7cd13fe-71ea-4598-9aff-764b7f736afe'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:56:29.723942 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8e4e7efe-3054-442c-bf28-20d06210290c" -d '{"events": [{"server_uuid": "93ad83e9-3682-4f82-b83f-f511d5942f94", "name": "network-vif-plugged", "status": "completed", "tag": "a7cd13fe-71ea-4598-9aff-764b7f736afe"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:56:29.738547 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port a7cd13fe-71ea-4598-9aff-764b7f736afe, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=a7cd13fe-71ea-4598-9aff-764b7f736afe,segment=NetworkSegment(c8ecb7dc-9cc8-47a7-94e7-62f066a97c10),segment_id=c8ecb7dc-9cc8-47a7-94e7-62f066a97c10)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:56:29.766881 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:56:29 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c987d69d-3fad-4428-80bd-7da3ee62a419 x-openstack-request-id: req-c987d69d-3fad-4428-80bd-7da3ee62a419 {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:56:29.766881 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "93ad83e9-3682-4f82-b83f-f511d5942f94", "name": "network-vif-plugged", "status": "completed", "tag": "a7cd13fe-71ea-4598-9aff-764b7f736afe", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:56:29.766881 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-c987d69d-3fad-4428-80bd-7da3ee62a419 {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:56:29.766881 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '93ad83e9-3682-4f82-b83f-f511d5942f94', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'a7cd13fe-71ea-4598-9aff-764b7f736afe', 'code': 200} Nov 02 12:56:29.844303 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:29.900440 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c61e0006-00ff-431c-8f6e-4ce662b577c8 req-ecdf8b6b-fb03-42b7-bab5-a030353a0721 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:29.901942 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c61e0006-00ff-431c-8f6e-4ce662b577c8 req-ecdf8b6b-fb03-42b7-bab5-a030353a0721 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 946 time: 0.0512469 Nov 02 12:56:29.903567 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=a7cd13fe-71ea-4598-9aff-764b7f736afe,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:56:29.911721 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:56:29.913779 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:56:29.913779 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:56:29.913779 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:56:29.913779 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:56:29.913779 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:56:29.913779 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:56:29.914444 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:56:29.914444 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:56:29.914625 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:56:29.914924 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:56:29.915244 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:56:29.960578 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c61e0006-00ff-431c-8f6e-4ce662b577c8 req-d7547249-28c4-434d-924f-a56877426781 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0481384 Nov 02 12:56:30.180492 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8cbebb89-4530-49e6-837a-7f74dce770a1 req-2b0f7c83-e459-4b2e-8628-8fa798085f15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:30.181948 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8cbebb89-4530-49e6-837a-7f74dce770a1 req-2b0f7c83-e459-4b2e-8628-8fa798085f15 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 1099 time: 0.0398645 Nov 02 12:56:30.229977 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8cbebb89-4530-49e6-837a-7f74dce770a1 req-3645994e-3caf-4ceb-ab51-82e73484e370 service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0400608 Nov 02 12:56:30.809614 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:31.080253 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bcb20dcb-00d2-4f11-82ae-056ad95ed1ae req-7f6444eb-bafe-4c7c-9a00-0de085e61f99 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:31.081736 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bcb20dcb-00d2-4f11-82ae-056ad95ed1ae req-7f6444eb-bafe-4c7c-9a00-0de085e61f99 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 946 time: 0.0498939 Nov 02 12:56:31.131043 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bcb20dcb-00d2-4f11-82ae-056ad95ed1ae req-bedc3923-9275-4dea-bd4b-0d3ab2e57471 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0431433 Nov 02 12:56:32.256577 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37fc6790-d3fc-4926-aac9-e31eafb56cc5 req-8a9538c4-d546-4098-801e-c1615ea481fd tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:32.258027 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-37fc6790-d3fc-4926-aac9-e31eafb56cc5 req-8a9538c4-d546-4098-801e-c1615ea481fd tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 946 time: 0.0541563 Nov 02 12:56:32.310297 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-37fc6790-d3fc-4926-aac9-e31eafb56cc5 req-e77dd5f0-1cc3-429d-a66f-d118fd8f1de9 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462446 Nov 02 12:56:32.425764 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8726a399-593d-42c1-8106-1ba64b63aa79 req-70a43a25-b50d-4155-8363-c456ba632c54 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:32.427303 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8726a399-593d-42c1-8106-1ba64b63aa79 req-70a43a25-b50d-4155-8363-c456ba632c54 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 946 time: 0.0500329 Nov 02 12:56:32.476480 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8726a399-593d-42c1-8106-1ba64b63aa79 req-c760be62-74aa-4799-88d5-854208184fbe tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432003 Nov 02 12:56:32.499075 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 34848) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:56:32.539476 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-74a016f0-4ed9-4e00-b6de-1cc5da2e78bf tempest-TestVolumeBootPattern-1047552789 tempest-TestVolumeBootPattern-1047552789-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:32.541061 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-74a016f0-4ed9-4e00-b6de-1cc5da2e78bf tempest-TestVolumeBootPattern-1047552789 tempest-TestVolumeBootPattern-1047552789-project-admin] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 1094 time: 0.0409982 Nov 02 12:56:32.544168 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 34850) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:56:32.548788 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-7e3bc3ca-89f1-45b9-8140-af265aed758b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Request body: {'floatingip': {'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'port_id': 'a7cd13fe-71ea-4598-9aff-764b7f736afe', 'tenant_id': '697de566c0334435b902950f6f31da45', 'fixed_ip_address': '172.20.0.13'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:56:32.661918 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7e3bc3ca-89f1-45b9-8140-af265aed758b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for floatingip, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:32.764994 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7e3bc3ca-89f1-45b9-8140-af265aed758b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:32.880027 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [None req-7e3bc3ca-89f1-45b9-8140-af265aed758b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Allocated IP 172.27.0.37 (43464fa8-eb00-46fb-9ca0-be7342f9ddbf/44a807bc-f2b6-41f0-b765-e5d3393fe305/7b92754b-5682-48b4-a9c5-cced29cd2261) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:56:32.984253 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7e3bc3ca-89f1-45b9-8140-af265aed758b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:33.095689 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7e3bc3ca-89f1-45b9-8140-af265aed758b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:33.133124 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7e3bc3ca-89f1-45b9-8140-af265aed758b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:56:33.138300 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [None req-7e3bc3ca-89f1-45b9-8140-af265aed758b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:56:33.141932 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7e3bc3ca-89f1-45b9-8140-af265aed758b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:56:33.147894 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e3bc3ca-89f1-45b9-8140-af265aed758b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Pushing event updated for resources: {'Port': ['ID=7b92754b-5682-48b4-a9c5-cced29cd2261,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:56:33.348110 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:33.763507 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7e3bc3ca-89f1-45b9-8140-af265aed758b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:33.895786 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7e3bc3ca-89f1-45b9-8140-af265aed758b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:34.047270 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7e3bc3ca-89f1-45b9-8140-af265aed758b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for port, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:34.123541 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7e3bc3ca-89f1-45b9-8140-af265aed758b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:34.191604 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7e3bc3ca-89f1-45b9-8140-af265aed758b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Pushing event updated for resources: {'Port': ['ID=7b92754b-5682-48b4-a9c5-cced29cd2261,revision_number=2']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:56:34.205336 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7e3bc3ca-89f1-45b9-8140-af265aed758b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1594992'] for floatingip, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:34.317503 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.db.l3_db [None req-7e3bc3ca-89f1-45b9-8140-af265aed758b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Floating IP 5fd4585f-d4f7-4f9e-971e-e5d255fd0c1d associated. External IP: 172.27.0.37, port: a7cd13fe-71ea-4598-9aff-764b7f736afe. Nov 02 12:56:34.542145 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7e3bc3ca-89f1-45b9-8140-af265aed758b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108543) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 12:56:34.654863 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7e3bc3ca-89f1-45b9-8140-af265aed758b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108543) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:56:34.664847 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2d5d728-33da-49fb-9c17-447c6ca681ef None None] Sync routers for ids ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'] in dv-cinder-816324-1-iscsi {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:56:34.674669 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2d5d728-33da-49fb-9c17-447c6ca681ef None None] Routers {'2a2f63fd-e512-4ad2-9007-46e6ab6e8134'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:56:34.675780 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-d2d5d728-33da-49fb-9c17-447c6ca681ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:56:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:56:34.742792 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7e3bc3ca-89f1-45b9-8140-af265aed758b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for floatingip, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:34.772132 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-7e3bc3ca-89f1-45b9-8140-af265aed758b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 996 time: 2.2267833 Nov 02 12:56:34.773003 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '93ad83e9-3682-4f82-b83f-f511d5942f94', 'tag': 'a7cd13fe-71ea-4598-9aff-764b7f736afe'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:56:34.775435 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-7e1a06f6-171d-43db-93e7-e3a67d1476b6" -d '{"events": [{"name": "network-changed", "server_uuid": "93ad83e9-3682-4f82-b83f-f511d5942f94", "tag": "a7cd13fe-71ea-4598-9aff-764b7f736afe"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:56:34.785204 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-d2d5d728-33da-49fb-9c17-447c6ca681ef None None] Set router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:56:34.813870 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:56:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-7005711a-28c1-4768-92bb-879579fe44db x-openstack-request-id: req-7005711a-28c1-4768-92bb-879579fe44db {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:56:34.814168 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "93ad83e9-3682-4f82-b83f-f511d5942f94", "tag": "a7cd13fe-71ea-4598-9aff-764b7f736afe", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:56:34.814449 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-7005711a-28c1-4768-92bb-879579fe44db {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:56:34.814857 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '93ad83e9-3682-4f82-b83f-f511d5942f94', 'tag': 'a7cd13fe-71ea-4598-9aff-764b7f736afe', 'status': 'completed', 'code': 200} Nov 02 12:56:34.888886 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e1a06f6-171d-43db-93e7-e3a67d1476b6 req-410492a6-3cb8-4dcf-8857-84362aef2c1f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:34.892294 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7e1a06f6-171d-43db-93e7-e3a67d1476b6 req-410492a6-3cb8-4dcf-8857-84362aef2c1f service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=697de566c0334435b902950f6f31da45&device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 1099 time: 0.0461688 Nov 02 12:56:34.988875 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e1a06f6-171d-43db-93e7-e3a67d1476b6 req-0ebf591d-a19c-491b-98f0-dedc36a1e238 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:34.990344 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7e1a06f6-171d-43db-93e7-e3a67d1476b6 req-0ebf591d-a19c-491b-98f0-dedc36a1e238 service neutron] 10.222.0.90 "GET /v2.0/networks?id=89f406ae-1b9f-4be7-8881-87075d7c5aa1 HTTP/1.1" status: 200 len: 913 time: 0.0903809 Nov 02 12:56:35.027186 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-d2d5d728-33da-49fb-9c17-447c6ca681ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port': {'id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:1f:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:31Z', 'updated_at': '2021-11-02T12:51:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': '5fd4585f-d4f7-4f9e-971e-e5d255fd0c1d', 'tenant_id': '697de566c0334435b902950f6f31da45', 'floating_ip_address': '172.27.0.37', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'port_id': 'a7cd13fe-71ea-4598-9aff-764b7f736afe', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 584, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'mac_address': 'fa:16:3e:e9:fc:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93ad83e9-3682-4f82-b83f-f511d5942f94', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:56:33Z', 'updated_at': '2021-11-02T12:56:33Z', 'revision_number': 0, 'project_id': '697de566c0334435b902950f6f31da45', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '80a55893-6272-4299-8834-e840aa37d37b', 'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'tenant_id': '697de566c0334435b902950f6f31da45', 'mac_address': 'fa:16:3e:64:ef:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_interface', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:48Z', 'updated_at': '2021-11-02T12:52:07Z', 'revision_number': 5, 'project_id': '697de566c0334435b902950f6f31da45', 'subnets': [{'id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:56:35.054795 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2d5d728-33da-49fb-9c17-447c6ca681ef None None] Checking router: 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 for host: dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:56:35.059885 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7e1a06f6-171d-43db-93e7-e3a67d1476b6 req-f2cc97e0-d22f-41c3-ae83-a3b0c70f29ab service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=a7cd13fe-71ea-4598-9aff-764b7f736afe HTTP/1.1" status: 200 len: 999 time: 0.0617876 Nov 02 12:56:35.063145 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d2d5d728-33da-49fb-9c17-447c6ca681ef None None] Routers {'2a2f63fd-e512-4ad2-9007-46e6ab6e8134'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:56:35.063734 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-d2d5d728-33da-49fb-9c17-447c6ca681ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:56:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:56:35.128275 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e1a06f6-171d-43db-93e7-e3a67d1476b6 req-b95bd1ca-dc9f-4b17-94d4-393b85dd628c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:35.129746 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7e1a06f6-171d-43db-93e7-e3a67d1476b6 req-b95bd1ca-dc9f-4b17-94d4-393b85dd628c service neutron] 10.222.0.90 "GET /v2.0/subnets?id=ae24c2fe-abba-48cd-9d91-28a628d2ef95 HTTP/1.1" status: 200 len: 851 time: 0.0494814 Nov 02 12:56:35.171811 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-d2d5d728-33da-49fb-9c17-447c6ca681ef None None] Set router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:56:35.188326 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7e1a06f6-171d-43db-93e7-e3a67d1476b6 req-99fe3eb3-be5d-4b90-ae2a-091f2e5240f9 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:56:35.189812 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7e1a06f6-171d-43db-93e7-e3a67d1476b6 req-99fe3eb3-be5d-4b90-ae2a-091f2e5240f9 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=89f406ae-1b9f-4be7-8881-87075d7c5aa1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0455098 Nov 02 12:56:35.283952 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7e1a06f6-171d-43db-93e7-e3a67d1476b6 req-738538dc-657f-449c-97d3-05c4609af27e service neutron] 10.222.0.90 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0855787 Nov 02 12:56:35.387033 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7e1a06f6-171d-43db-93e7-e3a67d1476b6 req-010fb062-5616-43d4-b4bc-28a420a5c547 service neutron] 10.222.0.90 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0901320 Nov 02 12:56:35.407713 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-d2d5d728-33da-49fb-9c17-447c6ca681ef None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port': {'id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:1f:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:31Z', 'updated_at': '2021-11-02T12:51:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': '5fd4585f-d4f7-4f9e-971e-e5d255fd0c1d', 'tenant_id': '697de566c0334435b902950f6f31da45', 'floating_ip_address': '172.27.0.37', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'port_id': 'a7cd13fe-71ea-4598-9aff-764b7f736afe', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 584, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'mac_address': 'fa:16:3e:e9:fc:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93ad83e9-3682-4f82-b83f-f511d5942f94', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:56:33Z', 'updated_at': '2021-11-02T12:56:33Z', 'revision_number': 0, 'project_id': '697de566c0334435b902950f6f31da45', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '80a55893-6272-4299-8834-e840aa37d37b', 'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'tenant_id': '697de566c0334435b902950f6f31da45', 'mac_address': 'fa:16:3e:64:ef:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_interface', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:48Z', 'updated_at': '2021-11-02T12:52:07Z', 'revision_number': 5, 'project_id': '697de566c0334435b902950f6f31da45', 'subnets': [{'id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:56:35.437669 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d2d5d728-33da-49fb-9c17-447c6ca681ef None None] The sync data for ids ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'] in dv-cinder-816324-1-iscsi is: [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port': {'id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:1f:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:31Z', 'updated_at': '2021-11-02T12:51:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': '5fd4585f-d4f7-4f9e-971e-e5d255fd0c1d', 'tenant_id': '697de566c0334435b902950f6f31da45', 'floating_ip_address': '172.27.0.37', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'port_id': 'a7cd13fe-71ea-4598-9aff-764b7f736afe', 'fixed_ip_address': '172.20.0.13', 'status': 'DOWN', 'standard_attr_id': 584, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'mac_address': 'fa:16:3e:e9:fc:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93ad83e9-3682-4f82-b83f-f511d5942f94', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:56:33Z', 'updated_at': '2021-11-02T12:56:33Z', 'revision_number': 0, 'project_id': '697de566c0334435b902950f6f31da45', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '80a55893-6272-4299-8834-e840aa37d37b', 'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'tenant_id': '697de566c0334435b902950f6f31da45', 'mac_address': 'fa:16:3e:64:ef:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_interface', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:48Z', 'updated_at': '2021-11-02T12:52:07Z', 'revision_number': 5, 'project_id': '697de566c0334435b902950f6f31da45', 'subnets': [{'id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:56:35.640351 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-722ed309-01ad-4545-8c4f-40581082f6d1 None None] New status for floating IP 5fd4585f-d4f7-4f9e-971e-e5d255fd0c1d: ACTIVE {{(pid=108545) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 02 12:56:46.468067 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:56:53.512241 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-14f5b886-37c3-42ca-8a97-cf93dfbebda0 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:55.630910 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-d258bafa-3cf0-43b4-87e5-9dcceb77c453 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:56.866105 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:56:58.351547 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:00.871879 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:03.346432 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:08.188983 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a5648314-7ded-42e7-938d-4de2d1fd8072 req-7592b69d-7343-4f4d-9357-bc9436898c33 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0396521 Nov 02 12:57:08.287474 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5648314-7ded-42e7-938d-4de2d1fd8072 req-17632869-74f7-467e-9ca0-4ebd52ed753a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:08.288983 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a5648314-7ded-42e7-938d-4de2d1fd8072 req-17632869-74f7-467e-9ca0-4ebd52ed753a service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=d3bf5c9bdd7f479aa4cbc28f9a007c81&device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 1098 time: 0.0420337 Nov 02 12:57:08.408391 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5648314-7ded-42e7-938d-4de2d1fd8072 req-b8c8039f-92c2-40ca-8b4e-a3a61f75a6a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:08.410000 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a5648314-7ded-42e7-938d-4de2d1fd8072 req-b8c8039f-92c2-40ca-8b4e-a3a61f75a6a9 service neutron] 10.222.0.90 "GET /v2.0/networks?id=adffa68a-25de-4006-9dcc-006cbedf32e3 HTTP/1.1" status: 200 len: 910 time: 0.0991445 Nov 02 12:57:08.479604 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a5648314-7ded-42e7-938d-4de2d1fd8072 req-a72d40b3-1326-4bc3-92f3-964bed1a0b68 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=af83efde-b4cd-446b-9f74-15c631e4c45a HTTP/1.1" status: 200 len: 1000 time: 0.0605006 Nov 02 12:57:08.536287 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5648314-7ded-42e7-938d-4de2d1fd8072 req-be8a7568-231c-457d-aac7-be02aa7c235b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:08.537782 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a5648314-7ded-42e7-938d-4de2d1fd8072 req-be8a7568-231c-457d-aac7-be02aa7c235b service neutron] 10.222.0.90 "GET /v2.0/subnets?id=9a20b259-01c2-4b3f-8f92-0797a18ff7f7 HTTP/1.1" status: 200 len: 848 time: 0.0501747 Nov 02 12:57:08.585120 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a5648314-7ded-42e7-938d-4de2d1fd8072 req-f31e0d88-959e-4a0b-9966-ee5c07e6843a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:08.586642 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a5648314-7ded-42e7-938d-4de2d1fd8072 req-f31e0d88-959e-4a0b-9966-ee5c07e6843a service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=adffa68a-25de-4006-9dcc-006cbedf32e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0410624 Nov 02 12:57:08.682824 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a5648314-7ded-42e7-938d-4de2d1fd8072 req-90fa9b80-23b8-462a-9df3-08f9f0bf6c24 service neutron] 10.222.0.90 "GET /v2.0/networks/adffa68a-25de-4006-9dcc-006cbedf32e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0872583 Nov 02 12:57:08.795398 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a5648314-7ded-42e7-938d-4de2d1fd8072 req-cd9061cc-5e9c-416d-a6b2-867d5deab0b4 service neutron] 10.222.0.90 "GET /v2.0/networks/adffa68a-25de-4006-9dcc-006cbedf32e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1040645 Nov 02 12:57:09.532879 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-af9f1311-ae0a-47a9-b601-9c0e08dd25f9 req-66c3c1be-4fe1-4ee9-8b89-250b61ba46e2 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:09.534248 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-af9f1311-ae0a-47a9-b601-9c0e08dd25f9 req-66c3c1be-4fe1-4ee9-8b89-250b61ba46e2 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 945 time: 0.0501330 Nov 02 12:57:09.582854 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-af9f1311-ae0a-47a9-b601-9c0e08dd25f9 req-b09fa9f2-f1d4-473c-88b7-07a0d0ed6f18 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0425165 Nov 02 12:57:10.708672 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f97a091-070d-461a-afa7-b8e1fdb23687 req-ec3ab2d9-23c6-402b-a874-b7ec9871ec33 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:10.710216 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1f97a091-070d-461a-afa7-b8e1fdb23687 req-ec3ab2d9-23c6-402b-a874-b7ec9871ec33 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 945 time: 0.0538523 Nov 02 12:57:10.757195 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1f97a091-070d-461a-afa7-b8e1fdb23687 req-beb43c71-d4a4-40a1-90e6-154cd9e48536 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0410566 Nov 02 12:57:11.217469 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54c37ac8-414e-4074-94fc-eee9dafce721 req-03b92103-7e91-481f-aa16-b32c0c4d1be8 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:11.219010 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-54c37ac8-414e-4074-94fc-eee9dafce721 req-03b92103-7e91-481f-aa16-b32c0c4d1be8 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.90 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 945 time: 0.0497768 Nov 02 12:57:11.311647 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-54c37ac8-414e-4074-94fc-eee9dafce721 req-3e20e335-5f4a-4330-ab59-29763bb92e8b tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Deleting port ca5c5f21-fa79-4114-ab42-264c76de67e3 {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:57:11.311988 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-54c37ac8-414e-4074-94fc-eee9dafce721 req-3e20e335-5f4a-4330-ab59-29763bb92e8b tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:11.407668 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-54c37ac8-414e-4074-94fc-eee9dafce721 req-3e20e335-5f4a-4330-ab59-29763bb92e8b tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] For port ca5c5f21-fa79-4114-ab42-264c76de67e3, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=ca5c5f21-fa79-4114-ab42-264c76de67e3,segment=NetworkSegment(e33ebaf8-f9b3-489e-9197-c5c63e968f23),segment_id=e33ebaf8-f9b3-489e-9197-c5c63e968f23)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:57:11.408031 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-54c37ac8-414e-4074-94fc-eee9dafce721 req-3e20e335-5f4a-4330-ab59-29763bb92e8b tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:11.421738 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-54c37ac8-414e-4074-94fc-eee9dafce721 req-3e20e335-5f4a-4330-ab59-29763bb92e8b tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Calling delete_port for ca5c5f21-fa79-4114-ab42-264c76de67e3 owned by compute:nova {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:57:11.614343 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-54c37ac8-414e-4074-94fc-eee9dafce721 req-3e20e335-5f4a-4330-ab59-29763bb92e8b tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:11.631903 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['ca5c5f21-fa79-4114-ab42-264c76de67e3'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:57:11.643624 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3e20e335-5f4a-4330-ab59-29763bb92e8b tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Pushing event deleted for resources: {'Port': ['ID=ca5c5f21-fa79-4114-ab42-264c76de67e3,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:11.656812 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e20e335-5f4a-4330-ab59-29763bb92e8b tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:11.657165 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e20e335-5f4a-4330-ab59-29763bb92e8b tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:11.657508 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e20e335-5f4a-4330-ab59-29763bb92e8b tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:11.657892 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e20e335-5f4a-4330-ab59-29763bb92e8b tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:11.658228 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e20e335-5f4a-4330-ab59-29763bb92e8b tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:11.658584 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e20e335-5f4a-4330-ab59-29763bb92e8b tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:11.658915 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e20e335-5f4a-4330-ab59-29763bb92e8b tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:11.659246 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e20e335-5f4a-4330-ab59-29763bb92e8b tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:11.659575 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e20e335-5f4a-4330-ab59-29763bb92e8b tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:11.659901 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e20e335-5f4a-4330-ab59-29763bb92e8b tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:11.660227 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e20e335-5f4a-4330-ab59-29763bb92e8b tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:11.660552 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-3e20e335-5f4a-4330-ab59-29763bb92e8b tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:11.693695 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-54c37ac8-414e-4074-94fc-eee9dafce721 req-3e20e335-5f4a-4330-ab59-29763bb92e8b tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] No DVR routers for this DVR port ca5c5f21-fa79-4114-ab42-264c76de67e3 on host hv-cinder-81632 {{(pid=108543) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 12:57:11.696195 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-54c37ac8-414e-4074-94fc-eee9dafce721 req-3e20e335-5f4a-4330-ab59-29763bb92e8b tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:11.699544 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-54c37ac8-414e-4074-94fc-eee9dafce721 req-3e20e335-5f4a-4330-ab59-29763bb92e8b tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.90 "DELETE /v2.0/ports/ca5c5f21-fa79-4114-ab42-264c76de67e3 HTTP/1.1" status: 204 len: 173 time: 0.4734004 Nov 02 12:57:11.699975 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '2e690c84-aca7-422c-9e29-cbb8b30d170f', 'name': 'network-vif-deleted', 'tag': 'ca5c5f21-fa79-4114-ab42-264c76de67e3'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:57:11.702251 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6a9a4b09-5eed-4845-ab64-4098f479e783" -d '{"events": [{"server_uuid": "2e690c84-aca7-422c-9e29-cbb8b30d170f", "name": "network-vif-deleted", "tag": "ca5c5f21-fa79-4114-ab42-264c76de67e3"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:57:11.738325 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:57:11 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9aa06a37-613e-4725-b5ea-ea82b65e0ad7 x-openstack-request-id: req-9aa06a37-613e-4725-b5ea-ea82b65e0ad7 {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:57:11.739129 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "2e690c84-aca7-422c-9e29-cbb8b30d170f", "name": "network-vif-deleted", "tag": "ca5c5f21-fa79-4114-ab42-264c76de67e3", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:57:11.739129 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-9aa06a37-613e-4725-b5ea-ea82b65e0ad7 {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:57:11.739385 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '2e690c84-aca7-422c-9e29-cbb8b30d170f', 'name': 'network-vif-deleted', 'tag': 'ca5c5f21-fa79-4114-ab42-264c76de67e3', 'status': 'completed', 'code': 200} Nov 02 12:57:11.857912 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6085911c-7358-485e-ae21-517fcd4a89d5 req-d9820173-78c6-46a2-b44e-583b836adaeb tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=2e690c84-aca7-422c-9e29-cbb8b30d170f HTTP/1.1" status: 200 len: 210 time: 0.0306082 Nov 02 12:57:16.669916 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device ca5c5f21-fa79-4114-ab42-264c76de67e3 no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:57:16.694095 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] No Port match for: ca5c5f21-fa79-4114-ab42-264c76de67e3 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:57:16.694095 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device ca5c5f21-fa79-4114-ab42-264c76de67e3 not bound to the agent host hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:57:17.168474 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b090c58d-56e9-4d63-90a7-5a1c43f3e829 req-b79e2dd8-92d5-4cc8-92e0-d6ed7eb61a41 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:17.169943 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b090c58d-56e9-4d63-90a7-5a1c43f3e829 req-b79e2dd8-92d5-4cc8-92e0-d6ed7eb61a41 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 946 time: 0.0497551 Nov 02 12:57:17.219676 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b090c58d-56e9-4d63-90a7-5a1c43f3e829 req-744793a5-9299-4999-aba6-e8cb984cdb54 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424042 Nov 02 12:57:18.100511 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 35054) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:18.411791 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6a6616bb-6975-4121-b8fa-1a75627d6ef2 req-1733479a-c319-49a7-98c2-391b103b8cd8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:18.413320 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6a6616bb-6975-4121-b8fa-1a75627d6ef2 req-1733479a-c319-49a7-98c2-391b103b8cd8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 946 time: 0.0773940 Nov 02 12:57:18.439728 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-fb470c7e-1149-4bd1-8365-02e702c4f97f tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Deleting port aed3a923-6de8-4776-8486-734106a997df {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:57:18.439980 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-fb470c7e-1149-4bd1-8365-02e702c4f97f tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:18.515874 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6a6616bb-6975-4121-b8fa-1a75627d6ef2 req-2213c8a8-12d0-4763-b51f-eca7df84a28d tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0953913 Nov 02 12:57:18.545731 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-fb470c7e-1149-4bd1-8365-02e702c4f97f tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:18.546079 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-fb470c7e-1149-4bd1-8365-02e702c4f97f tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:18.559429 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-fb470c7e-1149-4bd1-8365-02e702c4f97f tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Calling delete_port for aed3a923-6de8-4776-8486-734106a997df owned by network:floatingip {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:57:18.692004 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e13de15d-d1ee-4c0b-9b06-282167108802 req-077182e8-79b6-471c-85c6-2e4d530be123 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:18.693412 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e13de15d-d1ee-4c0b-9b06-282167108802 req-077182e8-79b6-471c-85c6-2e4d530be123 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.90 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 946 time: 0.0917177 Nov 02 12:57:18.838251 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-e13de15d-d1ee-4c0b-9b06-282167108802 req-c65b197c-4a2e-4c19-baf2-2fa638420f4c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Deleting port b2c052d8-c7f4-4790-afab-5f3766f86877 {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:57:18.838617 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-e13de15d-d1ee-4c0b-9b06-282167108802 req-c65b197c-4a2e-4c19-baf2-2fa638420f4c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:18.929438 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-e13de15d-d1ee-4c0b-9b06-282167108802 req-c65b197c-4a2e-4c19-baf2-2fa638420f4c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] For port b2c052d8-c7f4-4790-afab-5f3766f86877, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=b2c052d8-c7f4-4790-afab-5f3766f86877,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:57:18.929876 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-e13de15d-d1ee-4c0b-9b06-282167108802 req-c65b197c-4a2e-4c19-baf2-2fa638420f4c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:18.943779 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-fb470c7e-1149-4bd1-8365-02e702c4f97f tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:19.035735 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb470c7e-1149-4bd1-8365-02e702c4f97f tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Pushing event deleted for resources: {'Port': ['ID=aed3a923-6de8-4776-8486-734106a997df,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:19.423520 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-fb470c7e-1149-4bd1-8365-02e702c4f97f tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for floatingip, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:19.424298 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.db.l3_db [None req-fb470c7e-1149-4bd1-8365-02e702c4f97f tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Floating IP f46d9396-c840-4a9d-8cad-669b6639bbc1 disassociated (deleted). External IP: 172.27.0.18, port: af83efde-b4cd-446b-9f74-15c631e4c45a. Nov 02 12:57:19.557482 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-e13de15d-d1ee-4c0b-9b06-282167108802 req-c65b197c-4a2e-4c19-baf2-2fa638420f4c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:19.557482 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-e13de15d-d1ee-4c0b-9b06-282167108802 req-c65b197c-4a2e-4c19-baf2-2fa638420f4c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1594992'] for floatingip, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:19.557819 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.db.l3_db [req-e13de15d-d1ee-4c0b-9b06-282167108802 req-c65b197c-4a2e-4c19-baf2-2fa638420f4c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Floating IP e3501cd6-2b83-4251-9681-b015fefeca51 disassociated. External IP: 172.27.0.7, port: b2c052d8-c7f4-4790-afab-5f3766f86877. Nov 02 12:57:19.558041 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-e13de15d-d1ee-4c0b-9b06-282167108802 req-c65b197c-4a2e-4c19-baf2-2fa638420f4c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Calling delete_port for b2c052d8-c7f4-4790-afab-5f3766f86877 owned by compute:nova {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:57:19.727092 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-50009971-457c-49f3-af96-fcfac9270ce0 req-f5a6c1ab-4d1e-401f-bb1f-3af948080e6f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:19.729088 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-50009971-457c-49f3-af96-fcfac9270ce0 req-f5a6c1ab-4d1e-401f-bb1f-3af948080e6f tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 946 time: 0.1191649 Nov 02 12:57:19.856364 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fb470c7e-1149-4bd1-8365-02e702c4f97f tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Router 10f9b13b-6fcd-41e4-937a-5876beb694b1 has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108543) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 12:57:19.871316 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-50009971-457c-49f3-af96-fcfac9270ce0 req-c7f76c86-f2f7-4287-bf3b-ac97d692b554 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups?id=22be136f-6622-4997-9ab0-ce1c8e1fa2a3&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1084905 Nov 02 12:57:19.983553 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fb470c7e-1149-4bd1-8365-02e702c4f97f tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108543) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:57:19.988207 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-fb470c7e-1149-4bd1-8365-02e702c4f97f tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for floatingip, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:19.994393 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7555f145-36d4-48bf-b5ff-b126d493ab71 None None] Sync routers for ids ['10f9b13b-6fcd-41e4-937a-5876beb694b1'] in dv-cinder-816324-1-iscsi {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:57:20.004716 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7555f145-36d4-48bf-b5ff-b126d493ab71 None None] Routers {'10f9b13b-6fcd-41e4-937a-5876beb694b1'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:57:20.005425 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-7555f145-36d4-48bf-b5ff-b126d493ab71 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:56:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['10f9b13b-6fcd-41e4-937a-5876beb694b1'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:20.009016 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-e13de15d-d1ee-4c0b-9b06-282167108802 req-c65b197c-4a2e-4c19-baf2-2fa638420f4c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:20.041404 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-fb470c7e-1149-4bd1-8365-02e702c4f97f tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "DELETE /v2.0/floatingips/f46d9396-c840-4a9d-8cad-669b6639bbc1 HTTP/1.1" status: 204 len: 168 time: 1.9397483 Nov 02 12:57:20.044057 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8', 'tag': 'af83efde-b4cd-446b-9f74-15c631e4c45a'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:57:20.046150 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-c4c01c67-9362-46c4-be48-5469a5f39fea" -d '{"events": [{"name": "network-changed", "server_uuid": "d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8", "tag": "af83efde-b4cd-446b-9f74-15c631e4c45a"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:57:20.050033 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c65b197c-4a2e-4c19-baf2-2fa638420f4c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Pushing event deleted for resources: {'Port': ['ID=b2c052d8-c7f4-4790-afab-5f3766f86877,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:20.121134 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-7555f145-36d4-48bf-b5ff-b126d493ab71 None None] Set router 10f9b13b-6fcd-41e4-937a-5876beb694b1 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:57:20.146510 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:57:20 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-61d746e4-344a-4b62-8375-597f1fdbd527 x-openstack-request-id: req-61d746e4-344a-4b62-8375-597f1fdbd527 {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:57:20.146801 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8", "tag": "af83efde-b4cd-446b-9f74-15c631e4c45a", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:57:20.147051 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-61d746e4-344a-4b62-8375-597f1fdbd527 {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:57:20.147444 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8', 'tag': 'af83efde-b4cd-446b-9f74-15c631e4c45a', 'status': 'completed', 'code': 200} Nov 02 12:57:20.179767 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.l3_agent_scheduler [req-e13de15d-d1ee-4c0b-9b06-282167108802 req-c65b197c-4a2e-4c19-baf2-2fa638420f4c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Router 308142a4-46ba-42ef-a1f2-5df4b969cc8f has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108543) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 12:57:20.300494 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-e13de15d-d1ee-4c0b-9b06-282167108802 req-c65b197c-4a2e-4c19-baf2-2fa638420f4c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108543) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:57:20.311454 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-774b1939-cdc9-40fe-811e-1ef8e2fb3438 None None] Sync routers for ids ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'] in dv-cinder-816324-1-iscsi {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:57:20.323446 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-774b1939-cdc9-40fe-811e-1ef8e2fb3438 None None] Routers {'308142a4-46ba-42ef-a1f2-5df4b969cc8f'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:57:20.324327 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-774b1939-cdc9-40fe-811e-1ef8e2fb3438 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:56:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:20.344654 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-e13de15d-d1ee-4c0b-9b06-282167108802 req-c65b197c-4a2e-4c19-baf2-2fa638420f4c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] No DVR routers for this DVR port b2c052d8-c7f4-4790-afab-5f3766f86877 on host hv-cinder-81632 {{(pid=108543) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 12:57:20.347224 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-e13de15d-d1ee-4c0b-9b06-282167108802 req-c65b197c-4a2e-4c19-baf2-2fa638420f4c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:20.350224 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-7555f145-36d4-48bf-b5ff-b126d493ab71 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'name': 'tempest-TestShelveInstance-1902419255-router', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:17Z', 'updated_at': '2021-11-02T12:51:26Z', 'revision_number': 4, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'gw_port': {'id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b1:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 365, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:19Z', 'updated_at': '2021-11-02T12:51:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '0201d689-2e60-4ec9-800a-0897da7fce09', 'name': '', 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'mac_address': 'fa:16:3e:34:99:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '9a20b259-01c2-4b3f-8f92-0797a18ff7f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:24Z', 'updated_at': '2021-11-02T12:51:36Z', 'revision_number': 5, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'subnets': [{'id': '9a20b259-01c2-4b3f-8f92-0797a18ff7f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:20.351005 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e13de15d-d1ee-4c0b-9b06-282167108802 req-c65b197c-4a2e-4c19-baf2-2fa638420f4c tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.90 "DELETE /v2.0/ports/b2c052d8-c7f4-4790-afab-5f3766f86877 HTTP/1.1" status: 204 len: 173 time: 1.6481807 Nov 02 12:57:20.388719 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7555f145-36d4-48bf-b5ff-b126d493ab71 None None] Checking router: 10f9b13b-6fcd-41e4-937a-5876beb694b1 for host: dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:57:20.397152 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7555f145-36d4-48bf-b5ff-b126d493ab71 None None] Routers {'10f9b13b-6fcd-41e4-937a-5876beb694b1'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:57:20.397750 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-7555f145-36d4-48bf-b5ff-b126d493ab71 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:56:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['10f9b13b-6fcd-41e4-937a-5876beb694b1'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:20.442164 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-774b1939-cdc9-40fe-811e-1ef8e2fb3438 None None] Set router 308142a4-46ba-42ef-a1f2-5df4b969cc8f gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:57:20.535881 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-7555f145-36d4-48bf-b5ff-b126d493ab71 None None] Set router 10f9b13b-6fcd-41e4-937a-5876beb694b1 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:57:20.569637 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f956a4c-5170-4f42-9cc9-08be4f0d5766 req-755745a9-b885-4747-8576-8bfdb1c4e041 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:20.578780 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7f956a4c-5170-4f42-9cc9-08be4f0d5766 req-755745a9-b885-4747-8576-8bfdb1c4e041 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0748632 Nov 02 12:57:20.633105 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7f956a4c-5170-4f42-9cc9-08be4f0d5766 req-cedb44c4-408b-4c56-9831-87b7b739dae4 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0534410 Nov 02 12:57:20.689231 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-774b1939-cdc9-40fe-811e-1ef8e2fb3438 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'name': 'tempest-AttachVolumeShelveTestJSON-199949485-router', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207'}], 'enable_snat': True}, 'gw_port_id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:49:22Z', 'revision_number': 4, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'gw_port': {'id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:4a:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:12Z', 'updated_at': '2021-11-02T12:49:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '91fe3ff8-cdf3-4761-8b27-27e55f6f6690', 'name': '', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'mac_address': 'fa:16:3e:51:73:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:20Z', 'updated_at': '2021-11-02T12:49:34Z', 'revision_number': 5, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'subnets': [{'id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:20.716582 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-774b1939-cdc9-40fe-811e-1ef8e2fb3438 None None] Checking router: 308142a4-46ba-42ef-a1f2-5df4b969cc8f for host: dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:57:20.724837 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-774b1939-cdc9-40fe-811e-1ef8e2fb3438 None None] Routers {'308142a4-46ba-42ef-a1f2-5df4b969cc8f'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:57:20.725431 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-774b1939-cdc9-40fe-811e-1ef8e2fb3438 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:56:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:20.742749 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-7555f145-36d4-48bf-b5ff-b126d493ab71 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'name': 'tempest-TestShelveInstance-1902419255-router', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:17Z', 'updated_at': '2021-11-02T12:51:26Z', 'revision_number': 4, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'gw_port': {'id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b1:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 365, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:19Z', 'updated_at': '2021-11-02T12:51:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '0201d689-2e60-4ec9-800a-0897da7fce09', 'name': '', 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'mac_address': 'fa:16:3e:34:99:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '9a20b259-01c2-4b3f-8f92-0797a18ff7f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:24Z', 'updated_at': '2021-11-02T12:51:36Z', 'revision_number': 5, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'subnets': [{'id': '9a20b259-01c2-4b3f-8f92-0797a18ff7f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:20.768647 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-7555f145-36d4-48bf-b5ff-b126d493ab71 None None] The sync data for ids ['10f9b13b-6fcd-41e4-937a-5876beb694b1'] in dv-cinder-816324-1-iscsi is: [{'id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'name': 'tempest-TestShelveInstance-1902419255-router', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:17Z', 'updated_at': '2021-11-02T12:51:26Z', 'revision_number': 4, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'gw_port': {'id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b1:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 365, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:19Z', 'updated_at': '2021-11-02T12:51:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '0201d689-2e60-4ec9-800a-0897da7fce09', 'name': '', 'network_id': 'adffa68a-25de-4006-9dcc-006cbedf32e3', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'mac_address': 'fa:16:3e:34:99:55', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'device_owner': 'network:router_interface', 'standard_attr_id': 384, 'fixed_ips': [{'subnet_id': '9a20b259-01c2-4b3f-8f92-0797a18ff7f7', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:24Z', 'updated_at': '2021-11-02T12:51:36Z', 'revision_number': 5, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'subnets': [{'id': '9a20b259-01c2-4b3f-8f92-0797a18ff7f7', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:57:20.838018 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-774b1939-cdc9-40fe-811e-1ef8e2fb3438 None None] Set router 308142a4-46ba-42ef-a1f2-5df4b969cc8f gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:57:20.988069 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bdb3c302-5c00-4910-a22d-54c9584dea11 req-78b3a063-2544-48e1-b427-40d2f909477b tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 210 time: 0.0272183 Nov 02 12:57:21.032207 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-32182812-67fe-4aab-be71-f9b41196dbd0 None None] New status for floating IP f46d9396-c840-4a9d-8cad-669b6639bbc1: DOWN {{(pid=108544) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 02 12:57:21.052958 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-774b1939-cdc9-40fe-811e-1ef8e2fb3438 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'name': 'tempest-AttachVolumeShelveTestJSON-199949485-router', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207'}], 'enable_snat': True}, 'gw_port_id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:49:22Z', 'revision_number': 4, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'gw_port': {'id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:4a:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:12Z', 'updated_at': '2021-11-02T12:49:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '91fe3ff8-cdf3-4761-8b27-27e55f6f6690', 'name': '', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'mac_address': 'fa:16:3e:51:73:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:20Z', 'updated_at': '2021-11-02T12:49:34Z', 'revision_number': 5, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'subnets': [{'id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:21.080405 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-774b1939-cdc9-40fe-811e-1ef8e2fb3438 None None] The sync data for ids ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'] in dv-cinder-816324-1-iscsi is: [{'id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'name': 'tempest-AttachVolumeShelveTestJSON-199949485-router', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207'}], 'enable_snat': True}, 'gw_port_id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:49:22Z', 'revision_number': 4, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'gw_port': {'id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:4a:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:12Z', 'updated_at': '2021-11-02T12:49:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '91fe3ff8-cdf3-4761-8b27-27e55f6f6690', 'name': '', 'network_id': 'c468f0e1-3636-49b9-90c6-b90c643ed7d1', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'mac_address': 'fa:16:3e:51:73:ab', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_interface', 'standard_attr_id': 86, 'fixed_ips': [{'subnet_id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:20Z', 'updated_at': '2021-11-02T12:49:34Z', 'revision_number': 5, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'subnets': [{'id': 'ec48fe57-a1cd-4e7c-874f-073624f71f4b', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:57:21.293116 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-88a68323-a51d-4ddc-9549-f55a6c4e3cea None None] New status for floating IP e3501cd6-2b83-4251-9681-b015fefeca51: DOWN {{(pid=108545) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 02 12:57:21.751154 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04f73ffb-dde4-4fcc-b7cb-8d84b874cf4f req-60f1f8be-a6f3-45ff-8c8f-d7e287254bc3 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:21.752602 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-04f73ffb-dde4-4fcc-b7cb-8d84b874cf4f req-60f1f8be-a6f3-45ff-8c8f-d7e287254bc3 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0486162 Nov 02 12:57:21.802161 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-04f73ffb-dde4-4fcc-b7cb-8d84b874cf4f req-abbd4a3c-8c6b-4661-ae8b-d8e66e362ddf tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0436633 Nov 02 12:57:22.089904 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b67c7068-7015-467c-9c4f-eb08ff5de950 req-8522a44a-3161-4eec-a39f-ae343c068f63 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 210 time: 0.0262260 Nov 02 12:57:22.148646 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'a1984910-3b5c-43f5-8727-1c65226b3983', 'name': 'network-vif-deleted', 'tag': 'b2c052d8-c7f4-4790-afab-5f3766f86877'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:57:22.151668 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-900b59af-db0f-4598-9f52-635354e6e474" -d '{"events": [{"server_uuid": "a1984910-3b5c-43f5-8727-1c65226b3983", "name": "network-vif-deleted", "tag": "b2c052d8-c7f4-4790-afab-5f3766f86877"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:57:22.186742 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:57:22 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e46b6f5d-f282-4232-a43c-bd697a29c5ce x-openstack-request-id: req-e46b6f5d-f282-4232-a43c-bd697a29c5ce {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:57:22.187120 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "a1984910-3b5c-43f5-8727-1c65226b3983", "name": "network-vif-deleted", "tag": "b2c052d8-c7f4-4790-afab-5f3766f86877", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:57:22.187462 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-e46b6f5d-f282-4232-a43c-bd697a29c5ce {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:57:22.187925 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'a1984910-3b5c-43f5-8727-1c65226b3983', 'name': 'network-vif-deleted', 'tag': 'b2c052d8-c7f4-4790-afab-5f3766f86877', 'status': 'completed', 'code': 200} Nov 02 12:57:22.541927 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c01c67-9362-46c4-be48-5469a5f39fea req-d0797e50-887d-4569-acea-374a941de551 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:22.543478 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c4c01c67-9362-46c4-be48-5469a5f39fea req-d0797e50-887d-4569-acea-374a941de551 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=d3bf5c9bdd7f479aa4cbc28f9a007c81&device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 1098 time: 0.0455728 Nov 02 12:57:22.639825 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c01c67-9362-46c4-be48-5469a5f39fea req-c9aa081f-cae0-456d-aebb-dea6ad643581 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:22.641357 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c4c01c67-9362-46c4-be48-5469a5f39fea req-c9aa081f-cae0-456d-aebb-dea6ad643581 service neutron] 10.222.0.90 "GET /v2.0/networks?id=adffa68a-25de-4006-9dcc-006cbedf32e3 HTTP/1.1" status: 200 len: 910 time: 0.0893559 Nov 02 12:57:22.689887 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c4c01c67-9362-46c4-be48-5469a5f39fea req-813f84f8-55ce-407a-a8dd-b8aee4526496 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.7&port_id=af83efde-b4cd-446b-9f74-15c631e4c45a HTTP/1.1" status: 200 len: 217 time: 0.0388288 Nov 02 12:57:22.745157 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c01c67-9362-46c4-be48-5469a5f39fea req-61bd71c1-b372-4e36-ac79-fc95b5feb961 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:22.746606 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c4c01c67-9362-46c4-be48-5469a5f39fea req-61bd71c1-b372-4e36-ac79-fc95b5feb961 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=9a20b259-01c2-4b3f-8f92-0797a18ff7f7 HTTP/1.1" status: 200 len: 848 time: 0.0455515 Nov 02 12:57:22.797286 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c4c01c67-9362-46c4-be48-5469a5f39fea req-e5afca22-4072-4c74-be11-7d8ee934d0d8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:22.798838 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c4c01c67-9362-46c4-be48-5469a5f39fea req-e5afca22-4072-4c74-be11-7d8ee934d0d8 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=adffa68a-25de-4006-9dcc-006cbedf32e3&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0428166 Nov 02 12:57:22.930480 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c4c01c67-9362-46c4-be48-5469a5f39fea req-a423ab7d-5a04-4bd7-914a-b28ebfc543a3 service neutron] 10.222.0.90 "GET /v2.0/networks/adffa68a-25de-4006-9dcc-006cbedf32e3?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1212678 Nov 02 12:57:22.942087 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-650fa825-9510-474f-8653-89c8584cc20d req-0c3bba04-92a2-4f8f-b94b-d1033d3d72a3 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:22.943571 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-650fa825-9510-474f-8653-89c8584cc20d req-0c3bba04-92a2-4f8f-b94b-d1033d3d72a3 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0734122 Nov 02 12:57:23.051294 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-650fa825-9510-474f-8653-89c8584cc20d req-be24f769-1395-434d-a0b1-a11199f57a53 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0994847 Nov 02 12:57:23.070140 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c4c01c67-9362-46c4-be48-5469a5f39fea req-8e72f5cd-754f-4591-994a-184100340f3d service neutron] 10.222.0.90 "GET /v2.0/networks/adffa68a-25de-4006-9dcc-006cbedf32e3?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1255970 Nov 02 12:57:23.202771 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0b386819-4861-435e-9c9d-1b90225f9e00 req-02548eaa-3194-4430-b07a-c3f7ef430192 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/ports?device_id=a1984910-3b5c-43f5-8727-1c65226b3983 HTTP/1.1" status: 200 len: 210 time: 0.0262470 Nov 02 12:57:23.467946 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:57:23.528245 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-557b91f9-c1be-4aa3-84a9-96a0a7ba7dd7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:23.669832 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-ad19b5fc-0826-47f0-8b40-54de403cc7bf tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:23.671587 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-ad19b5fc-0826-47f0-8b40-54de403cc7bf tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/networks?id=8e873280-f41f-4e9c-a802-c6eb6e9e490f HTTP/1.1" status: 200 len: 812 time: 0.1080534 Nov 02 12:57:23.687244 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-4b45e8cc-2543-4610-ba65-67bb4354c81d tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/quotas/577cab8b312e435c94d7b8d6c6f1929d HTTP/1.1" status: 200 len: 375 time: 0.0093038 Nov 02 12:57:23.719921 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-7ff787f9-ca4e-4ef7-bc47-2aa8b7b3c09a tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?tenant_id=577cab8b312e435c94d7b8d6c6f1929d&fields=id HTTP/1.1" status: 200 len: 210 time: 0.0271294 Nov 02 12:57:23.854689 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-d69920c3-0e6c-4384-8251-c1407a6187fc service neutron] 10.222.0.98 "GET /v2.0/networks/8e873280-f41f-4e9c-a802-c6eb6e9e490f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1278758 Nov 02 12:57:23.950285 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-0d9cdde6-1799-4b2d-8b81-99a88d91505d service neutron] 10.222.0.98 "GET /v2.0/networks/8e873280-f41f-4e9c-a802-c6eb6e9e490f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0887661 Nov 02 12:57:24.201116 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a406d5a2-eee1-4ccc-bb68-3453411adf3d req-786ed138-22c3-4a40-8a1f-e9e78832feea tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:24.202761 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a406d5a2-eee1-4ccc-bb68-3453411adf3d req-786ed138-22c3-4a40-8a1f-e9e78832feea tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0806925 Nov 02 12:57:24.220618 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3e822f90-3a6d-41a7-8e9b-c8ab0020992b req-345c09b3-bff0-4268-90ba-b77e89f4a2b3 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=c255ff21-01f2-4710-911e-a3289a3fcc41 HTTP/1.1" status: 200 len: 210 time: 0.0445547 Nov 02 12:57:24.276178 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a406d5a2-eee1-4ccc-bb68-3453411adf3d req-88d521b7-382d-4bb0-a413-33b3471613ad tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/security-groups?id=3c1edf2a-2914-43e2-b6b9-2b238c73ff68&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0588856 Nov 02 12:57:24.381110 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 35124) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:24.438558 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-e19c793f-50ea-416c-92d6-a87dab0ffee6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:24.464276 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-e19c793f-50ea-416c-92d6-a87dab0ffee6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:24.485506 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device b2c052d8-c7f4-4790-afab-5f3766f86877 no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:57:24.514498 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] No Port match for: b2c052d8-c7f4-4790-afab-5f3766f86877 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:57:24.515538 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device b2c052d8-c7f4-4790-afab-5f3766f86877 not bound to the agent host hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:57:24.566986 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52313752-8ca0-450d-a11d-ef80e7f6c222 req-49d4105a-4a80-479f-859d-e737dc8c8373 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:24.568534 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-52313752-8ca0-450d-a11d-ef80e7f6c222 req-49d4105a-4a80-479f-859d-e737dc8c8373 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.90 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 945 time: 0.0692596 Nov 02 12:57:24.632215 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-e19c793f-50ea-416c-92d6-a87dab0ffee6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:24.636680 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-e19c793f-50ea-416c-92d6-a87dab0ffee6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:24.636680 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-e19c793f-50ea-416c-92d6-a87dab0ffee6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "DELETE /v2.0/security-groups/22be136f-6622-4997-9ab0-ce1c8e1fa2a3 HTTP/1.1" status: 204 len: 168 time: 0.2539389 Nov 02 12:57:24.641051 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 35126) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:24.659073 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.api.v2.resource [None req-246c0345-61b4-4d1e-82ec-c43af30392b3 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] show failed (client error): The resource could not be found. Nov 02 12:57:24.662837 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-246c0345-61b4-4d1e-82ec-c43af30392b3 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "GET /v2.0/security-groups/22be136f-6622-4997-9ab0-ce1c8e1fa2a3 HTTP/1.1" status: 404 len: 347 time: 0.0178199 Nov 02 12:57:24.663231 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 35130) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:24.670334 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e19c793f-50ea-416c-92d6-a87dab0ffee6 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=22be136f-6622-4997-9ab0-ce1c8e1fa2a3,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:24.713887 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-52313752-8ca0-450d-a11d-ef80e7f6c222 req-6d080d22-b3bd-47a4-9f30-b75463a513d8 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Deleting port af83efde-b4cd-446b-9f74-15c631e4c45a {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:57:24.714523 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-52313752-8ca0-450d-a11d-ef80e7f6c222 req-6d080d22-b3bd-47a4-9f30-b75463a513d8 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:24.798218 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-68cd0203-ae8b-43e9-ae63-95d30df266b8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Deleting port 3248e1f1-a6aa-47f6-9b78-2c1fddd0adc7 {{(pid=108542) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:57:24.798498 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-68cd0203-ae8b-43e9-ae63-95d30df266b8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:24.814857 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-52313752-8ca0-450d-a11d-ef80e7f6c222 req-6d080d22-b3bd-47a4-9f30-b75463a513d8 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] For port af83efde-b4cd-446b-9f74-15c631e4c45a, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=af83efde-b4cd-446b-9f74-15c631e4c45a,segment=NetworkSegment(e206345e-67db-4144-84ee-50b4e5db5d75),segment_id=e206345e-67db-4144-84ee-50b4e5db5d75)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:57:24.815218 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-52313752-8ca0-450d-a11d-ef80e7f6c222 req-6d080d22-b3bd-47a4-9f30-b75463a513d8 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:24.829594 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-52313752-8ca0-450d-a11d-ef80e7f6c222 req-6d080d22-b3bd-47a4-9f30-b75463a513d8 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Calling delete_port for af83efde-b4cd-446b-9f74-15c631e4c45a owned by compute:nova {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:57:24.890675 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-68cd0203-ae8b-43e9-ae63-95d30df266b8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:24.890998 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-68cd0203-ae8b-43e9-ae63-95d30df266b8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:24.905385 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-68cd0203-ae8b-43e9-ae63-95d30df266b8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Calling delete_port for 3248e1f1-a6aa-47f6-9b78-2c1fddd0adc7 owned by network:floatingip {{(pid=108542) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:57:25.049186 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-52313752-8ca0-450d-a11d-ef80e7f6c222 req-6d080d22-b3bd-47a4-9f30-b75463a513d8 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:25.080407 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6d080d22-b3bd-47a4-9f30-b75463a513d8 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Pushing event deleted for resources: {'Port': ['ID=af83efde-b4cd-446b-9f74-15c631e4c45a,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:25.126004 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-52313752-8ca0-450d-a11d-ef80e7f6c222 req-6d080d22-b3bd-47a4-9f30-b75463a513d8 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] No DVR routers for this DVR port af83efde-b4cd-446b-9f74-15c631e4c45a on host hv-cinder-81632 {{(pid=108543) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 12:57:25.128729 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-52313752-8ca0-450d-a11d-ef80e7f6c222 req-6d080d22-b3bd-47a4-9f30-b75463a513d8 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:25.132114 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-52313752-8ca0-450d-a11d-ef80e7f6c222 req-6d080d22-b3bd-47a4-9f30-b75463a513d8 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.90 "DELETE /v2.0/ports/af83efde-b4cd-446b-9f74-15c631e4c45a HTTP/1.1" status: 204 len: 173 time: 0.5541253 Nov 02 12:57:25.132556 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8', 'name': 'network-vif-deleted', 'tag': 'af83efde-b4cd-446b-9f74-15c631e4c45a'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:57:25.135462 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d255a712-6b39-4565-b0cc-e7dbc177f82e" -d '{"events": [{"server_uuid": "d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8", "name": "network-vif-deleted", "tag": "af83efde-b4cd-446b-9f74-15c631e4c45a"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:57:25.165441 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-68cd0203-ae8b-43e9-ae63-95d30df266b8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:25.173315 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:57:25 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-061c134a-fc44-478d-8d53-3204b8a13f4a x-openstack-request-id: req-061c134a-fc44-478d-8d53-3204b8a13f4a {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:57:25.174289 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8", "name": "network-vif-deleted", "tag": "af83efde-b4cd-446b-9f74-15c631e4c45a", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:57:25.174600 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-061c134a-fc44-478d-8d53-3204b8a13f4a {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:57:25.175048 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8', 'name': 'network-vif-deleted', 'tag': 'af83efde-b4cd-446b-9f74-15c631e4c45a', 'status': 'completed', 'code': 200} Nov 02 12:57:25.193131 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68cd0203-ae8b-43e9-ae63-95d30df266b8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Pushing event deleted for resources: {'Port': ['ID=3248e1f1-a6aa-47f6-9b78-2c1fddd0adc7,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:25.205437 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68cd0203-ae8b-43e9-ae63-95d30df266b8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:25.205780 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68cd0203-ae8b-43e9-ae63-95d30df266b8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:25.206120 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68cd0203-ae8b-43e9-ae63-95d30df266b8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:25.206538 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68cd0203-ae8b-43e9-ae63-95d30df266b8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:25.206949 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68cd0203-ae8b-43e9-ae63-95d30df266b8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:25.207280 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68cd0203-ae8b-43e9-ae63-95d30df266b8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:25.207621 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68cd0203-ae8b-43e9-ae63-95d30df266b8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:25.207941 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68cd0203-ae8b-43e9-ae63-95d30df266b8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:25.208263 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68cd0203-ae8b-43e9-ae63-95d30df266b8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:25.208583 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68cd0203-ae8b-43e9-ae63-95d30df266b8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:25.208908 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68cd0203-ae8b-43e9-ae63-95d30df266b8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:25.209252 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-68cd0203-ae8b-43e9-ae63-95d30df266b8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:25.276535 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-68cd0203-ae8b-43e9-ae63-95d30df266b8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks [] for floatingip, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:25.281503 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-68cd0203-ae8b-43e9-ae63-95d30df266b8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for floatingip, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:25.283580 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-68cd0203-ae8b-43e9-ae63-95d30df266b8 tempest-AttachVolumeShelveTestJSON-948496344 tempest-AttachVolumeShelveTestJSON-948496344-project] 10.222.0.98 "DELETE /v2.0/floatingips/e3501cd6-2b83-4251-9681-b015fefeca51 HTTP/1.1" status: 204 len: 168 time: 0.6190917 Nov 02 12:57:25.356798 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-25caa7b0-db35-4954-bbcf-588aaefe3906 req-aa5a99ce-463f-4041-8cad-6c902420ff2a tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=c255ff21-01f2-4710-911e-a3289a3fcc41 HTTP/1.1" status: 200 len: 210 time: 0.0363479 Nov 02 12:57:25.395744 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d3dd379c-8d01-492b-8644-20639ddc2435 req-c8a97546-5674-4319-b406-d5f8aaba5c3b tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 210 time: 0.0311279 Nov 02 12:57:25.682959 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-45b3c50b-9cfd-4673-919e-f8ea209f9bb2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:26.472859 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-adde14a8-7c1d-444e-bb77-92e3c5f6a974 req-6b8fda1f-eb73-4f87-94ca-9d7346f030b5 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=c255ff21-01f2-4710-911e-a3289a3fcc41 HTTP/1.1" status: 200 len: 210 time: 0.0282328 Nov 02 12:57:26.518224 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-57d9983f-4aad-4cf2-af78-b6b3966ca57d req-6e8fa3d8-83f8-49c5-9e84-2a5c83d25be2 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9e0ebc1-035a-4d4f-a63d-bf4a254d8ea8 HTTP/1.1" status: 200 len: 210 time: 0.0317502 Nov 02 12:57:26.867759 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-2cb7dc40-8dec-4959-b09e-f6ce1575e51d tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:26.869872 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-2cb7dc40-8dec-4959-b09e-f6ce1575e51d tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.90 "GET /v2.0/networks?id=8e873280-f41f-4e9c-a802-c6eb6e9e490f HTTP/1.1" status: 200 len: 812 time: 0.1306863 Nov 02 12:57:26.885201 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-ec9cfa0a-96f2-458e-93df-f5bbc47c2655 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Request body: {'port': {'device_id': 'c255ff21-01f2-4710-911e-a3289a3fcc41', 'network_id': '8e873280-f41f-4e9c-a802-c6eb6e9e490f', 'admin_state_up': True, 'tenant_id': '577cab8b312e435c94d7b8d6c6f1929d'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:57:26.906860 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:27.151782 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-ec9cfa0a-96f2-458e-93df-f5bbc47c2655 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Made reservation on behalf of 577cab8b312e435c94d7b8d6c6f1929d for: {'port': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:57:27.158004 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-ec9cfa0a-96f2-458e-93df-f5bbc47c2655 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:27.339934 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-ec9cfa0a-96f2-458e-93df-f5bbc47c2655 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Allocated IP 172.20.0.8 (8e873280-f41f-4e9c-a802-c6eb6e9e490f/c76b8d78-f8d1-4c53-8f06-2a9d4330c04a/be131926-c287-4b0b-a5cc-127875f9f4ac) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:57:27.578131 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-ec9cfa0a-96f2-458e-93df-f5bbc47c2655 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:27.591376 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 35166) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:27.627658 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c9dc6974-9be3-4673-bbe5-b62fcee4626f req-7394702d-28eb-4eaf-937c-716cd6d65772 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=c255ff21-01f2-4710-911e-a3289a3fcc41 HTTP/1.1" status: 200 len: 210 time: 0.0462034 Nov 02 12:57:27.673427 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-53e496d0-3602-40b6-bb88-533f31eb7ed8 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:27.703140 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-53e496d0-3602-40b6-bb88-533f31eb7ed8 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:27.740908 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-ec9cfa0a-96f2-458e-93df-f5bbc47c2655 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:27.796275 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-ec9cfa0a-96f2-458e-93df-f5bbc47c2655 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Network 8e873280-f41f-4e9c-a802-c6eb6e9e490f is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:57:27.802122 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-ec9cfa0a-96f2-458e-93df-f5bbc47c2655 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:57:27.806177 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-ec9cfa0a-96f2-458e-93df-f5bbc47c2655 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:57:27.813397 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ec9cfa0a-96f2-458e-93df-f5bbc47c2655 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Pushing event updated for resources: {'Port': ['ID=be131926-c287-4b0b-a5cc-127875f9f4ac,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:27.867706 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-ec9cfa0a-96f2-458e-93df-f5bbc47c2655 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:27.868357 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-ec9cfa0a-96f2-458e-93df-f5bbc47c2655 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:27.888613 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-53e496d0-3602-40b6-bb88-533f31eb7ed8 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:27.892598 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-53e496d0-3602-40b6-bb88-533f31eb7ed8 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:27.896205 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-53e496d0-3602-40b6-bb88-533f31eb7ed8 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] 10.222.0.98 "DELETE /v2.0/security-groups/3c1edf2a-2914-43e2-b6b9-2b238c73ff68 HTTP/1.1" status: 204 len: 168 time: 0.3015463 Nov 02 12:57:27.906984 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-53e496d0-3602-40b6-bb88-533f31eb7ed8 tempest-TestShelveInstance-1863846858 tempest-TestShelveInstance-1863846858-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=3c1edf2a-2914-43e2-b6b9-2b238c73ff68,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:27.960385 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-ec9cfa0a-96f2-458e-93df-f5bbc47c2655 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.0794926 Nov 02 12:57:27.978817 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-3be53e37-902b-4abb-96d1-15adcf3ea2b0 service neutron] Request body: {'port': {'device_id': 'c255ff21-01f2-4710-911e-a3289a3fcc41', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81632'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:57:28.016136 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 35170) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:28.056511 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-3be53e37-902b-4abb-96d1-15adcf3ea2b0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:28.159912 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 35180) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:28.351777 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:28.411353 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-3be53e37-902b-4abb-96d1-15adcf3ea2b0 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id be131926-c287-4b0b-a5cc-127875f9f4ac {{(pid=108543) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:57:28.426007 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-3be53e37-902b-4abb-96d1-15adcf3ea2b0 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:28.441856 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.provisioning_blocks [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-3be53e37-902b-4abb-96d1-15adcf3ea2b0 service neutron] Transition to ACTIVE for port object be131926-c287-4b0b-a5cc-127875f9f4ac will not be triggered until provisioned by entity L2. {{(pid=108543) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 02 12:57:28.496762 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device af83efde-b4cd-446b-9f74-15c631e4c45a no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:57:28.517173 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-3be53e37-902b-4abb-96d1-15adcf3ea2b0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:28.518495 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] No Port match for: af83efde-b4cd-446b-9f74-15c631e4c45a {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:57:28.519106 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device af83efde-b4cd-446b-9f74-15c631e4c45a not bound to the agent host hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:57:28.583561 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3be53e37-902b-4abb-96d1-15adcf3ea2b0 service neutron] Pushing event updated for resources: {'Port': ['ID=be131926-c287-4b0b-a5cc-127875f9f4ac,revision_number=2']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:28.672936 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-3be53e37-902b-4abb-96d1-15adcf3ea2b0 service neutron] Attempting to bind port be131926-c287-4b0b-a5cc-127875f9f4ac on host hv-cinder-81632 for vnic_type normal with profile {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:57:28.673446 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-3be53e37-902b-4abb-96d1-15adcf3ea2b0 service neutron] Attempting to bind port be131926-c287-4b0b-a5cc-127875f9f4ac by drivers openvswitch,hyperv on host hv-cinder-81632 at level 0 using segments [{'id': 'e33ebaf8-f9b3-489e-9197-c5c63e968f23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': '8e873280-f41f-4e9c-a802-c6eb6e9e490f'}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:57:28.674325 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-3be53e37-902b-4abb-96d1-15adcf3ea2b0 service neutron] Attempting to bind port be131926-c287-4b0b-a5cc-127875f9f4ac on network 8e873280-f41f-4e9c-a802-c6eb6e9e490f {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:57:28.681442 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-3be53e37-902b-4abb-96d1-15adcf3ea2b0 service neutron] Port be131926-c287-4b0b-a5cc-127875f9f4ac on network 8e873280-f41f-4e9c-a802-c6eb6e9e490f not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81632 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 02 12:57:28.682039 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-3be53e37-902b-4abb-96d1-15adcf3ea2b0 service neutron] Attempting to bind port be131926-c287-4b0b-a5cc-127875f9f4ac on network 8e873280-f41f-4e9c-a802-c6eb6e9e490f {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:57:28.690072 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-3be53e37-902b-4abb-96d1-15adcf3ea2b0 service neutron] Checking agent: {'id': '0d57fa42-4660-4f08-b7dc-53a872c3c01c', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81632', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'started_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 57, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:57:28.690072 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-3be53e37-902b-4abb-96d1-15adcf3ea2b0 service neutron] Checking segment: {'id': 'e33ebaf8-f9b3-489e-9197-c5c63e968f23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': '8e873280-f41f-4e9c-a802-c6eb6e9e490f'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108543) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:57:28.690527 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-3be53e37-902b-4abb-96d1-15adcf3ea2b0 service neutron] Bound using segment: {'id': 'e33ebaf8-f9b3-489e-9197-c5c63e968f23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': '8e873280-f41f-4e9c-a802-c6eb6e9e490f'} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:57:28.691069 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-3be53e37-902b-4abb-96d1-15adcf3ea2b0 service neutron] Bound port: be131926-c287-4b0b-a5cc-127875f9f4ac, host: hv-cinder-81632, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'e33ebaf8-f9b3-489e-9197-c5c63e968f23', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 863, 'network_id': '8e873280-f41f-4e9c-a802-c6eb6e9e490f'}}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:57:28.691619 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-3be53e37-902b-4abb-96d1-15adcf3ea2b0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:28.783204 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-3be53e37-902b-4abb-96d1-15adcf3ea2b0 service neutron] For port be131926-c287-4b0b-a5cc-127875f9f4ac, host hv-cinder-81632, cleared binding levels {{(pid=108543) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:57:28.813281 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-3be53e37-902b-4abb-96d1-15adcf3ea2b0 service neutron] For port be131926-c287-4b0b-a5cc-127875f9f4ac, host hv-cinder-81632, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=be131926-c287-4b0b-a5cc-127875f9f4ac,segment=NetworkSegment(e33ebaf8-f9b3-489e-9197-c5c63e968f23),segment_id=e33ebaf8-f9b3-489e-9197-c5c63e968f23)] {{(pid=108543) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:57:28.831837 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-330beafc-35e5-4bfc-8dd2-7c366effa04d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1590128'] for router_interface, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:28.835642 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b9fdbc84-8fed-4f59-a438-2466db7560c8 req-5f2d3426-7955-49f5-92ae-319450429870 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:28.838008 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b9fdbc84-8fed-4f59-a438-2466db7560c8 req-5f2d3426-7955-49f5-92ae-319450429870 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=c255ff21-01f2-4710-911e-a3289a3fcc41 HTTP/1.1" status: 200 len: 943 time: 0.0751245 Nov 02 12:57:28.892032 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b9fdbc84-8fed-4f59-a438-2466db7560c8 req-726f1bc5-c477-4c1b-818a-a8c8bfc5fcd1 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0474589 Nov 02 12:57:28.918339 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-3be53e37-902b-4abb-96d1-15adcf3ea2b0 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:28.967023 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-3be53e37-902b-4abb-96d1-15adcf3ea2b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:28.971539 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-3be53e37-902b-4abb-96d1-15adcf3ea2b0 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:28.971539 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-3be53e37-902b-4abb-96d1-15adcf3ea2b0 service neutron] 10.222.0.90 "PUT /v2.0/ports/be131926-c287-4b0b-a5cc-127875f9f4ac HTTP/1.1" status: 200 len: 1093 time: 0.9983597 Nov 02 12:57:28.971539 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'c255ff21-01f2-4710-911e-a3289a3fcc41', 'tag': 'be131926-c287-4b0b-a5cc-127875f9f4ac'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:57:28.971917 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6c2c2180-0670-4d19-a53b-51652dc9d7c1" -d '{"events": [{"name": "network-changed", "server_uuid": "c255ff21-01f2-4710-911e-a3289a3fcc41", "tag": "be131926-c287-4b0b-a5cc-127875f9f4ac"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:57:29.011700 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3be53e37-902b-4abb-96d1-15adcf3ea2b0 service neutron] Pushing event updated for resources: {'Port': ['ID=be131926-c287-4b0b-a5cc-127875f9f4ac,revision_number=3']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:29.015856 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:57:28 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-0605aa7a-19d0-4149-885d-6d0e764b2119 x-openstack-request-id: req-0605aa7a-19d0-4149-885d-6d0e764b2119 {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:57:29.016391 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "c255ff21-01f2-4710-911e-a3289a3fcc41", "tag": "be131926-c287-4b0b-a5cc-127875f9f4ac", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:57:29.017252 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-0605aa7a-19d0-4149-885d-6d0e764b2119 {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:57:29.017377 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'c255ff21-01f2-4710-911e-a3289a3fcc41', 'tag': 'be131926-c287-4b0b-a5cc-127875f9f4ac', 'status': 'completed', 'code': 200} Nov 02 12:57:29.099632 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c2c2180-0670-4d19-a53b-51652dc9d7c1 req-fb852f7a-632d-4612-882e-fa80f49311a4 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:29.101121 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6c2c2180-0670-4d19-a53b-51652dc9d7c1 req-fb852f7a-632d-4612-882e-fa80f49311a4 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=577cab8b312e435c94d7b8d6c6f1929d&device_id=c255ff21-01f2-4710-911e-a3289a3fcc41 HTTP/1.1" status: 200 len: 1096 time: 0.0569808 Nov 02 12:57:29.219140 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c2c2180-0670-4d19-a53b-51652dc9d7c1 req-08315403-0b00-4597-9a92-9685cea02ea5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:29.220617 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6c2c2180-0670-4d19-a53b-51652dc9d7c1 req-08315403-0b00-4597-9a92-9685cea02ea5 service neutron] 10.222.0.90 "GET /v2.0/networks?tenant_id=577cab8b312e435c94d7b8d6c6f1929d&shared=False HTTP/1.1" status: 200 len: 913 time: 0.1073253 Nov 02 12:57:29.248482 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-226597d3-2af0-4e79-9af5-871af0c7b9c4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1590128'] for router_interface, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:29.618725 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6c2c2180-0670-4d19-a53b-51652dc9d7c1 req-879b3024-d033-4c02-9282-cf918b649555 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:29.620707 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6c2c2180-0670-4d19-a53b-51652dc9d7c1 req-879b3024-d033-4c02-9282-cf918b649555 service neutron] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.3869970 Nov 02 12:57:29.647357 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-330beafc-35e5-4bfc-8dd2-7c366effa04d admin admin] Deleting port 0201d689-2e60-4ec9-800a-0897da7fce09 {{(pid=108542) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:57:29.647701 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-330beafc-35e5-4bfc-8dd2-7c366effa04d admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:29.721413 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-d4637907-c188-4b77-9f2a-e6a034800a7b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:29.723264 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-d4637907-c188-4b77-9f2a-e6a034800a7b service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=577cab8b312e435c94d7b8d6c6f1929d&device_id=c255ff21-01f2-4710-911e-a3289a3fcc41 HTTP/1.1" status: 200 len: 1096 time: 0.0566101 Nov 02 12:57:29.782478 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-3196b69a-e297-4450-8040-02d761668aff service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.8&port_id=be131926-c287-4b0b-a5cc-127875f9f4ac HTTP/1.1" status: 200 len: 217 time: 0.0491991 Nov 02 12:57:29.791403 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [None req-330beafc-35e5-4bfc-8dd2-7c366effa04d admin admin] For port 0201d689-2e60-4ec9-800a-0897da7fce09, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=0201d689-2e60-4ec9-800a-0897da7fce09,segment=NetworkSegment(e206345e-67db-4144-84ee-50b4e5db5d75),segment_id=e206345e-67db-4144-84ee-50b4e5db5d75)] {{(pid=108542) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:57:29.791792 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-330beafc-35e5-4bfc-8dd2-7c366effa04d admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:29.810049 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-226597d3-2af0-4e79-9af5-871af0c7b9c4 admin admin] Deleting port 91fe3ff8-cdf3-4761-8b27-27e55f6f6690 {{(pid=108542) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:57:29.810410 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-226597d3-2af0-4e79-9af5-871af0c7b9c4 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:29.812410 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-330beafc-35e5-4bfc-8dd2-7c366effa04d admin admin] Calling delete_port for 0201d689-2e60-4ec9-800a-0897da7fce09 owned by network:router_interface {{(pid=108542) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:57:29.843649 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-c6f5f899-a7d6-4c02-8f5e-fd0af3cb733e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:29.845082 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-c6f5f899-a7d6-4c02-8f5e-fd0af3cb733e service neutron] 10.222.0.90 "GET /v2.0/subnets?id=c76b8d78-f8d1-4c53-8f06-2a9d4330c04a HTTP/1.1" status: 200 len: 852 time: 0.0533230 Nov 02 12:57:29.886803 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-70c14ece-8514-49db-844b-78277a80db8e service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=8e873280-f41f-4e9c-a802-c6eb6e9e490f&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 210 time: 0.0275133 Nov 02 12:57:29.968035 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [None req-226597d3-2af0-4e79-9af5-871af0c7b9c4 admin admin] For port 91fe3ff8-cdf3-4761-8b27-27e55f6f6690, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=91fe3ff8-cdf3-4761-8b27-27e55f6f6690,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108542) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:57:29.968657 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-226597d3-2af0-4e79-9af5-871af0c7b9c4 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:29.995591 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-188f3204-8e86-4f41-b2ba-4c0d3db5d44b service neutron] 10.222.0.90 "GET /v2.0/networks/8e873280-f41f-4e9c-a802-c6eb6e9e490f?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1009340 Nov 02 12:57:30.021337 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-226597d3-2af0-4e79-9af5-871af0c7b9c4 admin admin] Calling delete_port for 91fe3ff8-cdf3-4761-8b27-27e55f6f6690 owned by network:router_interface {{(pid=108542) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:57:30.149454 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a1b526c9-9c89-42af-b1d2-6129ce61c790 req-5f82b4a6-3a86-4d4b-9478-09a069e6d1ce tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:30.151138 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a1b526c9-9c89-42af-b1d2-6129ce61c790 req-5f82b4a6-3a86-4d4b-9478-09a069e6d1ce tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=c255ff21-01f2-4710-911e-a3289a3fcc41 HTTP/1.1" status: 200 len: 943 time: 0.1485856 Nov 02 12:57:30.203357 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-790f6daf-b749-4214-b569-5fc03ca70ad8 req-efba73b8-bdc8-497e-bc5d-0d31cb9e20e4 service neutron] 10.222.0.90 "GET /v2.0/networks/8e873280-f41f-4e9c-a802-c6eb6e9e490f?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1991670 Nov 02 12:57:30.255392 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a1b526c9-9c89-42af-b1d2-6129ce61c790 req-27f3d8da-b7de-47fe-a540-18567d0ea046 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0863528 Nov 02 12:57:30.345598 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-330beafc-35e5-4bfc-8dd2-7c366effa04d admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:30.375720 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-330beafc-35e5-4bfc-8dd2-7c366effa04d admin admin] Pushing event deleted for resources: {'Port': ['ID=0201d689-2e60-4ec9-800a-0897da7fce09,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:30.492647 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-226597d3-2af0-4e79-9af5-871af0c7b9c4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:30.534099 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-226597d3-2af0-4e79-9af5-871af0c7b9c4 admin admin] Pushing event deleted for resources: {'Port': ['ID=91fe3ff8-cdf3-4761-8b27-27e55f6f6690,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:30.660581 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-330beafc-35e5-4bfc-8dd2-7c366effa04d admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1649147', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1591488'] for router_interface, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:30.814095 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:30.841779 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-226597d3-2af0-4e79-9af5-871af0c7b9c4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1649147', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1591488'] for router_interface, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:31.050694 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-330beafc-35e5-4bfc-8dd2-7c366effa04d admin admin] Router 10f9b13b-6fcd-41e4-937a-5876beb694b1 has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108542) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 12:57:31.395769 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9e097dfb-5b1f-42ff-991e-cb0ceee96ae9 req-7de70ada-0fbf-4b31-b86c-37675ad187e0 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:31.397354 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9e097dfb-5b1f-42ff-991e-cb0ceee96ae9 req-7de70ada-0fbf-4b31-b86c-37675ad187e0 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=c255ff21-01f2-4710-911e-a3289a3fcc41 HTTP/1.1" status: 200 len: 943 time: 0.0668828 Nov 02 12:57:31.452173 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9e097dfb-5b1f-42ff-991e-cb0ceee96ae9 req-bf865946-2c2f-41c7-a8c7-64994a3b9bcd tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0480311 Nov 02 12:57:31.485909 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-226597d3-2af0-4e79-9af5-871af0c7b9c4 admin admin] Router 308142a4-46ba-42ef-a1f2-5df4b969cc8f has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108542) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 12:57:31.499870 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-330beafc-35e5-4bfc-8dd2-7c366effa04d admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108542) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:57:31.505790 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-330beafc-35e5-4bfc-8dd2-7c366effa04d admin admin] 10.222.0.98 "PUT /v2.0/routers/10f9b13b-6fcd-41e4-937a-5876beb694b1/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4886200 Nov 02 12:57:31.508625 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 35194) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:31.511681 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2d5d7e1-e797-4e99-9c97-c14ca87928f6 None None] Sync routers for ids ['10f9b13b-6fcd-41e4-937a-5876beb694b1'] in dv-cinder-816324-1-iscsi {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:57:31.521927 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2d5d7e1-e797-4e99-9c97-c14ca87928f6 None None] Routers {'10f9b13b-6fcd-41e4-937a-5876beb694b1'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:57:31.522729 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-e2d5d7e1-e797-4e99-9c97-c14ca87928f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:57:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['10f9b13b-6fcd-41e4-937a-5876beb694b1'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:31.610447 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-226597d3-2af0-4e79-9af5-871af0c7b9c4 admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108542) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:57:31.616380 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-226597d3-2af0-4e79-9af5-871af0c7b9c4 admin admin] 10.222.0.98 "PUT /v2.0/routers/308142a4-46ba-42ef-a1f2-5df4b969cc8f/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 3.4554169 Nov 02 12:57:31.618942 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 35196) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:31.621719 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9af6d4c6-fc7c-43aa-9d02-c39a86c76d26 None None] Sync routers for ids ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'] in dv-cinder-816324-1-iscsi {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:57:31.635265 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9af6d4c6-fc7c-43aa-9d02-c39a86c76d26 None None] Routers {'308142a4-46ba-42ef-a1f2-5df4b969cc8f'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:57:31.637971 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-9af6d4c6-fc7c-43aa-9d02-c39a86c76d26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:57:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:31.645183 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ad248a49-4659-4090-bc5f-896c71ce7eef admin admin] Publish callbacks [] for router, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:31.650890 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-e2d5d7e1-e797-4e99-9c97-c14ca87928f6 None None] Set router 10f9b13b-6fcd-41e4-937a-5876beb694b1 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:57:31.729563 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b113882c-bf5b-4e57-b0ef-398212596fa7 admin admin] Publish callbacks [] for router, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:31.767108 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ad248a49-4659-4090-bc5f-896c71ce7eef admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:31.789437 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-9af6d4c6-fc7c-43aa-9d02-c39a86c76d26 None None] Set router 308142a4-46ba-42ef-a1f2-5df4b969cc8f gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:57:31.843106 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b113882c-bf5b-4e57-b0ef-398212596fa7 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:31.887997 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-ad248a49-4659-4090-bc5f-896c71ce7eef admin admin] Deleting port 33c58686-52bf-437c-8c82-2fe79a0dde7c {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:57:31.888469 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ad248a49-4659-4090-bc5f-896c71ce7eef admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:31.971761 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-e2d5d7e1-e797-4e99-9c97-c14ca87928f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'name': 'tempest-TestShelveInstance-1902419255-router', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93'}], 'enable_snat': True}, 'gw_port_id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:17Z', 'updated_at': '2021-11-02T12:57:30Z', 'revision_number': 5, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'gw_port': {'id': '33c58686-52bf-437c-8c82-2fe79a0dde7c', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d3:b1:29', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'device_owner': 'network:router_gateway', 'standard_attr_id': 365, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.93', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:19Z', 'updated_at': '2021-11-02T12:51:28Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:31.978305 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [None req-ad248a49-4659-4090-bc5f-896c71ce7eef admin admin] For port 33c58686-52bf-437c-8c82-2fe79a0dde7c, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=33c58686-52bf-437c-8c82-2fe79a0dde7c,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:57:31.978724 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ad248a49-4659-4090-bc5f-896c71ce7eef admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:31.998117 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-ad248a49-4659-4090-bc5f-896c71ce7eef admin admin] Calling delete_port for 33c58686-52bf-437c-8c82-2fe79a0dde7c owned by network:router_gateway {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:57:31.998742 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-b113882c-bf5b-4e57-b0ef-398212596fa7 admin admin] Deleting port 516275c5-8682-4dd0-8e44-89a67ec57721 {{(pid=108542) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:57:31.999099 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b113882c-bf5b-4e57-b0ef-398212596fa7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:31.999423 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-9af6d4c6-fc7c-43aa-9d02-c39a86c76d26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'name': 'tempest-AttachVolumeShelveTestJSON-199949485-router', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207'}], 'enable_snat': True}, 'gw_port_id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:57:30Z', 'revision_number': 5, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'gw_port': {'id': '516275c5-8682-4dd0-8e44-89a67ec57721', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ed:4a:bd', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'device_owner': 'network:router_gateway', 'standard_attr_id': 60, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.207', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:49:12Z', 'updated_at': '2021-11-02T12:49:23Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:32.008100 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2d5d7e1-e797-4e99-9c97-c14ca87928f6 None None] Checking router: 10f9b13b-6fcd-41e4-937a-5876beb694b1 for host: dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:57:32.017957 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e2d5d7e1-e797-4e99-9c97-c14ca87928f6 None None] Routers {'10f9b13b-6fcd-41e4-937a-5876beb694b1'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:57:32.018818 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-e2d5d7e1-e797-4e99-9c97-c14ca87928f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:57:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['10f9b13b-6fcd-41e4-937a-5876beb694b1'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:32.032432 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9af6d4c6-fc7c-43aa-9d02-c39a86c76d26 None None] Checking router: 308142a4-46ba-42ef-a1f2-5df4b969cc8f for host: dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:57:32.042153 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9af6d4c6-fc7c-43aa-9d02-c39a86c76d26 None None] Routers {'308142a4-46ba-42ef-a1f2-5df4b969cc8f'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:57:32.042968 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-9af6d4c6-fc7c-43aa-9d02-c39a86c76d26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:57:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:32.100864 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [None req-b113882c-bf5b-4e57-b0ef-398212596fa7 admin admin] For port 516275c5-8682-4dd0-8e44-89a67ec57721, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=516275c5-8682-4dd0-8e44-89a67ec57721,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108542) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:57:32.101452 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b113882c-bf5b-4e57-b0ef-398212596fa7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:32.116295 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-b113882c-bf5b-4e57-b0ef-398212596fa7 admin admin] Calling delete_port for 516275c5-8682-4dd0-8e44-89a67ec57721 owned by network:router_gateway {{(pid=108542) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:57:32.128659 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-e2d5d7e1-e797-4e99-9c97-c14ca87928f6 None None] Set router 10f9b13b-6fcd-41e4-937a-5876beb694b1 gateway port host: None {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:57:32.199585 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-e2d5d7e1-e797-4e99-9c97-c14ca87928f6 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'name': 'tempest-TestShelveInstance-1902419255-router', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:17Z', 'updated_at': '2021-11-02T12:57:31Z', 'revision_number': 6, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'gw_port_host': None}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:32.229253 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-e2d5d7e1-e797-4e99-9c97-c14ca87928f6 None None] The sync data for ids ['10f9b13b-6fcd-41e4-937a-5876beb694b1'] in dv-cinder-816324-1-iscsi is: [{'id': '10f9b13b-6fcd-41e4-937a-5876beb694b1', 'name': 'tempest-TestShelveInstance-1902419255-router', 'tenant_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:17Z', 'updated_at': '2021-11-02T12:57:31Z', 'revision_number': 6, 'project_id': 'd3bf5c9bdd7f479aa4cbc28f9a007c81', 'gw_port_host': None}] {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:57:32.233383 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-9af6d4c6-fc7c-43aa-9d02-c39a86c76d26 None None] Set router 308142a4-46ba-42ef-a1f2-5df4b969cc8f gateway port host: None {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:57:32.296107 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-9af6d4c6-fc7c-43aa-9d02-c39a86c76d26 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'name': 'tempest-AttachVolumeShelveTestJSON-199949485-router', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:57:31Z', 'revision_number': 6, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'gw_port_host': None}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:32.323738 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9af6d4c6-fc7c-43aa-9d02-c39a86c76d26 None None] The sync data for ids ['308142a4-46ba-42ef-a1f2-5df4b969cc8f'] in dv-cinder-816324-1-iscsi is: [{'id': '308142a4-46ba-42ef-a1f2-5df4b969cc8f', 'name': 'tempest-AttachVolumeShelveTestJSON-199949485-router', 'tenant_id': 'aaddc046689441b8ab3641f2afd07c0e', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:49:10Z', 'updated_at': '2021-11-02T12:57:31Z', 'revision_number': 6, 'project_id': 'aaddc046689441b8ab3641f2afd07c0e', 'gw_port_host': None}] {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:57:32.356257 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ad248a49-4659-4090-bc5f-896c71ce7eef admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:32.380422 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ad248a49-4659-4090-bc5f-896c71ce7eef admin admin] Pushing event deleted for resources: {'Port': ['ID=33c58686-52bf-437c-8c82-2fe79a0dde7c,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:32.444833 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ad248a49-4659-4090-bc5f-896c71ce7eef admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1595046'] for router_gateway, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:32.486313 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b113882c-bf5b-4e57-b0ef-398212596fa7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:32.497997 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device be131926-c287-4b0b-a5cc-127875f9f4ac details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 12:57:32.533686 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b113882c-bf5b-4e57-b0ef-398212596fa7 admin admin] Pushing event deleted for resources: {'Port': ['ID=516275c5-8682-4dd0-8e44-89a67ec57721,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:32.554024 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ad248a49-4659-4090-bc5f-896c71ce7eef admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1593116', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-25699'] for router, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:32.556958 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ad248a49-4659-4090-bc5f-896c71ce7eef admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:32.629489 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b113882c-bf5b-4e57-b0ef-398212596fa7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1595046'] for router_gateway, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:32.636589 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port be131926-c287-4b0b-a5cc-127875f9f4ac, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=be131926-c287-4b0b-a5cc-127875f9f4ac,segment=NetworkSegment(e33ebaf8-f9b3-489e-9197-c5c63e968f23),segment_id=e33ebaf8-f9b3-489e-9197-c5c63e968f23)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:57:32.653475 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': 'be131926-c287-4b0b-a5cc-127875f9f4ac', 'network_id': '8e873280-f41f-4e9c-a802-c6eb6e9e490f', 'port_id': 'be131926-c287-4b0b-a5cc-127875f9f4ac', 'mac_address': 'fa:16:3e:fd:41:c5', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 863, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'c76b8d78-f8d1-4c53-8f06-2a9d4330c04a', 'ip_address': '172.20.0.8'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 12:57:32.675810 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22561356-d584-48ab-adb5-2cb8ceaffb79 req-feacfc7f-7805-46af-9473-d8df09d3d624 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:32.677660 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-22561356-d584-48ab-adb5-2cb8ceaffb79 req-feacfc7f-7805-46af-9473-d8df09d3d624 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=c255ff21-01f2-4710-911e-a3289a3fcc41 HTTP/1.1" status: 200 len: 943 time: 0.1141019 Nov 02 12:57:32.710829 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:32.725236 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id be131926-c287-4b0b-a5cc-127875f9f4ac {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:57:32.734192 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b113882c-bf5b-4e57-b0ef-398212596fa7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1593116', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-25699'] for router, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:32.736741 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b113882c-bf5b-4e57-b0ef-398212596fa7 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:32.738837 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-22561356-d584-48ab-adb5-2cb8ceaffb79 req-14e87328-aade-4897-8d47-c3c2f8ca944c tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0526905 Nov 02 12:57:32.739980 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ad248a49-4659-4090-bc5f-896c71ce7eef admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1593093'] for router, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:32.740762 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ad248a49-4659-4090-bc5f-896c71ce7eef admin admin] Fanout notify agent at l3_agent the message router_deleted on router 10f9b13b-6fcd-41e4-937a-5876beb694b1 {{(pid=108543) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 02 12:57:32.746850 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ad248a49-4659-4090-bc5f-896c71ce7eef admin admin] Publish callbacks [] for router, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:32.747702 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port be131926-c287-4b0b-a5cc-127875f9f4ac, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=be131926-c287-4b0b-a5cc-127875f9f4ac,segment=NetworkSegment(e33ebaf8-f9b3-489e-9197-c5c63e968f23),segment_id=e33ebaf8-f9b3-489e-9197-c5c63e968f23)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:57:32.750737 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-ad248a49-4659-4090-bc5f-896c71ce7eef admin admin] 10.222.0.98 "DELETE /v2.0/routers/10f9b13b-6fcd-41e4-937a-5876beb694b1 HTTP/1.1" status: 204 len: 168 time: 1.2407608 Nov 02 12:57:32.751330 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 35200) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:32.800529 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_v2 [None req-5daf1bf6-23e3-46de-ab0c-66aa42c23308 admin admin] Deleting subnet 9a20b259-01c2-4b3f-8f92-0797a18ff7f7 {{(pid=108543) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 02 12:57:32.803935 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-5daf1bf6-23e3-46de-ab0c-66aa42c23308 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:32.839756 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-5daf1bf6-23e3-46de-ab0c-66aa42c23308 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3308629'] for subnet, precommit_delete_associations {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:32.859775 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:32.923406 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=be131926-c287-4b0b-a5cc-127875f9f4ac,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:32.931721 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:32.932071 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:32.932503 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:32.932795 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:32.933127 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:32.933464 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:32.933784 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:32.934666 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:32.934666 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:32.935081 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:32.935160 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:32.935475 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:32.961515 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-5daf1bf6-23e3-46de-ab0c-66aa42c23308 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-933154'] for subnet, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:32.963441 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b113882c-bf5b-4e57-b0ef-398212596fa7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1593093'] for router, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:32.966520 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-b113882c-bf5b-4e57-b0ef-398212596fa7 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 308142a4-46ba-42ef-a1f2-5df4b969cc8f {{(pid=108542) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 02 12:57:32.968922 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b113882c-bf5b-4e57-b0ef-398212596fa7 admin admin] Publish callbacks [] for router, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:32.970437 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-b113882c-bf5b-4e57-b0ef-398212596fa7 admin admin] 10.222.0.98 "DELETE /v2.0/routers/308142a4-46ba-42ef-a1f2-5df4b969cc8f HTTP/1.1" status: 204 len: 168 time: 1.3503277 Nov 02 12:57:32.972818 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 35202) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:33.019858 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_v2 [None req-b79f48f0-9bd4-4412-b5b2-3b729358c523 admin admin] Deleting subnet ec48fe57-a1cd-4e7c-874f-073624f71f4b {{(pid=108542) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 02 12:57:33.029068 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b79f48f0-9bd4-4412-b5b2-3b729358c523 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:33.062485 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b79f48f0-9bd4-4412-b5b2-3b729358c523 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3344686'] for subnet, precommit_delete_associations {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:33.113079 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['be131926-c287-4b0b-a5cc-127875f9f4ac'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:57:33.169688 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b79f48f0-9bd4-4412-b5b2-3b729358c523 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-933154'] for subnet, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:33.174684 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-5daf1bf6-23e3-46de-ab0c-66aa42c23308 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-933141', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126393134', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126244844'] for subnet, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:33.202930 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5daf1bf6-23e3-46de-ab0c-66aa42c23308 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=9a20b259-01c2-4b3f-8f92-0797a18ff7f7,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:33.211372 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-5daf1bf6-23e3-46de-ab0c-66aa42c23308 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for subnet, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:33.214412 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-5daf1bf6-23e3-46de-ab0c-66aa42c23308 admin admin] 10.222.0.98 "DELETE /v2.0/subnets/9a20b259-01c2-4b3f-8f92-0797a18ff7f7 HTTP/1.1" status: 204 len: 168 time: 0.4613795 Nov 02 12:57:33.216303 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 35204) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:33.252043 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-5b849bbf-8a10-4cc7-bee3-9cc79d66d4de None None] Network adffa68a-25de-4006-9dcc-006cbedf32e3 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:57:33.308147 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-4161ed34-61a7-4342-9cea-0d19491484f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-972735'] for network, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:33.363894 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-4161ed34-61a7-4342-9cea-0d19491484f7 admin admin] Deleting port f7367a44-35be-44cc-922e-6b32f480d883 {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:57:33.364231 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-4161ed34-61a7-4342-9cea-0d19491484f7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:33.386349 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b79f48f0-9bd4-4412-b5b2-3b729358c523 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-933141', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126478215', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126185624'] for subnet, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:33.429948 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b79f48f0-9bd4-4412-b5b2-3b729358c523 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ec48fe57-a1cd-4e7c-874f-073624f71f4b,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:33.432161 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b79f48f0-9bd4-4412-b5b2-3b729358c523 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:33.438249 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:33.440177 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-a5051f51-0cd8-4221-a71b-50b50c73d59b None None] Network c468f0e1-3636-49b9-90c6-b90c643ed7d1 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:57:33.440796 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-b79f48f0-9bd4-4412-b5b2-3b729358c523 admin admin] 10.222.0.98 "DELETE /v2.0/subnets/ec48fe57-a1cd-4e7c-874f-073624f71f4b HTTP/1.1" status: 204 len: 168 time: 0.4669642 Nov 02 12:57:33.441960 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 35206) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:33.442273 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [None req-4161ed34-61a7-4342-9cea-0d19491484f7 admin admin] For port f7367a44-35be-44cc-922e-6b32f480d883, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=f7367a44-35be-44cc-922e-6b32f480d883,segment=NetworkSegment(e206345e-67db-4144-84ee-50b4e5db5d75),segment_id=e206345e-67db-4144-84ee-50b4e5db5d75)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:57:33.443012 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-4161ed34-61a7-4342-9cea-0d19491484f7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:33.458898 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-4161ed34-61a7-4342-9cea-0d19491484f7 admin admin] Calling delete_port for f7367a44-35be-44cc-922e-6b32f480d883 owned by network:dhcp {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:57:33.518248 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1062ed14-6595-4774-9aaf-99132840a65c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-972735'] for network, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:33.594194 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b2574d6b-6bcb-4080-8f6c-991737d23e02 None None] DHCP port deletion for adffa68a-25de-4006-9dcc-006cbedf32e3 request from dv-cinder-816324-1-iscsi {{(pid=108544) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 02 12:57:33.603383 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-1062ed14-6595-4774-9aaf-99132840a65c admin admin] Deleting port a19591c0-ae4e-427d-a5ad-28a0c283eec4 {{(pid=108542) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:57:33.603978 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1062ed14-6595-4774-9aaf-99132840a65c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:33.667968 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-b2574d6b-6bcb-4080-8f6c-991737d23e02 None None] Deleting port f7367a44-35be-44cc-922e-6b32f480d883 {{(pid=108544) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:57:33.668346 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-b2574d6b-6bcb-4080-8f6c-991737d23e02 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:33.688554 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-4161ed34-61a7-4342-9cea-0d19491484f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:33.706628 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2ed0663a-57d9-45c8-ac86-0982faf7d526 None None] DHCP port deletion for c468f0e1-3636-49b9-90c6-b90c643ed7d1 request from dv-cinder-816324-1-iscsi {{(pid=108544) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 02 12:57:33.732635 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [None req-1062ed14-6595-4774-9aaf-99132840a65c admin admin] For port a19591c0-ae4e-427d-a5ad-28a0c283eec4, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=a19591c0-ae4e-427d-a5ad-28a0c283eec4,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108542) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:57:33.733030 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1062ed14-6595-4774-9aaf-99132840a65c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:33.757506 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4161ed34-61a7-4342-9cea-0d19491484f7 admin admin] No DVR routers for this DVR port f7367a44-35be-44cc-922e-6b32f480d883 on host dv-cinder-816324-1-iscsi {{(pid=108543) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 12:57:33.761853 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4161ed34-61a7-4342-9cea-0d19491484f7 admin admin] Pushing event deleted for resources: {'Port': ['ID=f7367a44-35be-44cc-922e-6b32f480d883,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:33.775520 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-1062ed14-6595-4774-9aaf-99132840a65c admin admin] Calling delete_port for a19591c0-ae4e-427d-a5ad-28a0c283eec4 owned by network:dhcp {{(pid=108542) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:57:33.800078 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 0201d689-2e60-4ec9-800a-0897da7fce09 no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:57:33.844272 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: 0201d689-2e60-4ec9-800a-0897da7fce09 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:57:33.844564 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 0201d689-2e60-4ec9-800a-0897da7fce09 not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:57:33.848200 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-b2574d6b-6bcb-4080-8f6c-991737d23e02 None None] For port f7367a44-35be-44cc-922e-6b32f480d883, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=f7367a44-35be-44cc-922e-6b32f480d883,segment=NetworkSegment(e206345e-67db-4144-84ee-50b4e5db5d75),segment_id=e206345e-67db-4144-84ee-50b4e5db5d75)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:57:33.848540 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-b2574d6b-6bcb-4080-8f6c-991737d23e02 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:33.864310 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-4161ed34-61a7-4342-9cea-0d19491484f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-930985', 'neutron.services.segments.db._delete_segments_for_network-8738449897966'] for network, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:33.864977 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-b2574d6b-6bcb-4080-8f6c-991737d23e02 None None] Calling delete_port for f7367a44-35be-44cc-922e-6b32f480d883 owned by network:dhcp {{(pid=108544) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:57:33.919019 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.services.segments.db [None req-4161ed34-61a7-4342-9cea-0d19491484f7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['adffa68a-25de-4006-9dcc-006cbedf32e3']}} {{(pid=108543) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:33.921650 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.services.segments.db [None req-4161ed34-61a7-4342-9cea-0d19491484f7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e206345e-67db-4144-84ee-50b4e5db5d75') {'for_net_delete': True} {{(pid=108543) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:33.921946 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.services.segments.db [None req-4161ed34-61a7-4342-9cea-0d19491484f7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e206345e-67db-4144-84ee-50b4e5db5d75') {} {{(pid=108543) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:33.934856 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-4161ed34-61a7-4342-9cea-0d19491484f7 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738449902583', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3308610'] for segment, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:33.955774 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-236ac0b6-d76c-42c0-bd9a-f703d7a79835 req-28d9e94a-19bc-4d55-98d7-c4a08cba3c92 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:33.957261 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-236ac0b6-d76c-42c0-bd9a-f703d7a79835 req-28d9e94a-19bc-4d55-98d7-c4a08cba3c92 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=c255ff21-01f2-4710-911e-a3289a3fcc41 HTTP/1.1" status: 200 len: 944 time: 0.1064699 Nov 02 12:57:33.963630 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-4161ed34-61a7-4342-9cea-0d19491484f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:33.977280 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-4161ed34-61a7-4342-9cea-0d19491484f7 admin admin] Releasing vlan 874 on physical network physnet1 to pool {{(pid=108543) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 02 12:57:33.978312 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-4161ed34-61a7-4342-9cea-0d19491484f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126393740'] for segment, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: Traceback (most recent call last): Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: timer() Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: cb(*args, **kw) Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: return func(*args, **kwargs) Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: self._notify() Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: self.callback(batched_events) Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: event.method(event) Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: aggregate_uuid = self.p_client.list_aggregates( Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: return f(self, *a, **k) Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: return self._get(url).json() Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: return self.request(url, 'GET', **kwargs) Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: base_url = self.get_endpoint(auth, allow=allow, Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 02 12:57:33.980300 dv-cinder-816324-1-iscsi neutron-server[108543]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 02 12:57:33.994261 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-2ed0663a-57d9-45c8-ac86-0982faf7d526 None None] Deleting port a19591c0-ae4e-427d-a5ad-28a0c283eec4 {{(pid=108544) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:57:33.994782 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-2ed0663a-57d9-45c8-ac86-0982faf7d526 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:34.008381 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1062ed14-6595-4774-9aaf-99132840a65c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:34.035583 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1062ed14-6595-4774-9aaf-99132840a65c admin admin] Pushing event deleted for resources: {'Port': ['ID=a19591c0-ae4e-427d-a5ad-28a0c283eec4,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:34.040805 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [None req-1062ed14-6595-4774-9aaf-99132840a65c admin admin] No DVR routers for this DVR port a19591c0-ae4e-427d-a5ad-28a0c283eec4 on host dv-cinder-816324-1-iscsi {{(pid=108542) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 12:57:34.087181 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-236ac0b6-d76c-42c0-bd9a-f703d7a79835 req-147aa089-a24c-4e37-9f18-20ce4bd0f38e tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1202927 Nov 02 12:57:34.094258 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-b2574d6b-6bcb-4080-8f6c-991737d23e02 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678'] for port, after_delete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:34.108971 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-2ed0663a-57d9-45c8-ac86-0982faf7d526 None None] For port a19591c0-ae4e-427d-a5ad-28a0c283eec4, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=a19591c0-ae4e-427d-a5ad-28a0c283eec4,segment=NetworkSegment(b2bc3e69-86f7-4524-92d5-933aa81f8f2f),segment_id=b2bc3e69-86f7-4524-92d5-933aa81f8f2f)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:57:34.109389 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-2ed0663a-57d9-45c8-ac86-0982faf7d526 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:34.120273 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1062ed14-6595-4774-9aaf-99132840a65c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-930985', 'neutron.services.segments.db._delete_segments_for_network-8738449897966'] for network, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:34.142954 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2574d6b-6bcb-4080-8f6c-991737d23e02 None None] Pushing event deleted for resources: {'Port': ['ID=f7367a44-35be-44cc-922e-6b32f480d883,revision_number=None']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:34.145310 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b2574d6b-6bcb-4080-8f6c-991737d23e02 None None] No DVR routers for this DVR port f7367a44-35be-44cc-922e-6b32f480d883 on host dv-cinder-816324-1-iscsi {{(pid=108544) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 12:57:34.145775 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-1062ed14-6595-4774-9aaf-99132840a65c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['c468f0e1-3636-49b9-90c6-b90c643ed7d1']}} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:34.146856 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-2ed0663a-57d9-45c8-ac86-0982faf7d526 None None] Calling delete_port for a19591c0-ae4e-427d-a5ad-28a0c283eec4 owned by network:dhcp {{(pid=108544) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:57:34.151473 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-4161ed34-61a7-4342-9cea-0d19491484f7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-930976', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1594946'] for network, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:34.158030 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-1062ed14-6595-4774-9aaf-99132840a65c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b2bc3e69-86f7-4524-92d5-933aa81f8f2f') {'for_net_delete': True} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:34.158688 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-1062ed14-6595-4774-9aaf-99132840a65c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b2bc3e69-86f7-4524-92d5-933aa81f8f2f') {} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:34.161759 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-4161ed34-61a7-4342-9cea-0d19491484f7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:34.169317 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-4161ed34-61a7-4342-9cea-0d19491484f7 admin admin] 10.222.0.98 "DELETE /v2.0/networks/adffa68a-25de-4006-9dcc-006cbedf32e3 HTTP/1.1" status: 204 len: 168 time: 0.9491282 Nov 02 12:57:34.170147 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 35210) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:34.184669 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4161ed34-61a7-4342-9cea-0d19491484f7 admin admin] Pushing event deleted for resources: {'Network': ['ID=adffa68a-25de-4006-9dcc-006cbedf32e3,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:34.190529 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1062ed14-6595-4774-9aaf-99132840a65c admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738449902583', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3344697'] for segment, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:34.237010 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1062ed14-6595-4774-9aaf-99132840a65c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:34.238204 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-2ed0663a-57d9-45c8-ac86-0982faf7d526 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678'] for port, after_delete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:34.265047 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ed0663a-57d9-45c8-ac86-0982faf7d526 None None] Pushing event deleted for resources: {'Port': ['ID=a19591c0-ae4e-427d-a5ad-28a0c283eec4,revision_number=None']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:34.269789 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2ed0663a-57d9-45c8-ac86-0982faf7d526 None None] No DVR routers for this DVR port a19591c0-ae4e-427d-a5ad-28a0c283eec4 on host dv-cinder-816324-1-iscsi {{(pid=108544) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 12:57:34.342932 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-1062ed14-6595-4774-9aaf-99132840a65c admin admin] Releasing vlan 854 on physical network physnet1 to pool {{(pid=108542) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 02 12:57:34.343236 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1062ed14-6595-4774-9aaf-99132840a65c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126476581'] for segment, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: Traceback (most recent call last): Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: timer() Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: cb(*args, **kw) Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: return func(*args, **kwargs) Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: self._notify() Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: self.callback(batched_events) Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: event.method(event) Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: aggregate_uuid = self.p_client.list_aggregates( Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: return f(self, *a, **k) Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: return self._get(url).json() Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: return self.request(url, 'GET', **kwargs) Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: base_url = self.get_endpoint(auth, allow=allow, Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 02 12:57:34.344975 dv-cinder-816324-1-iscsi neutron-server[108542]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 02 12:57:34.406946 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 91fe3ff8-cdf3-4761-8b27-27e55f6f6690 no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:57:34.430726 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: 91fe3ff8-cdf3-4761-8b27-27e55f6f6690 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:57:34.431070 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 91fe3ff8-cdf3-4761-8b27-27e55f6f6690 not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:57:34.431472 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device f7367a44-35be-44cc-922e-6b32f480d883 no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:57:34.450826 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: f7367a44-35be-44cc-922e-6b32f480d883 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:57:34.451166 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device f7367a44-35be-44cc-922e-6b32f480d883 not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:57:34.451569 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device a19591c0-ae4e-427d-a5ad-28a0c283eec4 no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:57:34.471750 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: a19591c0-ae4e-427d-a5ad-28a0c283eec4 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:57:34.472086 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device a19591c0-ae4e-427d-a5ad-28a0c283eec4 not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:57:34.472486 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 516275c5-8682-4dd0-8e44-89a67ec57721 no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:57:34.490362 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1062ed14-6595-4774-9aaf-99132840a65c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-930976', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1594946'] for network, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:34.495102 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: 516275c5-8682-4dd0-8e44-89a67ec57721 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:57:34.495450 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 516275c5-8682-4dd0-8e44-89a67ec57721 not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:57:34.495978 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 33c58686-52bf-437c-8c82-2fe79a0dde7c no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:57:34.498860 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1062ed14-6595-4774-9aaf-99132840a65c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:34.504349 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-1062ed14-6595-4774-9aaf-99132840a65c admin admin] 10.222.0.98 "DELETE /v2.0/networks/c468f0e1-3636-49b9-90c6-b90c643ed7d1 HTTP/1.1" status: 204 len: 168 time: 1.0590694 Nov 02 12:57:34.518334 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: 33c58686-52bf-437c-8c82-2fe79a0dde7c {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:57:34.518862 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 33c58686-52bf-437c-8c82-2fe79a0dde7c not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:57:34.529477 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device be131926-c287-4b0b-a5cc-127875f9f4ac up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:57:34.532821 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1062ed14-6595-4774-9aaf-99132840a65c admin admin] Pushing event deleted for resources: {'Network': ['ID=c468f0e1-3636-49b9-90c6-b90c643ed7d1,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:34.626964 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a0677a90-80d7-4d56-8ad5-c87dc8d0e7ff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1590128'] for router_interface, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:34.745897 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning for port be131926-c287-4b0b-a5cc-127875f9f4ac completed by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 02 12:57:34.750067 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port be131926-c287-4b0b-a5cc-127875f9f4ac triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:57:34.750463 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:34.832713 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:34.860437 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c255ff21-01f2-4710-911e-a3289a3fcc41', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'be131926-c287-4b0b-a5cc-127875f9f4ac'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:57:34.862708 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-40827eff-370c-4628-b6fb-ce84518246fd" -d '{"events": [{"server_uuid": "c255ff21-01f2-4710-911e-a3289a3fcc41", "name": "network-vif-plugged", "status": "completed", "tag": "be131926-c287-4b0b-a5cc-127875f9f4ac"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:57:34.875715 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port be131926-c287-4b0b-a5cc-127875f9f4ac, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=be131926-c287-4b0b-a5cc-127875f9f4ac,segment=NetworkSegment(e33ebaf8-f9b3-489e-9197-c5c63e968f23),segment_id=e33ebaf8-f9b3-489e-9197-c5c63e968f23)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:57:34.877815 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-a0677a90-80d7-4d56-8ad5-c87dc8d0e7ff admin admin] Deleting port 8cecf398-cb8a-44a0-8ac5-4fb0469dd771 {{(pid=108542) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:57:34.878228 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a0677a90-80d7-4d56-8ad5-c87dc8d0e7ff admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:34.900190 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:57:34 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ac0db6cd-83d7-41e4-ba15-ca92ecfb9624 x-openstack-request-id: req-ac0db6cd-83d7-41e4-ba15-ca92ecfb9624 {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:57:34.905315 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c255ff21-01f2-4710-911e-a3289a3fcc41", "name": "network-vif-plugged", "status": "completed", "tag": "be131926-c287-4b0b-a5cc-127875f9f4ac", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:57:34.905315 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-ac0db6cd-83d7-41e4-ba15-ca92ecfb9624 {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:57:34.905315 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c255ff21-01f2-4710-911e-a3289a3fcc41', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'be131926-c287-4b0b-a5cc-127875f9f4ac', 'code': 200} Nov 02 12:57:34.945405 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 35216) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:34.963367 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:34.963595 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [None req-a0677a90-80d7-4d56-8ad5-c87dc8d0e7ff admin admin] For port 8cecf398-cb8a-44a0-8ac5-4fb0469dd771, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=8cecf398-cb8a-44a0-8ac5-4fb0469dd771,segment=NetworkSegment(b7dd916f-2223-4397-bf62-f54ca54f5493),segment_id=b7dd916f-2223-4397-bf62-f54ca54f5493)] {{(pid=108542) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:57:34.963754 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a0677a90-80d7-4d56-8ad5-c87dc8d0e7ff admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:34.979360 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-a0677a90-80d7-4d56-8ad5-c87dc8d0e7ff admin admin] Calling delete_port for 8cecf398-cb8a-44a0-8ac5-4fb0469dd771 owned by network:router_interface {{(pid=108542) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:57:34.992859 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-99d6832b-1ded-454e-9228-1c2b9fe572d2 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=aaddc046689441b8ab3641f2afd07c0e&name=default HTTP/1.1" status: 200 len: 2992 time: 0.0470631 Nov 02 12:57:34.995571 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 35218) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:35.012918 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=be131926-c287-4b0b-a5cc-127875f9f4ac,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:35.050736 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-6fb503f6-20ac-486c-9ffc-e1a77bccc63c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:35.072888 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-6fb503f6-20ac-486c-9ffc-e1a77bccc63c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:35.207066 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7f751f1f-1130-46ad-bcf5-3d3904421ba9 req-4c9c7055-842b-4a6c-b64a-19bed067df92 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:35.208537 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7f751f1f-1130-46ad-bcf5-3d3904421ba9 req-4c9c7055-842b-4a6c-b64a-19bed067df92 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=c255ff21-01f2-4710-911e-a3289a3fcc41 HTTP/1.1" status: 200 len: 945 time: 0.0507240 Nov 02 12:57:35.259377 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7f751f1f-1130-46ad-bcf5-3d3904421ba9 req-46f34fc8-cb98-4992-9404-06f4cf776240 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0442247 Nov 02 12:57:35.304334 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a0677a90-80d7-4d56-8ad5-c87dc8d0e7ff admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:35.305132 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-cd3d4936-1697-48c2-b6e3-b4f5f7f1f1b2 req-fd5f7957-ce66-462a-a658-c56b144e9255 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:35.307146 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cd3d4936-1697-48c2-b6e3-b4f5f7f1f1b2 req-fd5f7957-ce66-462a-a658-c56b144e9255 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=c255ff21-01f2-4710-911e-a3289a3fcc41 HTTP/1.1" status: 200 len: 1098 time: 0.0396733 Nov 02 12:57:35.307871 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-6fb503f6-20ac-486c-9ffc-e1a77bccc63c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:35.310409 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-6fb503f6-20ac-486c-9ffc-e1a77bccc63c admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:35.311429 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-6fb503f6-20ac-486c-9ffc-e1a77bccc63c admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/bad40fce-afd8-4ab0-8623-494bc1eab9e0 HTTP/1.1" status: 204 len: 168 time: 0.3146689 Nov 02 12:57:35.334306 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a0677a90-80d7-4d56-8ad5-c87dc8d0e7ff admin admin] Pushing event deleted for resources: {'Port': ['ID=8cecf398-cb8a-44a0-8ac5-4fb0469dd771,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:35.336599 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6fb503f6-20ac-486c-9ffc-e1a77bccc63c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=bad40fce-afd8-4ab0-8623-494bc1eab9e0,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:35.364660 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-cd3d4936-1697-48c2-b6e3-b4f5f7f1f1b2 req-2972cfa4-b3b7-4dde-9ec9-2730f3ff5e4e service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434031 Nov 02 12:57:35.518514 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a0677a90-80d7-4d56-8ad5-c87dc8d0e7ff admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1649147', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1591488'] for router_interface, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:35.743890 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-a0677a90-80d7-4d56-8ad5-c87dc8d0e7ff admin admin] Router a72e5e28-7ed6-44ee-a885-44b7d3fc15a7 has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108542) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 12:57:35.853887 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-a0677a90-80d7-4d56-8ad5-c87dc8d0e7ff admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108542) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:57:35.864182 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c6ae5da-8c6e-473b-9011-7b9191833ce4 None None] Sync routers for ids ['a72e5e28-7ed6-44ee-a885-44b7d3fc15a7'] in dv-cinder-816324-1-iscsi {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:57:35.864695 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-a0677a90-80d7-4d56-8ad5-c87dc8d0e7ff admin admin] 10.222.0.98 "PUT /v2.0/routers/a72e5e28-7ed6-44ee-a885-44b7d3fc15a7/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6927342 Nov 02 12:57:35.867695 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 35234) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:35.876025 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c6ae5da-8c6e-473b-9011-7b9191833ce4 None None] Routers {'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:57:35.876640 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-4c6ae5da-8c6e-473b-9011-7b9191833ce4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:57:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['a72e5e28-7ed6-44ee-a885-44b7d3fc15a7'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:35.994883 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-4c6ae5da-8c6e-473b-9011-7b9191833ce4 None None] Set router a72e5e28-7ed6-44ee-a885-44b7d3fc15a7 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:57:36.184426 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-4c6ae5da-8c6e-473b-9011-7b9191833ce4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7', 'name': 'tempest-TestShelveInstance-685743967-router', 'tenant_id': '8207b92ade05471e96c3fb2b69070dc9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.246'}], 'enable_snat': True}, 'gw_port_id': '22dd88eb-dc23-4b7d-a289-a316ccafbbe0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:35Z', 'updated_at': '2021-11-02T12:57:35Z', 'revision_number': 5, 'project_id': '8207b92ade05471e96c3fb2b69070dc9', 'gw_port': {'id': '22dd88eb-dc23-4b7d-a289-a316ccafbbe0', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:79:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 407, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:37Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:36.215631 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c6ae5da-8c6e-473b-9011-7b9191833ce4 None None] Checking router: a72e5e28-7ed6-44ee-a885-44b7d3fc15a7 for host: dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:57:36.225520 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c6ae5da-8c6e-473b-9011-7b9191833ce4 None None] Routers {'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:57:36.226604 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-4c6ae5da-8c6e-473b-9011-7b9191833ce4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:57:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['a72e5e28-7ed6-44ee-a885-44b7d3fc15a7'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:36.242083 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f951021e-f72e-4f05-b3ff-b03af80a294f admin admin] Publish callbacks [] for router, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:36.362095 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f951021e-f72e-4f05-b3ff-b03af80a294f admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:36.435526 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ba73f58c-342a-4709-87be-e7832a7cc1fd req-25c9ef1d-5ac5-46e3-b6a3-3fcd6d31e7ba tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:36.437082 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ba73f58c-342a-4709-87be-e7832a7cc1fd req-25c9ef1d-5ac5-46e3-b6a3-3fcd6d31e7ba tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=c255ff21-01f2-4710-911e-a3289a3fcc41 HTTP/1.1" status: 200 len: 945 time: 0.0559616 Nov 02 12:57:36.491441 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-4c6ae5da-8c6e-473b-9011-7b9191833ce4 None None] Set router a72e5e28-7ed6-44ee-a885-44b7d3fc15a7 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:57:36.509729 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ba73f58c-342a-4709-87be-e7832a7cc1fd req-b7d25a1e-ed27-4095-9f3f-c6008415bf00 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0657308 Nov 02 12:57:36.556638 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-f951021e-f72e-4f05-b3ff-b03af80a294f admin admin] Deleting port 22dd88eb-dc23-4b7d-a289-a316ccafbbe0 {{(pid=108542) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:57:36.557114 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f951021e-f72e-4f05-b3ff-b03af80a294f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:36.596889 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 35248) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:36.666700 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [None req-f951021e-f72e-4f05-b3ff-b03af80a294f admin admin] For port 22dd88eb-dc23-4b7d-a289-a316ccafbbe0, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=22dd88eb-dc23-4b7d-a289-a316ccafbbe0,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108542) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:57:36.667100 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f951021e-f72e-4f05-b3ff-b03af80a294f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:36.682226 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-f951021e-f72e-4f05-b3ff-b03af80a294f admin admin] Calling delete_port for 22dd88eb-dc23-4b7d-a289-a316ccafbbe0 owned by network:router_gateway {{(pid=108542) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:57:36.700539 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-4c6ae5da-8c6e-473b-9011-7b9191833ce4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7', 'name': 'tempest-TestShelveInstance-685743967-router', 'tenant_id': '8207b92ade05471e96c3fb2b69070dc9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.246'}], 'enable_snat': True}, 'gw_port_id': '22dd88eb-dc23-4b7d-a289-a316ccafbbe0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:35Z', 'updated_at': '2021-11-02T12:57:35Z', 'revision_number': 5, 'project_id': '8207b92ade05471e96c3fb2b69070dc9', 'gw_port': {'id': '22dd88eb-dc23-4b7d-a289-a316ccafbbe0', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:79:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 407, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:37Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:36.721165 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-2a8f51ac-b22e-4289-91ce-7a45b8fa812c admin admin] Request body: {'network': {'name': 'tempest-AttachVolumeTestJSON-1054401684-network', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:57:36.741216 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c6ae5da-8c6e-473b-9011-7b9191833ce4 None None] The sync data for ids ['a72e5e28-7ed6-44ee-a885-44b7d3fc15a7'] in dv-cinder-816324-1-iscsi is: [{'id': 'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7', 'name': 'tempest-TestShelveInstance-685743967-router', 'tenant_id': '8207b92ade05471e96c3fb2b69070dc9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.246'}], 'enable_snat': True}, 'gw_port_id': '22dd88eb-dc23-4b7d-a289-a316ccafbbe0', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:35Z', 'updated_at': '2021-11-02T12:57:35Z', 'revision_number': 5, 'project_id': '8207b92ade05471e96c3fb2b69070dc9', 'gw_port': {'id': '22dd88eb-dc23-4b7d-a289-a316ccafbbe0', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:36:79:e0', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'a72e5e28-7ed6-44ee-a885-44b7d3fc15a7', 'device_owner': 'network:router_gateway', 'standard_attr_id': 407, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.246', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:37Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}] {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:57:36.808120 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2a8f51ac-b22e-4289-91ce-7a45b8fa812c admin admin] Made reservation on behalf of 6064269d26644d27aaf12fd0ae66c0a9 for: {'network': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:57:36.810601 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-2a8f51ac-b22e-4289-91ce-7a45b8fa812c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for network, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:36.823041 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-2a8f51ac-b22e-4289-91ce-7a45b8fa812c admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:36.897792 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-2a8f51ac-b22e-4289-91ce-7a45b8fa812c admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:36.934209 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f951021e-f72e-4f05-b3ff-b03af80a294f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:36.962610 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-2a8f51ac-b22e-4289-91ce-7a45b8fa812c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:36.964558 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f951021e-f72e-4f05-b3ff-b03af80a294f admin admin] Pushing event deleted for resources: {'Port': ['ID=22dd88eb-dc23-4b7d-a289-a316ccafbbe0,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:36.990787 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-2a8f51ac-b22e-4289-91ce-7a45b8fa812c admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 871} {{(pid=108543) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 02 12:57:37.012492 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a8f51ac-b22e-4289-91ce-7a45b8fa812c admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=93817758-0ad3-4b93-9e7c-7f72bf40de98,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:37.012492 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-2a8f51ac-b22e-4289-91ce-7a45b8fa812c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:37.012492 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.db.segments_db [None req-2a8f51ac-b22e-4289-91ce-7a45b8fa812c admin admin] Added segment 0271db13-2254-4db8-b649-9b3f1a40557a of type vlan for network 4e122687-d2b4-4db2-bcc0-8820ad5e5b77 Nov 02 12:57:37.025581 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f951021e-f72e-4f05-b3ff-b03af80a294f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1595046'] for router_gateway, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:37.047102 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-2a8f51ac-b22e-4289-91ce-7a45b8fa812c admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738449409639'] for network, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:37.119114 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f951021e-f72e-4f05-b3ff-b03af80a294f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1593116', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-25699'] for router, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:37.121497 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f951021e-f72e-4f05-b3ff-b03af80a294f admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:37.173981 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-2a8f51ac-b22e-4289-91ce-7a45b8fa812c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for network, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:37.175046 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2a8f51ac-b22e-4289-91ce-7a45b8fa812c admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:37.175635 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-2a8f51ac-b22e-4289-91ce-7a45b8fa812c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:37.241627 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2a8f51ac-b22e-4289-91ce-7a45b8fa812c admin admin] Pushing event updated for resources: {'Network': ['ID=4e122687-d2b4-4db2-bcc0-8820ad5e5b77,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:37.253155 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Network 4e122687-d2b4-4db2-bcc0-8820ad5e5b77 details requested by agent ovs-agent-dv-cinder-816324-1-iscsi with host dv-cinder-816324-1-iscsi {{(pid=108544) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 02 12:57:37.280278 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f951021e-f72e-4f05-b3ff-b03af80a294f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1593093'] for router, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:37.280278 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f951021e-f72e-4f05-b3ff-b03af80a294f admin admin] Fanout notify agent at l3_agent the message router_deleted on router a72e5e28-7ed6-44ee-a885-44b7d3fc15a7 {{(pid=108542) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 02 12:57:37.282480 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f951021e-f72e-4f05-b3ff-b03af80a294f admin admin] Publish callbacks [] for router, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:37.288343 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-f951021e-f72e-4f05-b3ff-b03af80a294f admin admin] 10.222.0.98 "DELETE /v2.0/routers/a72e5e28-7ed6-44ee-a885-44b7d3fc15a7 HTTP/1.1" status: 204 len: 168 time: 1.4149504 Nov 02 12:57:37.288650 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 35252) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:37.315507 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-2a8f51ac-b22e-4289-91ce-7a45b8fa812c admin admin] 10.222.0.98 "POST /v2.0/networks HTTP/1.1" status: 201 len: 884 time: 0.7169859 Nov 02 12:57:37.319839 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 35254) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:37.326117 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-dcff6c4b-7e72-419f-aa62-f3d7fa6c7986 admin admin] Request body: {'subnet': {'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'cidr': '172.20.0.0/28', 'name': 'tempest-AttachVolumeTestJSON-1054401684-subnet', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'enable_dhcp': True, 'ip_version': 4}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:57:37.366502 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_v2 [None req-eae5d1e7-f690-42b4-ac3c-bcae89bb1c06 admin admin] Deleting subnet 981d49eb-4000-4cb3-981b-174f2c0b159a {{(pid=108542) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 02 12:57:37.369906 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-eae5d1e7-f690-42b4-ac3c-bcae89bb1c06 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:37.407122 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-eae5d1e7-f690-42b4-ac3c-bcae89bb1c06 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3344686'] for subnet, precommit_delete_associations {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:37.464043 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-dcff6c4b-7e72-419f-aa62-f3d7fa6c7986 admin admin] Made reservation on behalf of 6064269d26644d27aaf12fd0ae66c0a9 for: {'subnet': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:57:37.466500 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-dcff6c4b-7e72-419f-aa62-f3d7fa6c7986 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126244823'] for subnet, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:37.495253 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-eae5d1e7-f690-42b4-ac3c-bcae89bb1c06 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-933154'] for subnet, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:37.626546 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-eae5d1e7-f690-42b4-ac3c-bcae89bb1c06 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-933141', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126478215', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126185624'] for subnet, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:37.656235 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-eae5d1e7-f690-42b4-ac3c-bcae89bb1c06 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:37.662888 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-eae5d1e7-f690-42b4-ac3c-bcae89bb1c06 admin admin] 10.222.0.98 "DELETE /v2.0/subnets/981d49eb-4000-4cb3-981b-174f2c0b159a HTTP/1.1" status: 204 len: 168 time: 0.3711390 Nov 02 12:57:37.662888 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eae5d1e7-f690-42b4-ac3c-bcae89bb1c06 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=981d49eb-4000-4cb3-981b-174f2c0b159a,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:37.664076 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-682ac3b6-48ad-4d29-88f9-89a84ee0f59a None None] Network caeed602-a9f7-4485-9f47-7818b602d82c requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:57:37.668450 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 35258) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:37.683101 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1dd04bc5-e76d-4a05-8c49-8f75dcee6b1d req-864b9abb-515a-470a-9e82-ab4464c2bc65 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:37.688306 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1dd04bc5-e76d-4a05-8c49-8f75dcee6b1d req-864b9abb-515a-470a-9e82-ab4464c2bc65 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=c255ff21-01f2-4710-911e-a3289a3fcc41 HTTP/1.1" status: 200 len: 945 time: 0.0978637 Nov 02 12:57:37.735424 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1dd04bc5-e76d-4a05-8c49-8f75dcee6b1d req-9e670586-f509-4e08-b490-d8c29f2ce4a3 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447998 Nov 02 12:57:37.742618 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-dcff6c4b-7e72-419f-aa62-f3d7fa6c7986 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126393185', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126244837'] for subnet, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:37.745007 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-87dc0414-60b4-408d-b967-e49ca6cb6dcd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-972735'] for network, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:37.834563 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-87dc0414-60b4-408d-b967-e49ca6cb6dcd admin admin] Deleting port 57760200-5fe9-4008-b7e8-6f2b065c140b {{(pid=108542) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:57:37.835057 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-87dc0414-60b4-408d-b967-e49ca6cb6dcd admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:37.838193 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-dcff6c4b-7e72-419f-aa62-f3d7fa6c7986 admin admin] Checking segment: {'id': '0271db13-2254-4db8-b649-9b3f1a40557a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108543) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:57:37.838580 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dcff6c4b-7e72-419f-aa62-f3d7fa6c7986 admin admin] Network hostable DHCP agents. Network: 4e122687-d2b4-4db2-bcc0-8820ad5e5b77, hostable agents: ['1b947f40-f8bf-4088-a5dc-35ee29d90d78'], hosted agents: [] {{(pid=108543) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 02 12:57:37.840620 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcff6c4b-7e72-419f-aa62-f3d7fa6c7986 admin admin] Pushing event updated for resources: {'Subnet': ['ID=0c2af8c2-0033-47ba-9f80-d43799d51067,revision_number=0']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:37.914006 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [None req-87dc0414-60b4-408d-b967-e49ca6cb6dcd admin admin] For port 57760200-5fe9-4008-b7e8-6f2b065c140b, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=57760200-5fe9-4008-b7e8-6f2b065c140b,segment=NetworkSegment(b7dd916f-2223-4397-bf62-f54ca54f5493),segment_id=b7dd916f-2223-4397-bf62-f54ca54f5493)] {{(pid=108542) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:57:37.914400 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-87dc0414-60b4-408d-b967-e49ca6cb6dcd admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:37.921894 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2f750ad1-ff9f-454c-9287-5257ab119aca None None] DHCP port deletion for caeed602-a9f7-4485-9f47-7818b602d82c request from dv-cinder-816324-1-iscsi {{(pid=108544) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 02 12:57:37.928367 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-87dc0414-60b4-408d-b967-e49ca6cb6dcd admin admin] Calling delete_port for 57760200-5fe9-4008-b7e8-6f2b065c140b owned by network:dhcp {{(pid=108542) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:57:37.939789 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-dcff6c4b-7e72-419f-aa62-f3d7fa6c7986 admin admin] Network 4e122687-d2b4-4db2-bcc0-8820ad5e5b77 is scheduled to be hosted by DHCP agent 1b947f40-f8bf-4088-a5dc-35ee29d90d78 with binding_index 1 {{(pid=108543) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 02 12:57:37.972221 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-2f750ad1-ff9f-454c-9287-5257ab119aca None None] Deleting port 57760200-5fe9-4008-b7e8-6f2b065c140b {{(pid=108544) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:57:37.972711 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-2f750ad1-ff9f-454c-9287-5257ab119aca None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:38.044501 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-2f750ad1-ff9f-454c-9287-5257ab119aca None None] For port 57760200-5fe9-4008-b7e8-6f2b065c140b, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=57760200-5fe9-4008-b7e8-6f2b065c140b,segment=NetworkSegment(b7dd916f-2223-4397-bf62-f54ca54f5493),segment_id=b7dd916f-2223-4397-bf62-f54ca54f5493)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:57:38.044899 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-2f750ad1-ff9f-454c-9287-5257ab119aca None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:38.048102 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [None req-dcff6c4b-7e72-419f-aa62-f3d7fa6c7986 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816324-1-iscsi, 4e122687-d2b4-4db2-bcc0-8820ad5e5b77) {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:57:38.052876 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-dcff6c4b-7e72-419f-aa62-f3d7fa6c7986 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:38.053430 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-dcff6c4b-7e72-419f-aa62-f3d7fa6c7986 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for subnet, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:38.058580 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c6974fe8-0957-4cfb-9665-99c996820004 None None] Network 4e122687-d2b4-4db2-bcc0-8820ad5e5b77 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:57:38.063919 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-2f750ad1-ff9f-454c-9287-5257ab119aca None None] Calling delete_port for 57760200-5fe9-4008-b7e8-6f2b065c140b owned by network:dhcp {{(pid=108544) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:57:38.168154 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-87dc0414-60b4-408d-b967-e49ca6cb6dcd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:38.188951 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-dcff6c4b-7e72-419f-aa62-f3d7fa6c7986 admin admin] 10.222.0.98 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 847 time: 0.8676589 Nov 02 12:57:38.192045 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 35264) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:38.197763 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-c93c1d68-7d62-4cc1-b973-c00e78b0445e admin admin] Request body: {'router': {'name': 'tempest-AttachVolumeTestJSON-1054401684-router', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:57:38.198252 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87dc0414-60b4-408d-b967-e49ca6cb6dcd admin admin] Pushing event deleted for resources: {'Port': ['ID=57760200-5fe9-4008-b7e8-6f2b065c140b,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:38.206612 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [None req-87dc0414-60b4-408d-b967-e49ca6cb6dcd admin admin] No DVR routers for this DVR port 57760200-5fe9-4008-b7e8-6f2b065c140b on host dv-cinder-816324-1-iscsi {{(pid=108542) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 12:57:38.242857 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-2f750ad1-ff9f-454c-9287-5257ab119aca None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678'] for port, after_delete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:38.275372 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2f750ad1-ff9f-454c-9287-5257ab119aca None None] Pushing event deleted for resources: {'Port': ['ID=57760200-5fe9-4008-b7e8-6f2b065c140b,revision_number=None']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:38.282979 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-87dc0414-60b4-408d-b967-e49ca6cb6dcd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-930985', 'neutron.services.segments.db._delete_segments_for_network-8738449897966'] for network, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:38.294497 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2f750ad1-ff9f-454c-9287-5257ab119aca None None] No DVR routers for this DVR port 57760200-5fe9-4008-b7e8-6f2b065c140b on host dv-cinder-816324-1-iscsi {{(pid=108544) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 12:57:38.304785 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-31a81ff6-8965-4d08-9f54-a7fdfadbe129 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp94ac73f7-a43e-5b43-a0b7-503cbb5c76bd-4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'fixed_ips': [{'subnet_id': '0c2af8c2-0033-47ba-9f80-d43799d51067'}]}} from dv-cinder-816324-1-iscsi. {{(pid=108544) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 02 12:57:38.306266 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-31a81ff6-8965-4d08-9f54-a7fdfadbe129 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:38.313122 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-87dc0414-60b4-408d-b967-e49ca6cb6dcd admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['caeed602-a9f7-4485-9f47-7818b602d82c']}} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:38.324671 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-87dc0414-60b4-408d-b967-e49ca6cb6dcd admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'b7dd916f-2223-4397-bf62-f54ca54f5493') {'for_net_delete': True} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:38.324967 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-87dc0414-60b4-408d-b967-e49ca6cb6dcd admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'b7dd916f-2223-4397-bf62-f54ca54f5493') {} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:38.335031 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-87dc0414-60b4-408d-b967-e49ca6cb6dcd admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738449902583', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3344697'] for segment, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:38.349134 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-87dc0414-60b4-408d-b967-e49ca6cb6dcd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:38.356096 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-87dc0414-60b4-408d-b967-e49ca6cb6dcd admin admin] Releasing vlan 855 on physical network physnet1 to pool {{(pid=108542) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 02 12:57:38.357943 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-87dc0414-60b4-408d-b967-e49ca6cb6dcd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126476581'] for segment, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: Traceback (most recent call last): Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: timer() Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: cb(*args, **kw) Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: return func(*args, **kwargs) Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: self._notify() Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: self.callback(batched_events) Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: event.method(event) Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: aggregate_uuid = self.p_client.list_aggregates( Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: return f(self, *a, **k) Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: return self._get(url).json() Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: return self.request(url, 'GET', **kwargs) Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: base_url = self.get_endpoint(auth, allow=allow, Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 02 12:57:38.358526 dv-cinder-816324-1-iscsi neutron-server[108542]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 02 12:57:38.386029 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c93c1d68-7d62-4cc1-b973-c00e78b0445e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1593342', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-25677'] for router, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:38.387150 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c93c1d68-7d62-4cc1-b973-c00e78b0445e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1593154', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1595081', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1973616', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-25716'] for router, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:38.438684 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 22dd88eb-dc23-4b7d-a289-a316ccafbbe0 no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:57:38.449272 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c93c1d68-7d62-4cc1-b973-c00e78b0445e admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:38.463200 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: 22dd88eb-dc23-4b7d-a289-a316ccafbbe0 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:57:38.463541 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 22dd88eb-dc23-4b7d-a289-a316ccafbbe0 not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:57:38.464004 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 57760200-5fe9-4008-b7e8-6f2b065c140b no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:57:38.489048 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: 57760200-5fe9-4008-b7e8-6f2b065c140b {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:57:38.489383 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 57760200-5fe9-4008-b7e8-6f2b065c140b not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:57:38.489790 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 8cecf398-cb8a-44a0-8ac5-4fb0469dd771 no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:57:38.520311 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: 8cecf398-cb8a-44a0-8ac5-4fb0469dd771 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:57:38.520644 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 8cecf398-cb8a-44a0-8ac5-4fb0469dd771 not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:57:38.522467 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.db_base_plugin_common [None req-31a81ff6-8965-4d08-9f54-a7fdfadbe129 None None] Allocated IP 172.20.0.2 (4e122687-d2b4-4db2-bcc0-8820ad5e5b77/0c2af8c2-0033-47ba-9f80-d43799d51067/1c3a007d-9333-4aca-b0b1-468dc71b6768) {{(pid=108544) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:57:38.579844 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-87dc0414-60b4-408d-b967-e49ca6cb6dcd admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-930976', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1594946'] for network, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:38.591820 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-87dc0414-60b4-408d-b967-e49ca6cb6dcd admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:38.592028 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-87dc0414-60b4-408d-b967-e49ca6cb6dcd admin admin] 10.222.0.98 "DELETE /v2.0/networks/caeed602-a9f7-4485-9f47-7818b602d82c HTTP/1.1" status: 204 len: 168 time: 0.9225538 Nov 02 12:57:38.603413 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-87dc0414-60b4-408d-b967-e49ca6cb6dcd admin admin] Pushing event deleted for resources: {'Network': ['ID=caeed602-a9f7-4485-9f47-7818b602d82c,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:38.676105 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-31a81ff6-8965-4d08-9f54-a7fdfadbe129 None None] Publish callbacks [] for port, precommit_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:38.753314 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c93c1d68-7d62-4cc1-b973-c00e78b0445e admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:38.847452 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-31a81ff6-8965-4d08-9f54-a7fdfadbe129 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669'] for port, after_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:38.893446 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-31a81ff6-8965-4d08-9f54-a7fdfadbe129 None None] Network 4e122687-d2b4-4db2-bcc0-8820ad5e5b77 is already hosted by enough agents. {{(pid=108544) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:57:38.900983 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.scheduler.base_scheduler [None req-31a81ff6-8965-4d08-9f54-a7fdfadbe129 None None] Resources bound (agent type, host, resource id): {{(pid=108544) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:57:38.903488 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-31a81ff6-8965-4d08-9f54-a7fdfadbe129 None None] Received port after_create {{(pid=108544) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:57:38.911793 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31a81ff6-8965-4d08-9f54-a7fdfadbe129 None None] Pushing event updated for resources: {'Port': ['ID=1c3a007d-9333-4aca-b0b1-468dc71b6768,revision_number=1']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:38.969985 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-31a81ff6-8965-4d08-9f54-a7fdfadbe129 None None] Attempting to bind port 1c3a007d-9333-4aca-b0b1-468dc71b6768 on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:57:38.969985 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-31a81ff6-8965-4d08-9f54-a7fdfadbe129 None None] Attempting to bind port 1c3a007d-9333-4aca-b0b1-468dc71b6768 by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': '0271db13-2254-4db8-b649-9b3f1a40557a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77'}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:57:38.969985 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31a81ff6-8965-4d08-9f54-a7fdfadbe129 None None] Attempting to bind port 1c3a007d-9333-4aca-b0b1-468dc71b6768 on network 4e122687-d2b4-4db2-bcc0-8820ad5e5b77 {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:57:38.971161 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31a81ff6-8965-4d08-9f54-a7fdfadbe129 None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 57, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:57:38.971725 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31a81ff6-8965-4d08-9f54-a7fdfadbe129 None None] Checking segment: {'id': '0271db13-2254-4db8-b649-9b3f1a40557a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108544) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:57:38.972119 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-31a81ff6-8965-4d08-9f54-a7fdfadbe129 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:38.972576 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-31a81ff6-8965-4d08-9f54-a7fdfadbe129 None None] Bound using segment: {'id': '0271db13-2254-4db8-b649-9b3f1a40557a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77'} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:57:38.973043 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-31a81ff6-8965-4d08-9f54-a7fdfadbe129 None None] Bound port: 1c3a007d-9333-4aca-b0b1-468dc71b6768, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0271db13-2254-4db8-b649-9b3f1a40557a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77'}}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:57:38.973472 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-31a81ff6-8965-4d08-9f54-a7fdfadbe129 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:39.049000 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-31a81ff6-8965-4d08-9f54-a7fdfadbe129 None None] For port 1c3a007d-9333-4aca-b0b1-468dc71b6768, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108544) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:57:39.052442 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-31a81ff6-8965-4d08-9f54-a7fdfadbe129 None None] For port 1c3a007d-9333-4aca-b0b1-468dc71b6768, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=1c3a007d-9333-4aca-b0b1-468dc71b6768,segment=NetworkSegment(0271db13-2254-4db8-b649-9b3f1a40557a),segment_id=0271db13-2254-4db8-b649-9b3f1a40557a)] {{(pid=108544) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:57:39.106170 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c93c1d68-7d62-4cc1-b973-c00e78b0445e admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:39.124725 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c93c1d68-7d62-4cc1-b973-c00e78b0445e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:39.161068 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 35276) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:39.201814 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-937e4ec0-c938-4012-944f-5625929b972c admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=d3bf5c9bdd7f479aa4cbc28f9a007c81&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0394020 Nov 02 12:57:39.204273 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 35278) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:39.232568 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-31a81ff6-8965-4d08-9f54-a7fdfadbe129 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:39.265053 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-111258a9-d717-4e99-a1aa-5324fac31813 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:39.290640 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-111258a9-d717-4e99-a1aa-5324fac31813 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:39.337562 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31a81ff6-8965-4d08-9f54-a7fdfadbe129 None None] Pushing event updated for resources: {'Port': ['ID=1c3a007d-9333-4aca-b0b1-468dc71b6768,revision_number=2']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:39.532785 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-111258a9-d717-4e99-a1aa-5324fac31813 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:39.535588 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-111258a9-d717-4e99-a1aa-5324fac31813 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:39.536847 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-111258a9-d717-4e99-a1aa-5324fac31813 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/4b220cd4-bcd5-478a-84dc-4e0eaa87581b HTTP/1.1" status: 204 len: 168 time: 0.3316050 Nov 02 12:57:39.538872 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [None req-c93c1d68-7d62-4cc1-b973-c00e78b0445e admin admin] Allocated IP 172.27.0.220 (43464fa8-eb00-46fb-9ca0-be7342f9ddbf/44a807bc-f2b6-41f0-b765-e5d3393fe305/8a56dbe9-75f7-4598-a2ef-687071c1fb71) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:57:39.561411 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-111258a9-d717-4e99-a1aa-5324fac31813 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=4b220cd4-bcd5-478a-84dc-4e0eaa87581b,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:39.676042 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c93c1d68-7d62-4cc1-b973-c00e78b0445e admin admin] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:39.814453 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c93c1d68-7d62-4cc1-b973-c00e78b0445e admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:39.854314 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c93c1d68-7d62-4cc1-b973-c00e78b0445e admin admin] Network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:57:39.859283 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [None req-c93c1d68-7d62-4cc1-b973-c00e78b0445e admin admin] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:57:39.865082 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c93c1d68-7d62-4cc1-b973-c00e78b0445e admin admin] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:57:39.892467 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c93c1d68-7d62-4cc1-b973-c00e78b0445e admin admin] Pushing event updated for resources: {'Port': ['ID=8a56dbe9-75f7-4598-a2ef-687071c1fb71,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:40.235699 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-03987051-1068-4aef-a0f0-81efd51a44a5 None None] Network 4e122687-d2b4-4db2-bcc0-8820ad5e5b77 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 12:57:40.267014 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c93c1d68-7d62-4cc1-b973-c00e78b0445e admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:40.390570 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-9beb9e85-7417-433c-ab49-1e54ed32f0f3 None None] Provisioning complete for port 1c3a007d-9333-4aca-b0b1-468dc71b6768 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:57:40.391121 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-9beb9e85-7417-433c-ab49-1e54ed32f0f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:40.487452 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 1c3a007d-9333-4aca-b0b1-468dc71b6768 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:57:40.512673 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c93c1d68-7d62-4cc1-b973-c00e78b0445e admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1593163', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1595034'] for router, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:40.524303 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-9beb9e85-7417-433c-ab49-1e54ed32f0f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:40.553188 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 35286) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:40.576363 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-9beb9e85-7417-433c-ab49-1e54ed32f0f3 None None] For port 1c3a007d-9333-4aca-b0b1-468dc71b6768, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=1c3a007d-9333-4aca-b0b1-468dc71b6768,segment=NetworkSegment(0271db13-2254-4db8-b649-9b3f1a40557a),segment_id=0271db13-2254-4db8-b649-9b3f1a40557a)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:57:40.589237 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 1c3a007d-9333-4aca-b0b1-468dc71b6768 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:57:40.589237 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:40.640572 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-9beb9e85-7417-433c-ab49-1e54ed32f0f3 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:40.665932 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-1da08283-45b8-4d53-9940-467e9a4a2333 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=8207b92ade05471e96c3fb2b69070dc9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1116459 Nov 02 12:57:40.668873 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 35288) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:40.725382 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9beb9e85-7417-433c-ab49-1e54ed32f0f3 None None] Pushing event updated for resources: {'Port': ['ID=1c3a007d-9333-4aca-b0b1-468dc71b6768,revision_number=3']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:40.741512 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-dcae43f2-d57a-44e2-bca6-b06da1a7b51b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:40.763197 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-41998e8d-af62-4096-bddb-8bd3b253cf3e None None] Provisioning complete for port 1c3a007d-9333-4aca-b0b1-468dc71b6768 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:57:40.763566 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-41998e8d-af62-4096-bddb-8bd3b253cf3e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:40.777319 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-dcae43f2-d57a-44e2-bca6-b06da1a7b51b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:40.933873 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c93c1d68-7d62-4cc1-b973-c00e78b0445e admin admin] Router cf121ee7-8e7c-41c2-ad44-460321366ae3 is scheduled to L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc with binding_index 1 {{(pid=108543) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 02 12:57:40.986060 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-dcae43f2-d57a-44e2-bca6-b06da1a7b51b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:40.988654 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-dcae43f2-d57a-44e2-bca6-b06da1a7b51b admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:40.989779 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-dcae43f2-d57a-44e2-bca6-b06da1a7b51b admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/e1632635-1eba-4e80-b6e6-ee933a5008a1 HTTP/1.1" status: 204 len: 168 time: 0.3196104 Nov 02 12:57:41.005785 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-dcae43f2-d57a-44e2-bca6-b06da1a7b51b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=e1632635-1eba-4e80-b6e6-ee933a5008a1,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:41.056180 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c93c1d68-7d62-4cc1-b973-c00e78b0445e admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108543) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:57:41.065914 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] Sync routers for ids ['cf121ee7-8e7c-41c2-ad44-460321366ae3'] in dv-cinder-816324-1-iscsi {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:57:41.083040 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] Routers {'cf121ee7-8e7c-41c2-ad44-460321366ae3'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:57:41.083040 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:57:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['cf121ee7-8e7c-41c2-ad44-460321366ae3'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:41.158692 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c93c1d68-7d62-4cc1-b973-c00e78b0445e admin admin] Publish callbacks [] for router, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:41.159951 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-c93c1d68-7d62-4cc1-b973-c00e78b0445e admin admin] 10.222.0.98 "POST /v2.0/routers HTTP/1.1" status: 201 len: 923 time: 2.9666865 Nov 02 12:57:41.162754 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 35294) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:41.185789 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] Set router cf121ee7-8e7c-41c2-ad44-460321366ae3 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:57:41.370979 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'name': 'tempest-AttachVolumeTestJSON-1054401684-router', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:57:38Z', 'updated_at': '2021-11-02T12:57:40Z', 'revision_number': 3, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'gw_port': {'id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:0e:ad', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:39Z', 'updated_at': '2021-11-02T12:57:39Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:41.407435 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] Checking router: cf121ee7-8e7c-41c2-ad44-460321366ae3 for host: dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:57:41.407774 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] Updating router cf121ee7-8e7c-41c2-ad44-460321366ae3 port 8a56dbe9-75f7-4598-a2ef-687071c1fb71 binding host dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 02 12:57:41.441960 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:41.621069 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d8f59148-c6ac-4d33-80a1-8c3d958e433b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:41.721960 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] Publish callbacks [] for port, precommit_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:41.775256 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [None req-d8f59148-c6ac-4d33-80a1-8c3d958e433b admin admin] Allocated IP 172.20.0.1 (4e122687-d2b4-4db2-bcc0-8820ad5e5b77/0c2af8c2-0033-47ba-9f80-d43799d51067/29f4ed03-3784-40c8-9c15-00c1bd9d54cc) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:57:41.795531 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:41.848207 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] Attempting to bind port 8a56dbe9-75f7-4598-a2ef-687071c1fb71 on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:57:41.848562 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] Attempting to bind port 8a56dbe9-75f7-4598-a2ef-687071c1fb71 by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}] {{(pid=108545) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:57:41.848913 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] Attempting to bind port 8a56dbe9-75f7-4598-a2ef-687071c1fb71 on network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:57:41.851882 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6671a05-31b2-40f5-868f-001bcc5f6dad None None] Pushing event updated for resources: {'Port': ['ID=8a56dbe9-75f7-4598-a2ef-687071c1fb71,revision_number=2']} {{(pid=108545) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:41.859438 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 57, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:57:41.859801 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] Checking segment: {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108545) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:57:41.860193 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:41.860573 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] Bound using segment: {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'} {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:57:41.861024 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] Bound port: 8a56dbe9-75f7-4598-a2ef-687071c1fb71, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}}] {{(pid=108545) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:57:41.861418 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:41.864699 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6671a05-31b2-40f5-868f-001bcc5f6dad None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:41.874205 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6671a05-31b2-40f5-868f-001bcc5f6dad None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:41.874205 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6671a05-31b2-40f5-868f-001bcc5f6dad None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:41.874205 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6671a05-31b2-40f5-868f-001bcc5f6dad None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:41.874205 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6671a05-31b2-40f5-868f-001bcc5f6dad None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:41.874205 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6671a05-31b2-40f5-868f-001bcc5f6dad None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:41.874205 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6671a05-31b2-40f5-868f-001bcc5f6dad None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:41.874205 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6671a05-31b2-40f5-868f-001bcc5f6dad None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:41.874205 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6671a05-31b2-40f5-868f-001bcc5f6dad None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:41.874205 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6671a05-31b2-40f5-868f-001bcc5f6dad None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:41.874205 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6671a05-31b2-40f5-868f-001bcc5f6dad None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:41.874205 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-f6671a05-31b2-40f5-868f-001bcc5f6dad None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:57:41.882775 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d8f59148-c6ac-4d33-80a1-8c3d958e433b admin admin] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:41.920739 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.db [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] For port 8a56dbe9-75f7-4598-a2ef-687071c1fb71, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108545) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:57:41.923692 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.db [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] For port 8a56dbe9-75f7-4598-a2ef-687071c1fb71, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=8a56dbe9-75f7-4598-a2ef-687071c1fb71,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108545) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:57:42.014423 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d8f59148-c6ac-4d33-80a1-8c3d958e433b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:42.025930 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:42.061396 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8f59148-c6ac-4d33-80a1-8c3d958e433b admin admin] Network 4e122687-d2b4-4db2-bcc0-8820ad5e5b77 is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:57:42.064477 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [None req-d8f59148-c6ac-4d33-80a1-8c3d958e433b admin admin] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:57:42.070533 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d8f59148-c6ac-4d33-80a1-8c3d958e433b admin admin] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:57:42.074486 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8f59148-c6ac-4d33-80a1-8c3d958e433b admin admin] Pushing event updated for resources: {'Port': ['ID=29f4ed03-3784-40c8-9c15-00c1bd9d54cc,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:42.093953 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f6671a05-31b2-40f5-868f-001bcc5f6dad None None] Pushing event updated for resources: {'Port': ['ID=8a56dbe9-75f7-4598-a2ef-687071c1fb71,revision_number=3']} {{(pid=108545) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:42.097656 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] Routers {'cf121ee7-8e7c-41c2-ad44-460321366ae3'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:57:42.098264 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:57:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['cf121ee7-8e7c-41c2-ad44-460321366ae3'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:42.120756 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d8f59148-c6ac-4d33-80a1-8c3d958e433b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1590217'] for router_interface, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:42.220442 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] Set router cf121ee7-8e7c-41c2-ad44-460321366ae3 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:57:42.360718 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d8f59148-c6ac-4d33-80a1-8c3d958e433b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:42.386523 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-2628d309-8315-4ff0-b2f3-aaaa2b876a84 None None] Provisioning complete for port 29f4ed03-3784-40c8-9c15-00c1bd9d54cc triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:57:42.387090 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-2628d309-8315-4ff0-b2f3-aaaa2b876a84 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:42.417493 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'name': 'tempest-AttachVolumeTestJSON-1054401684-router', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:57:38Z', 'updated_at': '2021-11-02T12:57:40Z', 'revision_number': 3, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'gw_port': {'id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:0e:ad', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:39Z', 'updated_at': '2021-11-02T12:57:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:42.426094 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 1c3a007d-9333-4aca-b0b1-468dc71b6768 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:57:42.446167 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4c56dad9-6a68-4f16-b1ca-4574884bcd11 None None] The sync data for ids ['cf121ee7-8e7c-41c2-ad44-460321366ae3'] in dv-cinder-816324-1-iscsi is: [{'id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'name': 'tempest-AttachVolumeTestJSON-1054401684-router', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:57:38Z', 'updated_at': '2021-11-02T12:57:40Z', 'revision_number': 3, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'gw_port': {'id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:0e:ad', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:39Z', 'updated_at': '2021-11-02T12:57:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}] {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:57:42.464040 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-2628d309-8315-4ff0-b2f3-aaaa2b876a84 None None] Port 29f4ed03-3784-40c8-9c15-00c1bd9d54cc cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:57:42.498166 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 1c3a007d-9333-4aca-b0b1-468dc71b6768 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:57:42.498573 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:42.584938 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d8f59148-c6ac-4d33-80a1-8c3d958e433b admin admin] Publish callbacks [] for port, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:42.727780 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d8f59148-c6ac-4d33-80a1-8c3d958e433b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:42.803247 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d8f59148-c6ac-4d33-80a1-8c3d958e433b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1649136', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1590109'] for router_interface, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:42.805037 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d8f59148-c6ac-4d33-80a1-8c3d958e433b admin admin] Pushing event updated for resources: {'Port': ['ID=29f4ed03-3784-40c8-9c15-00c1bd9d54cc,revision_number=2']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:42.901823 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-d8f59148-c6ac-4d33-80a1-8c3d958e433b admin admin] Network 4e122687-d2b4-4db2-bcc0-8820ad5e5b77 is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:57:42.903536 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [None req-d8f59148-c6ac-4d33-80a1-8c3d958e433b admin admin] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:57:43.031193 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d8f59148-c6ac-4d33-80a1-8c3d958e433b admin admin] Router cf121ee7-8e7c-41c2-ad44-460321366ae3 has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108543) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 12:57:43.150350 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d8f59148-c6ac-4d33-80a1-8c3d958e433b admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108543) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:57:43.155733 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-d8f59148-c6ac-4d33-80a1-8c3d958e433b admin admin] 10.222.0.98 "PUT /v2.0/routers/cf121ee7-8e7c-41c2-ad44-460321366ae3/add_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9919760 Nov 02 12:57:43.194362 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-6816338f-7a44-47b4-98c3-14e910f6f545 None None] Provisioning complete for port 29f4ed03-3784-40c8-9c15-00c1bd9d54cc triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:57:43.194764 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-6816338f-7a44-47b4-98c3-14e910f6f545 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:43.235298 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-6816338f-7a44-47b4-98c3-14e910f6f545 None None] Port 29f4ed03-3784-40c8-9c15-00c1bd9d54cc cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:57:43.721861 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 35306) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:43.726555 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-80e73cc7-ad1f-4721-9c29-a20b5fb5e82e tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1185448753', 'description': 'tempest-description--2122598216'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:57:43.906409 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-80e73cc7-ad1f-4721-9c29-a20b5fb5e82e tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:43.941039 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-80e73cc7-ad1f-4721-9c29-a20b5fb5e82e tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:43.969262 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] Sync routers for ids ['cf121ee7-8e7c-41c2-ad44-460321366ae3'] in dv-cinder-816324-1-iscsi {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:57:43.983409 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] Routers {'cf121ee7-8e7c-41c2-ad44-460321366ae3'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:57:43.984166 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:57:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['cf121ee7-8e7c-41c2-ad44-460321366ae3'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:44.128440 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-80e73cc7-ad1f-4721-9c29-a20b5fb5e82e tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:44.159432 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-80e73cc7-ad1f-4721-9c29-a20b5fb5e82e tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Pushing event updated for resources: {'SecurityGroup': ['ID=feb93c53-c828-40b9-b292-5bcae1f79883,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:44.228678 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] Set router cf121ee7-8e7c-41c2-ad44-460321366ae3 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:57:44.243539 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-80e73cc7-ad1f-4721-9c29-a20b5fb5e82e tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:44.244898 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-80e73cc7-ad1f-4721-9c29-a20b5fb5e82e tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1797 time: 0.5219643 Nov 02 12:57:44.248122 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 35308) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:44.254229 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-929793f1-69b6-454f-b788-5b8323c2f184 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Request body: {'security_group_rule': {'security_group_id': 'feb93c53-c828-40b9-b292-5bcae1f79883', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:57:44.368508 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-929793f1-69b6-454f-b788-5b8323c2f184 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:44.437611 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-929793f1-69b6-454f-b788-5b8323c2f184 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:44.445450 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'name': 'tempest-AttachVolumeTestJSON-1054401684-router', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:57:38Z', 'updated_at': '2021-11-02T12:57:42Z', 'revision_number': 4, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'gw_port': {'id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:0e:ad', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:39Z', 'updated_at': '2021-11-02T12:57:41Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '29f4ed03-3784-40c8-9c15-00c1bd9d54cc', 'name': '', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'mac_address': 'fa:16:3e:db:98:04', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 597, 'fixed_ips': [{'subnet_id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:41Z', 'updated_at': '2021-11-02T12:57:42Z', 'revision_number': 2, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'subnets': [{'id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:44.468351 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 8a56dbe9-75f7-4598-a2ef-687071c1fb71 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:57:44.476055 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] Checking router: cf121ee7-8e7c-41c2-ad44-460321366ae3 for host: dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:57:44.476055 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] Updating router cf121ee7-8e7c-41c2-ad44-460321366ae3 port 29f4ed03-3784-40c8-9c15-00c1bd9d54cc binding host dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 02 12:57:44.525020 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:44.539799 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-929793f1-69b6-454f-b788-5b8323c2f184 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:44.558803 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-929793f1-69b6-454f-b788-5b8323c2f184 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=d69ce716-bfdf-46a3-abd3-8b56ac4d4e66,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:44.586512 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 8a56dbe9-75f7-4598-a2ef-687071c1fb71 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:57:44.587397 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:44.644598 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-929793f1-69b6-454f-b788-5b8323c2f184 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:44.645944 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-929793f1-69b6-454f-b788-5b8323c2f184 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3968306 Nov 02 12:57:44.650040 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 35312) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:44.655041 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-28e253c4-5349-4110-9a7b-dcdef4f99e7d tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Request body: {'security_group_rule': {'security_group_id': 'feb93c53-c828-40b9-b292-5bcae1f79883', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:57:44.745202 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-28e253c4-5349-4110-9a7b-dcdef4f99e7d tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:44.789794 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:44.813025 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-28e253c4-5349-4110-9a7b-dcdef4f99e7d tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:44.822149 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] For port 8a56dbe9-75f7-4598-a2ef-687071c1fb71, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=8a56dbe9-75f7-4598-a2ef-687071c1fb71,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:57:44.876256 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] Publish callbacks [] for port, precommit_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:44.905558 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-28e253c4-5349-4110-9a7b-dcdef4f99e7d tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:44.925252 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-28e253c4-5349-4110-9a7b-dcdef4f99e7d tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=34f1bbf5-0cc7-47ac-9b31-bbafb4f1d53c,revision_number=0']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:44.944849 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:44.993475 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Pushing event updated for resources: {'Port': ['ID=8a56dbe9-75f7-4598-a2ef-687071c1fb71,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:45.019336 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:45.072890 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-28e253c4-5349-4110-9a7b-dcdef4f99e7d tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:45.074116 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-28e253c4-5349-4110-9a7b-dcdef4f99e7d tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.4230115 Nov 02 12:57:45.077026 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32d9cd89-0da6-4518-8622-e0efef05ed77 None None] Pushing event updated for resources: {'Port': ['ID=29f4ed03-3784-40c8-9c15-00c1bd9d54cc,revision_number=3']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:45.077921 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 35314) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:57:45.083216 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-a88a6695-412e-4ca8-85ba-497bf91a4507 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Request body: {'floatingip': {'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:57:45.129425 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] Attempting to bind port 29f4ed03-3784-40c8-9c15-00c1bd9d54cc on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:57:45.129803 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] Attempting to bind port 29f4ed03-3784-40c8-9c15-00c1bd9d54cc by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': '0271db13-2254-4db8-b649-9b3f1a40557a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77'}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:57:45.130298 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] Attempting to bind port 29f4ed03-3784-40c8-9c15-00c1bd9d54cc on network 4e122687-d2b4-4db2-bcc0-8820ad5e5b77 {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:57:45.136321 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 57, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:57:45.136695 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] Checking segment: {'id': '0271db13-2254-4db8-b649-9b3f1a40557a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108544) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:57:45.137095 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:45.137487 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] Bound using segment: {'id': '0271db13-2254-4db8-b649-9b3f1a40557a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77'} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:57:45.137961 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] Bound port: 29f4ed03-3784-40c8-9c15-00c1bd9d54cc, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '0271db13-2254-4db8-b649-9b3f1a40557a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77'}}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:57:45.138430 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:45.185248 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-a88a6695-412e-4ca8-85ba-497bf91a4507 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for floatingip, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:45.207207 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] For port 29f4ed03-3784-40c8-9c15-00c1bd9d54cc, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108544) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:57:45.211780 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] For port 29f4ed03-3784-40c8-9c15-00c1bd9d54cc, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=29f4ed03-3784-40c8-9c15-00c1bd9d54cc,segment=NetworkSegment(0271db13-2254-4db8-b649-9b3f1a40557a),segment_id=0271db13-2254-4db8-b649-9b3f1a40557a)] {{(pid=108544) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:57:45.266744 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-2bcfdd9f-837e-4e56-9fca-d4c8f656415e None None] Provisioning complete for port 29f4ed03-3784-40c8-9c15-00c1bd9d54cc triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:57:45.267022 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-2bcfdd9f-837e-4e56-9fca-d4c8f656415e None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:45.289282 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-a88a6695-412e-4ca8-85ba-497bf91a4507 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:45.304546 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-2bcfdd9f-837e-4e56-9fca-d4c8f656415e None None] Port 29f4ed03-3784-40c8-9c15-00c1bd9d54cc cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:57:45.324376 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:45.383627 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] Routers {'cf121ee7-8e7c-41c2-ad44-460321366ae3'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:57:45.384284 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 6, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 6, "log_agent_heartbeats": false, "routers": 6},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:57:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['cf121ee7-8e7c-41c2-ad44-460321366ae3'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:45.386530 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-32d9cd89-0da6-4518-8622-e0efef05ed77 None None] Pushing event updated for resources: {'Port': ['ID=29f4ed03-3784-40c8-9c15-00c1bd9d54cc,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:45.411383 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [None req-a88a6695-412e-4ca8-85ba-497bf91a4507 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Allocated IP 172.27.0.22 (43464fa8-eb00-46fb-9ca0-be7342f9ddbf/44a807bc-f2b6-41f0-b765-e5d3393fe305/51d9b5ad-9f20-4815-892b-b44055629750) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:57:45.527839 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] Set router cf121ee7-8e7c-41c2-ad44-460321366ae3 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:57:45.545754 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-a88a6695-412e-4ca8-85ba-497bf91a4507 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:45.700028 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-a88a6695-412e-4ca8-85ba-497bf91a4507 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:45.740365 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-a88a6695-412e-4ca8-85ba-497bf91a4507 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:57:45.741536 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-f852b7a7-269f-4136-9ec9-275db4697bb0 None None] Provisioning complete for port 29f4ed03-3784-40c8-9c15-00c1bd9d54cc triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:57:45.741888 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-f852b7a7-269f-4136-9ec9-275db4697bb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:45.748651 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [None req-a88a6695-412e-4ca8-85ba-497bf91a4507 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:57:45.753160 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [None req-a88a6695-412e-4ca8-85ba-497bf91a4507 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:57:45.756439 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a88a6695-412e-4ca8-85ba-497bf91a4507 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Pushing event updated for resources: {'Port': ['ID=51d9b5ad-9f20-4815-892b-b44055629750,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:45.801388 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'name': 'tempest-AttachVolumeTestJSON-1054401684-router', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:57:38Z', 'updated_at': '2021-11-02T12:57:42Z', 'revision_number': 4, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'gw_port': {'id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:0e:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:39Z', 'updated_at': '2021-11-02T12:57:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '29f4ed03-3784-40c8-9c15-00c1bd9d54cc', 'name': '', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'mac_address': 'fa:16:3e:db:98:04', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 597, 'fixed_ips': [{'subnet_id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:41Z', 'updated_at': '2021-11-02T12:57:45Z', 'revision_number': 4, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'subnets': [{'id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:57:45.832867 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d3b44eac-5d30-4907-a725-b6aa856dcbe9 None None] The sync data for ids ['cf121ee7-8e7c-41c2-ad44-460321366ae3'] in dv-cinder-816324-1-iscsi is: [{'id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'name': 'tempest-AttachVolumeTestJSON-1054401684-router', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:57:38Z', 'updated_at': '2021-11-02T12:57:42Z', 'revision_number': 4, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'gw_port': {'id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:0e:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:39Z', 'updated_at': '2021-11-02T12:57:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '29f4ed03-3784-40c8-9c15-00c1bd9d54cc', 'name': '', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'mac_address': 'fa:16:3e:db:98:04', 'admin_state_up': True, 'status': 'DOWN', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 597, 'fixed_ips': [{'subnet_id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:41Z', 'updated_at': '2021-11-02T12:57:45Z', 'revision_number': 4, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'subnets': [{'id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:57:45.861128 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-a88a6695-412e-4ca8-85ba-497bf91a4507 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:45.872914 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-f852b7a7-269f-4136-9ec9-275db4697bb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:45.918241 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-f852b7a7-269f-4136-9ec9-275db4697bb0 None None] For port 29f4ed03-3784-40c8-9c15-00c1bd9d54cc, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=29f4ed03-3784-40c8-9c15-00c1bd9d54cc,segment=NetworkSegment(0271db13-2254-4db8-b649-9b3f1a40557a),segment_id=0271db13-2254-4db8-b649-9b3f1a40557a)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:57:45.989145 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-a88a6695-412e-4ca8-85ba-497bf91a4507 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:46.109836 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-f852b7a7-269f-4136-9ec9-275db4697bb0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:46.161425 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-a88a6695-412e-4ca8-85ba-497bf91a4507 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for port, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:46.179353 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f852b7a7-269f-4136-9ec9-275db4697bb0 None None] Pushing event updated for resources: {'Port': ['ID=29f4ed03-3784-40c8-9c15-00c1bd9d54cc,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:46.271116 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-a88a6695-412e-4ca8-85ba-497bf91a4507 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:46.340710 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a88a6695-412e-4ca8-85ba-497bf91a4507 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Pushing event updated for resources: {'Port': ['ID=51d9b5ad-9f20-4815-892b-b44055629750,revision_number=2']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:46.355326 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-a88a6695-412e-4ca8-85ba-497bf91a4507 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1594992'] for floatingip, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:46.457869 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-a88a6695-412e-4ca8-85ba-497bf91a4507 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for floatingip, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:46.463110 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-a88a6695-412e-4ca8-85ba-497bf91a4507 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 692 time: 1.3805790 Nov 02 12:57:46.573930 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 8a56dbe9-75f7-4598-a2ef-687071c1fb71 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:57:46.684224 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 8a56dbe9-75f7-4598-a2ef-687071c1fb71 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:57:46.684729 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:46.699196 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b308dc36-0c8d-489a-834e-b29513125c40 req-b70f9041-4fb3-428d-a910-6e5e9c8ed222 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?name=tempest-securitygroup--1185448753&fields=id&tenant_id=6064269d26644d27aaf12fd0ae66c0a9 HTTP/1.1" status: 200 len: 267 time: 0.0826075 Nov 02 12:57:46.793780 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 29f4ed03-3784-40c8-9c15-00c1bd9d54cc up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:57:46.834065 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b308dc36-0c8d-489a-834e-b29513125c40 req-5e86ea14-997e-4815-a5cf-943dc109f048 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:46.835639 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b308dc36-0c8d-489a-834e-b29513125c40 req-5e86ea14-997e-4815-a5cf-943dc109f048 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/networks?id=4e122687-d2b4-4db2-bcc0-8820ad5e5b77 HTTP/1.1" status: 200 len: 811 time: 0.1340971 Nov 02 12:57:46.846266 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 29f4ed03-3784-40c8-9c15-00c1bd9d54cc triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:57:46.846700 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:46.850844 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b308dc36-0c8d-489a-834e-b29513125c40 req-060743d7-5672-446b-876a-7aa010d24048 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/quotas/6064269d26644d27aaf12fd0ae66c0a9 HTTP/1.1" status: 200 len: 375 time: 0.0094228 Nov 02 12:57:46.915797 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b308dc36-0c8d-489a-834e-b29513125c40 req-b3c15335-0725-436f-9465-f8721720772f tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?tenant_id=6064269d26644d27aaf12fd0ae66c0a9&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0572793 Nov 02 12:57:47.302108 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b308dc36-0c8d-489a-834e-b29513125c40 req-d42a37c6-5b96-450a-a533-8f0c624a8dff service neutron] 10.222.0.98 "GET /v2.0/networks/4e122687-d2b4-4db2-bcc0-8820ad5e5b77?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.3658366 Nov 02 12:57:47.391671 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b308dc36-0c8d-489a-834e-b29513125c40 req-8825aafd-9a25-421a-9984-98143bba211d service neutron] 10.222.0.98 "GET /v2.0/networks/4e122687-d2b4-4db2-bcc0-8820ad5e5b77?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0832434 Nov 02 12:57:47.653708 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7e545853-d98b-456f-8139-22829c4600ff req-e8414d24-db9d-4277-97f6-0b0db93d8fa0 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 210 time: 0.0366948 Nov 02 12:57:48.732756 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8dc3223e-fa55-465b-a08b-403cd82eb1a6 req-70b53607-f0f5-49e7-b352-60ebd099f8b4 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 210 time: 0.0272820 Nov 02 12:57:49.827841 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0a60e4d9-cdb1-48ab-b44a-5786e118d016 req-c53869d2-f208-4a7a-9c1c-b892c90f964b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 210 time: 0.0263138 Nov 02 12:57:50.922946 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-58390417-62b3-4643-aadc-232cdddd3931 req-8b77463c-9e34-428a-a0c4-ee2580823f64 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 210 time: 0.0275598 Nov 02 12:57:51.597516 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b308dc36-0c8d-489a-834e-b29513125c40 req-65b02f22-6c52-4168-91d5-2662f5d29d13 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:51.599010 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b308dc36-0c8d-489a-834e-b29513125c40 req-65b02f22-6c52-4168-91d5-2662f5d29d13 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.90 "GET /v2.0/networks?id=4e122687-d2b4-4db2-bcc0-8820ad5e5b77 HTTP/1.1" status: 200 len: 811 time: 0.1120102 Nov 02 12:57:51.666296 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b308dc36-0c8d-489a-834e-b29513125c40 req-d19481fd-8146-4acf-adae-25138a6e9ed9 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.90 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6064269d26644d27aaf12fd0ae66c0a9 HTTP/1.1" status: 200 len: 380 time: 0.0560601 Nov 02 12:57:51.676442 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-b308dc36-0c8d-489a-834e-b29513125c40 req-12f925a1-d077-4983-93fd-60024402255a tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Request body: {'port': {'device_id': 'ae55bfa7-4aee-4816-acad-b828d2c6eb9c', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'admin_state_up': True, 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'security_groups': ['feb93c53-c828-40b9-b292-5bcae1f79883']}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:57:51.904171 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-b308dc36-0c8d-489a-834e-b29513125c40 req-12f925a1-d077-4983-93fd-60024402255a tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Made reservation on behalf of 6064269d26644d27aaf12fd0ae66c0a9 for: {'port': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:57:51.908170 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b308dc36-0c8d-489a-834e-b29513125c40 req-12f925a1-d077-4983-93fd-60024402255a tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:52.043881 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-500115d4-7153-491c-be77-4c824a7a2cb1 req-26eca053-d8a4-49e5-823a-6a00b768e763 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 210 time: 0.0480728 Nov 02 12:57:52.064125 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [req-b308dc36-0c8d-489a-834e-b29513125c40 req-12f925a1-d077-4983-93fd-60024402255a tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Allocated IP 172.20.0.10 (4e122687-d2b4-4db2-bcc0-8820ad5e5b77/0c2af8c2-0033-47ba-9f80-d43799d51067/8001df2f-618b-4944-8995-ce83bb50997a) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:57:52.215258 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b308dc36-0c8d-489a-834e-b29513125c40 req-12f925a1-d077-4983-93fd-60024402255a tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:52.368412 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b308dc36-0c8d-489a-834e-b29513125c40 req-12f925a1-d077-4983-93fd-60024402255a tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:52.413017 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-b308dc36-0c8d-489a-834e-b29513125c40 req-12f925a1-d077-4983-93fd-60024402255a tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Network 4e122687-d2b4-4db2-bcc0-8820ad5e5b77 is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:57:52.418946 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [req-b308dc36-0c8d-489a-834e-b29513125c40 req-12f925a1-d077-4983-93fd-60024402255a tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:57:52.422735 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-b308dc36-0c8d-489a-834e-b29513125c40 req-12f925a1-d077-4983-93fd-60024402255a tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:57:52.429160 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-12f925a1-d077-4983-93fd-60024402255a tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Pushing event updated for resources: {'Port': ['ID=8001df2f-618b-4944-8995-ce83bb50997a,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:52.482513 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b308dc36-0c8d-489a-834e-b29513125c40 req-12f925a1-d077-4983-93fd-60024402255a tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:52.483160 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b308dc36-0c8d-489a-834e-b29513125c40 req-12f925a1-d077-4983-93fd-60024402255a tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:52.587800 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b308dc36-0c8d-489a-834e-b29513125c40 req-12f925a1-d077-4983-93fd-60024402255a tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.9151578 Nov 02 12:57:52.676736 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-2f79ca44-c873-481b-9c85-35a3b3468265 None None] Provisioning complete for port 8001df2f-618b-4944-8995-ce83bb50997a triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:57:52.677358 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-2f79ca44-c873-481b-9c85-35a3b3468265 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:52.713986 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-2f79ca44-c873-481b-9c85-35a3b3468265 None None] Port 8001df2f-618b-4944-8995-ce83bb50997a cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:57:53.161539 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1f0c8c74-60da-488e-851f-905c6a39a73a req-e9b0f1dc-82fb-4aec-8179-d0be057425d8 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:53.163097 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1f0c8c74-60da-488e-851f-905c6a39a73a req-e9b0f1dc-82fb-4aec-8179-d0be057425d8 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 932 time: 0.0503576 Nov 02 12:57:53.212034 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1f0c8c74-60da-488e-851f-905c6a39a73a req-f27f83e7-9f74-4873-be46-6d6b6ef3fb5d tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0427554 Nov 02 12:57:53.516143 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c2473e5c-acbe-4554-b544-8379d7a8aab6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:54.326117 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c448f4c-c980-4f9a-bace-eb34c528461e req-cb9e10d9-121d-4ab3-9668-5e2bfc849ddf tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:54.327664 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0c448f4c-c980-4f9a-bace-eb34c528461e req-cb9e10d9-121d-4ab3-9668-5e2bfc849ddf tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 932 time: 0.0494361 Nov 02 12:57:54.374957 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0c448f4c-c980-4f9a-bace-eb34c528461e req-fb319bc5-27ca-4f75-b3dd-561657d84c2e tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413294 Nov 02 12:57:54.952338 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-b308dc36-0c8d-489a-834e-b29513125c40 req-d1f5afe2-e659-4ebc-ac21-db1804986447 service neutron] Request body: {'port': {'device_id': 'ae55bfa7-4aee-4816-acad-b828d2c6eb9c', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81632'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:57:55.010029 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b308dc36-0c8d-489a-834e-b29513125c40 req-d1f5afe2-e659-4ebc-ac21-db1804986447 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:55.274267 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [req-b308dc36-0c8d-489a-834e-b29513125c40 req-d1f5afe2-e659-4ebc-ac21-db1804986447 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 8001df2f-618b-4944-8995-ce83bb50997a {{(pid=108543) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:57:55.281852 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b308dc36-0c8d-489a-834e-b29513125c40 req-d1f5afe2-e659-4ebc-ac21-db1804986447 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:55.294042 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.provisioning_blocks [req-b308dc36-0c8d-489a-834e-b29513125c40 req-d1f5afe2-e659-4ebc-ac21-db1804986447 service neutron] Transition to ACTIVE for port object 8001df2f-618b-4944-8995-ce83bb50997a will not be triggered until provisioned by entity L2. {{(pid=108543) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 02 12:57:55.407732 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b308dc36-0c8d-489a-834e-b29513125c40 req-d1f5afe2-e659-4ebc-ac21-db1804986447 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:55.514988 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1f5afe2-e659-4ebc-ac21-db1804986447 service neutron] Pushing event updated for resources: {'Port': ['ID=8001df2f-618b-4944-8995-ce83bb50997a,revision_number=2']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:55.573225 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-bb86297e-fdce-4fd5-99f5-1f164a4b0246 req-723b285f-8c32-474b-96cb-562d20f053f1 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:55.576190 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bb86297e-fdce-4fd5-99f5-1f164a4b0246 req-723b285f-8c32-474b-96cb-562d20f053f1 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 944 time: 0.1293013 Nov 02 12:57:55.607708 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-b308dc36-0c8d-489a-834e-b29513125c40 req-d1f5afe2-e659-4ebc-ac21-db1804986447 service neutron] Attempting to bind port 8001df2f-618b-4944-8995-ce83bb50997a on host hv-cinder-81632 for vnic_type normal with profile {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:57:55.608046 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-b308dc36-0c8d-489a-834e-b29513125c40 req-d1f5afe2-e659-4ebc-ac21-db1804986447 service neutron] Attempting to bind port 8001df2f-618b-4944-8995-ce83bb50997a by drivers openvswitch,hyperv on host hv-cinder-81632 at level 0 using segments [{'id': '0271db13-2254-4db8-b649-9b3f1a40557a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77'}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:57:55.644397 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b308dc36-0c8d-489a-834e-b29513125c40 req-d1f5afe2-e659-4ebc-ac21-db1804986447 service neutron] Attempting to bind port 8001df2f-618b-4944-8995-ce83bb50997a on network 4e122687-d2b4-4db2-bcc0-8820ad5e5b77 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:57:55.644397 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b308dc36-0c8d-489a-834e-b29513125c40 req-d1f5afe2-e659-4ebc-ac21-db1804986447 service neutron] Port 8001df2f-618b-4944-8995-ce83bb50997a on network 4e122687-d2b4-4db2-bcc0-8820ad5e5b77 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81632 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 02 12:57:55.644397 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b308dc36-0c8d-489a-834e-b29513125c40 req-d1f5afe2-e659-4ebc-ac21-db1804986447 service neutron] Attempting to bind port 8001df2f-618b-4944-8995-ce83bb50997a on network 4e122687-d2b4-4db2-bcc0-8820ad5e5b77 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:57:55.644397 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b308dc36-0c8d-489a-834e-b29513125c40 req-d1f5afe2-e659-4ebc-ac21-db1804986447 service neutron] Checking agent: {'id': '0d57fa42-4660-4f08-b7dc-53a872c3c01c', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81632', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'started_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 57, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:57:55.644397 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b308dc36-0c8d-489a-834e-b29513125c40 req-d1f5afe2-e659-4ebc-ac21-db1804986447 service neutron] Checking segment: {'id': '0271db13-2254-4db8-b649-9b3f1a40557a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108543) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:57:55.644397 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-b308dc36-0c8d-489a-834e-b29513125c40 req-d1f5afe2-e659-4ebc-ac21-db1804986447 service neutron] Bound using segment: {'id': '0271db13-2254-4db8-b649-9b3f1a40557a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77'} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:57:55.644397 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-b308dc36-0c8d-489a-834e-b29513125c40 req-d1f5afe2-e659-4ebc-ac21-db1804986447 service neutron] Bound port: 8001df2f-618b-4944-8995-ce83bb50997a, host: hv-cinder-81632, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0271db13-2254-4db8-b649-9b3f1a40557a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77'}}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:57:55.644397 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b308dc36-0c8d-489a-834e-b29513125c40 req-d1f5afe2-e659-4ebc-ac21-db1804986447 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:55.661189 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-bb86297e-fdce-4fd5-99f5-1f164a4b0246 req-8b090464-bab7-44ee-87ef-1241abf31cb7 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0780160 Nov 02 12:57:55.704703 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-a199311e-0c7c-4e3a-9040-67f2f0c8227c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:55.716848 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-b308dc36-0c8d-489a-834e-b29513125c40 req-d1f5afe2-e659-4ebc-ac21-db1804986447 service neutron] For port 8001df2f-618b-4944-8995-ce83bb50997a, host hv-cinder-81632, cleared binding levels {{(pid=108543) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:57:55.719738 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-b308dc36-0c8d-489a-834e-b29513125c40 req-d1f5afe2-e659-4ebc-ac21-db1804986447 service neutron] For port 8001df2f-618b-4944-8995-ce83bb50997a, host hv-cinder-81632, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=8001df2f-618b-4944-8995-ce83bb50997a,segment=NetworkSegment(0271db13-2254-4db8-b649-9b3f1a40557a),segment_id=0271db13-2254-4db8-b649-9b3f1a40557a)] {{(pid=108543) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:57:55.848332 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b308dc36-0c8d-489a-834e-b29513125c40 req-d1f5afe2-e659-4ebc-ac21-db1804986447 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:55.884873 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b308dc36-0c8d-489a-834e-b29513125c40 req-d1f5afe2-e659-4ebc-ac21-db1804986447 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:55.885495 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b308dc36-0c8d-489a-834e-b29513125c40 req-d1f5afe2-e659-4ebc-ac21-db1804986447 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:55.886968 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b308dc36-0c8d-489a-834e-b29513125c40 req-d1f5afe2-e659-4ebc-ac21-db1804986447 service neutron] 10.222.0.90 "PUT /v2.0/ports/8001df2f-618b-4944-8995-ce83bb50997a HTTP/1.1" status: 200 len: 1094 time: 0.9392068 Nov 02 12:57:55.888828 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ae55bfa7-4aee-4816-acad-b828d2c6eb9c', 'tag': '8001df2f-618b-4944-8995-ce83bb50997a'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:57:55.889657 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2d14e964-22a0-449c-8cca-071b0417f8fd" -d '{"events": [{"name": "network-changed", "server_uuid": "ae55bfa7-4aee-4816-acad-b828d2c6eb9c", "tag": "8001df2f-618b-4944-8995-ce83bb50997a"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:57:55.914076 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d1f5afe2-e659-4ebc-ac21-db1804986447 service neutron] Pushing event updated for resources: {'Port': ['ID=8001df2f-618b-4944-8995-ce83bb50997a,revision_number=3']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:55.946518 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:57:55 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bc1816b8-c2c8-4a89-b1f8-7e8e22245dce x-openstack-request-id: req-bc1816b8-c2c8-4a89-b1f8-7e8e22245dce {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:57:55.946918 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ae55bfa7-4aee-4816-acad-b828d2c6eb9c", "tag": "8001df2f-618b-4944-8995-ce83bb50997a", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:57:55.947243 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-bc1816b8-c2c8-4a89-b1f8-7e8e22245dce {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:57:55.947710 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ae55bfa7-4aee-4816-acad-b828d2c6eb9c', 'tag': '8001df2f-618b-4944-8995-ce83bb50997a', 'status': 'completed', 'code': 200} Nov 02 12:57:56.016587 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d14e964-22a0-449c-8cca-071b0417f8fd req-9c9a0ba5-10b6-48bd-a5f8-b9e2b83e9d15 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:56.018181 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2d14e964-22a0-449c-8cca-071b0417f8fd req-9c9a0ba5-10b6-48bd-a5f8-b9e2b83e9d15 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=6064269d26644d27aaf12fd0ae66c0a9&device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 1097 time: 0.0478873 Nov 02 12:57:56.129384 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d14e964-22a0-449c-8cca-071b0417f8fd req-408942ec-b23f-47ee-bbc1-a09ab2490193 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:56.136985 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2d14e964-22a0-449c-8cca-071b0417f8fd req-408942ec-b23f-47ee-bbc1-a09ab2490193 service neutron] 10.222.0.90 "GET /v2.0/networks?tenant_id=6064269d26644d27aaf12fd0ae66c0a9&shared=False HTTP/1.1" status: 200 len: 912 time: 0.1039824 Nov 02 12:57:56.230798 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2d14e964-22a0-449c-8cca-071b0417f8fd req-cbb2d928-ea19-40af-9e16-1cf23bd5b280 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:56.232266 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2d14e964-22a0-449c-8cca-071b0417f8fd req-cbb2d928-ea19-40af-9e16-1cf23bd5b280 service neutron] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.0937068 Nov 02 12:57:56.321490 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b308dc36-0c8d-489a-834e-b29513125c40 req-17ee7728-d425-4e74-9ecb-f15d7c8d8a2a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:56.323186 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b308dc36-0c8d-489a-834e-b29513125c40 req-17ee7728-d425-4e74-9ecb-f15d7c8d8a2a service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=6064269d26644d27aaf12fd0ae66c0a9&device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 1097 time: 0.0473869 Nov 02 12:57:56.369447 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b308dc36-0c8d-489a-834e-b29513125c40 req-08889865-b3c8-4190-a0e1-2260b33e9028 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=8001df2f-618b-4944-8995-ce83bb50997a HTTP/1.1" status: 200 len: 217 time: 0.0358324 Nov 02 12:57:56.419973 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b308dc36-0c8d-489a-834e-b29513125c40 req-bfdec450-ff95-4b95-b37c-04bdaf9195f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:56.421419 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b308dc36-0c8d-489a-834e-b29513125c40 req-bfdec450-ff95-4b95-b37c-04bdaf9195f2 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=0c2af8c2-0033-47ba-9f80-d43799d51067 HTTP/1.1" status: 200 len: 850 time: 0.0449541 Nov 02 12:57:56.471974 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b308dc36-0c8d-489a-834e-b29513125c40 req-1ae3fdd9-0664-491b-8df4-39025e4a3142 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:56.473441 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b308dc36-0c8d-489a-834e-b29513125c40 req-1ae3fdd9-0664-491b-8df4-39025e4a3142 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=4e122687-d2b4-4db2-bcc0-8820ad5e5b77&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0439882 Nov 02 12:57:56.569754 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b308dc36-0c8d-489a-834e-b29513125c40 req-01d7cd62-dbed-4c14-b7ae-155e53b232d3 service neutron] 10.222.0.90 "GET /v2.0/networks/4e122687-d2b4-4db2-bcc0-8820ad5e5b77?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0883160 Nov 02 12:57:56.666192 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b308dc36-0c8d-489a-834e-b29513125c40 req-4e6dce4d-3b26-42b7-835b-392a0802a28c service neutron] 10.222.0.90 "GET /v2.0/networks/4e122687-d2b4-4db2-bcc0-8820ad5e5b77?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0883272 Nov 02 12:57:56.776057 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2c6ddd5-02ac-412b-b6a4-7a715f6def89 req-466fd667-b3d5-4093-ab05-56369832ddae tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:56.777523 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a2c6ddd5-02ac-412b-b6a4-7a715f6def89 req-466fd667-b3d5-4093-ab05-56369832ddae tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 944 time: 0.0505292 Nov 02 12:57:56.825399 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a2c6ddd5-02ac-412b-b6a4-7a715f6def89 req-a986fbd6-d196-47b9-9418-d01bb05bff9a tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417018 Nov 02 12:57:56.882305 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:57.942243 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a2d49ffc-807b-4199-b18b-39197e181d1c req-a1fe066d-5249-49a6-ab3f-959266cc2c49 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:57.943769 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a2d49ffc-807b-4199-b18b-39197e181d1c req-a1fe066d-5249-49a6-ab3f-959266cc2c49 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 944 time: 0.0498500 Nov 02 12:57:57.995430 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a2d49ffc-807b-4199-b18b-39197e181d1c req-cc86e1f2-a390-4d7f-8cf4-d04f7bbe5234 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0451162 Nov 02 12:57:58.413378 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:58.988506 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 8001df2f-618b-4944-8995-ce83bb50997a details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 12:57:59.087448 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 8001df2f-618b-4944-8995-ce83bb50997a, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=8001df2f-618b-4944-8995-ce83bb50997a,segment=NetworkSegment(0271db13-2254-4db8-b649-9b3f1a40557a),segment_id=0271db13-2254-4db8-b649-9b3f1a40557a)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:57:59.099928 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': '8001df2f-618b-4944-8995-ce83bb50997a', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'port_id': '8001df2f-618b-4944-8995-ce83bb50997a', 'mac_address': 'fa:16:3e:3d:fc:62', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 871, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'ip_address': '172.20.0.10'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 12:57:59.111589 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1be74b7b-3d92-4f60-a0ef-f443462dc2d8 req-2c52e8ac-541a-40ff-b8b6-317632bbb4c8 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:57:59.113148 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1be74b7b-3d92-4f60-a0ef-f443462dc2d8 req-2c52e8ac-541a-40ff-b8b6-317632bbb4c8 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 944 time: 0.0507607 Nov 02 12:57:59.137522 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:59.154924 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 8001df2f-618b-4944-8995-ce83bb50997a {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:57:59.163894 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1be74b7b-3d92-4f60-a0ef-f443462dc2d8 req-8172bb08-6134-48f9-a8a5-5f4ef9b95a59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0446162 Nov 02 12:57:59.174825 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 8001df2f-618b-4944-8995-ce83bb50997a, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=8001df2f-618b-4944-8995-ce83bb50997a,segment=NetworkSegment(0271db13-2254-4db8-b649-9b3f1a40557a),segment_id=0271db13-2254-4db8-b649-9b3f1a40557a)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:57:59.287725 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:57:59.337084 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=8001df2f-618b-4944-8995-ce83bb50997a,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:57:59.535024 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['8001df2f-618b-4944-8995-ce83bb50997a'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:58:00.286053 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a01985e6-6d4f-4425-879b-de72fa8e56f4 req-39023e66-ea91-4780-b225-4764b8eb0ea9 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:00.287582 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a01985e6-6d4f-4425-879b-de72fa8e56f4 req-39023e66-ea91-4780-b225-4764b8eb0ea9 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 945 time: 0.0508809 Nov 02 12:58:00.336315 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a01985e6-6d4f-4425-879b-de72fa8e56f4 req-0a6320b9-9453-40f0-bdd2-128b5771dd77 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425823 Nov 02 12:58:00.467751 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:58:00.835471 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:00.994552 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 8001df2f-618b-4944-8995-ce83bb50997a up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:58:01.104967 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning for port 8001df2f-618b-4944-8995-ce83bb50997a completed by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 02 12:58:01.108884 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port 8001df2f-618b-4944-8995-ce83bb50997a triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:58:01.109322 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:01.186883 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:01.209384 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ae55bfa7-4aee-4816-acad-b828d2c6eb9c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8001df2f-618b-4944-8995-ce83bb50997a'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:58:01.211631 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-1543a885-d7ca-4f10-9b71-8406b4f830b1" -d '{"events": [{"server_uuid": "ae55bfa7-4aee-4816-acad-b828d2c6eb9c", "name": "network-vif-plugged", "status": "completed", "tag": "8001df2f-618b-4944-8995-ce83bb50997a"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:58:01.227529 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 8001df2f-618b-4944-8995-ce83bb50997a, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=8001df2f-618b-4944-8995-ce83bb50997a,segment=NetworkSegment(0271db13-2254-4db8-b649-9b3f1a40557a),segment_id=0271db13-2254-4db8-b649-9b3f1a40557a)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:58:01.248213 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:58:01 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e02bf422-abd3-42a7-b1fc-3e562d6ec694 x-openstack-request-id: req-e02bf422-abd3-42a7-b1fc-3e562d6ec694 {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:58:01.248213 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ae55bfa7-4aee-4816-acad-b828d2c6eb9c", "name": "network-vif-plugged", "status": "completed", "tag": "8001df2f-618b-4944-8995-ce83bb50997a", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:58:01.248475 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-e02bf422-abd3-42a7-b1fc-3e562d6ec694 {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:58:01.248864 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ae55bfa7-4aee-4816-acad-b828d2c6eb9c', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '8001df2f-618b-4944-8995-ce83bb50997a', 'code': 200} Nov 02 12:58:01.333104 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:01.465487 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-988ccc81-ea33-4d9a-bf98-4182492457dd req-6e40b758-ec41-4234-8160-b6d00741fa83 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:01.467064 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-988ccc81-ea33-4d9a-bf98-4182492457dd req-6e40b758-ec41-4234-8160-b6d00741fa83 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0590181 Nov 02 12:58:01.515836 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=8001df2f-618b-4944-8995-ce83bb50997a,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:58:01.521709 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-988ccc81-ea33-4d9a-bf98-4182492457dd req-0b61d5e8-1703-4d2e-8752-568787ee9af4 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0481703 Nov 02 12:58:01.608942 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-976104f2-3046-4ed4-9193-834d1e6a3af6 req-1dde3780-c88c-4f9c-87b5-bc45be8f2350 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:01.610492 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-976104f2-3046-4ed4-9193-834d1e6a3af6 req-1dde3780-c88c-4f9c-87b5-bc45be8f2350 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 1099 time: 0.0411582 Nov 02 12:58:01.661397 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-976104f2-3046-4ed4-9193-834d1e6a3af6 req-98712b1d-1852-4384-8466-a2e080b9d96b service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0423889 Nov 02 12:58:02.294225 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff6bcd67-94c4-4485-b959-99e503b6a15f req-75480155-425e-49db-b023-e0c9bf850059 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:02.295690 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ff6bcd67-94c4-4485-b959-99e503b6a15f req-75480155-425e-49db-b023-e0c9bf850059 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=c255ff21-01f2-4710-911e-a3289a3fcc41 HTTP/1.1" status: 200 len: 945 time: 0.0489385 Nov 02 12:58:02.348783 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ff6bcd67-94c4-4485-b959-99e503b6a15f req-3bbb7581-4d93-4414-a48d-cb6949613be6 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0451875 Nov 02 12:58:02.639956 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-20b5bf51-79d2-450a-b3c3-1db261f8832b req-de1294ee-6672-4e14-851c-3630d3124b5e tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:02.641463 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-20b5bf51-79d2-450a-b3c3-1db261f8832b req-de1294ee-6672-4e14-851c-3630d3124b5e tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0499787 Nov 02 12:58:02.692481 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-20b5bf51-79d2-450a-b3c3-1db261f8832b req-03d6fe0c-46e8-487a-8482-4607719df180 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0431187 Nov 02 12:58:03.373527 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:03.463728 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-336d1ec2-ca1d-450f-a4d8-b7b4d243dc08 req-94bef13e-4506-4121-9279-f3f69ed645ee tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:03.465280 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-336d1ec2-ca1d-450f-a4d8-b7b4d243dc08 req-94bef13e-4506-4121-9279-f3f69ed645ee tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=c255ff21-01f2-4710-911e-a3289a3fcc41 HTTP/1.1" status: 200 len: 945 time: 0.0496111 Nov 02 12:58:03.515138 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-336d1ec2-ca1d-450f-a4d8-b7b4d243dc08 req-ec5da253-63db-4ea7-93cc-989398a01352 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/security-groups?id=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0434184 Nov 02 12:58:03.811189 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-04198876-929b-4909-a5c4-2bf52aa21694 req-e0dafc6f-705b-4d13-a71e-f6ceb09de79f tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:03.812716 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-04198876-929b-4909-a5c4-2bf52aa21694 req-e0dafc6f-705b-4d13-a71e-f6ceb09de79f tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0531614 Nov 02 12:58:03.860690 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-04198876-929b-4909-a5c4-2bf52aa21694 req-07a7b5df-efdb-4848-8488-9e05bf4ac745 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419409 Nov 02 12:58:04.002411 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e287099d-6379-4891-b94c-cef3144930fa req-e06135b7-8cc0-4852-8cda-20af700d30df tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:04.003812 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e287099d-6379-4891-b94c-cef3144930fa req-e06135b7-8cc0-4852-8cda-20af700d30df tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0803356 Nov 02 12:58:04.012524 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 35444) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:58:04.015293 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0c7bfb38-4a67-4dd2-b8f1-df57ab0b5942 req-5ed02d65-96b8-4c4c-84b2-fcaae521e0fd tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:04.016778 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0c7bfb38-4a67-4dd2-b8f1-df57ab0b5942 req-5ed02d65-96b8-4c4c-84b2-fcaae521e0fd tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.90 "GET /v2.0/ports?device_id=c255ff21-01f2-4710-911e-a3289a3fcc41 HTTP/1.1" status: 200 len: 945 time: 0.0678446 Nov 02 12:58:04.017356 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-9268439c-6364-4bd4-9fd9-5a602dacc4dd tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Request body: {'floatingip': {'port_id': '8001df2f-618b-4944-8995-ce83bb50997a'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:58:04.060189 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-9268439c-6364-4bd4-9fd9-5a602dacc4dd tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for floatingip, before_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:04.112409 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-0c7bfb38-4a67-4dd2-b8f1-df57ab0b5942 req-837016e1-ed5e-412c-a763-45592d4f0046 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Deleting port be131926-c287-4b0b-a5cc-127875f9f4ac {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 12:58:04.112746 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-0c7bfb38-4a67-4dd2-b8f1-df57ab0b5942 req-837016e1-ed5e-412c-a763-45592d4f0046 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:04.202475 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-0c7bfb38-4a67-4dd2-b8f1-df57ab0b5942 req-837016e1-ed5e-412c-a763-45592d4f0046 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] For port be131926-c287-4b0b-a5cc-127875f9f4ac, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=be131926-c287-4b0b-a5cc-127875f9f4ac,segment=NetworkSegment(e33ebaf8-f9b3-489e-9197-c5c63e968f23),segment_id=e33ebaf8-f9b3-489e-9197-c5c63e968f23)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:58:04.202839 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-0c7bfb38-4a67-4dd2-b8f1-df57ab0b5942 req-837016e1-ed5e-412c-a763-45592d4f0046 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:04.219944 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-0c7bfb38-4a67-4dd2-b8f1-df57ab0b5942 req-837016e1-ed5e-412c-a763-45592d4f0046 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Calling delete_port for be131926-c287-4b0b-a5cc-127875f9f4ac owned by compute:nova {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 12:58:04.459336 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-0c7bfb38-4a67-4dd2-b8f1-df57ab0b5942 req-837016e1-ed5e-412c-a763-45592d4f0046 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:04.471110 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['be131926-c287-4b0b-a5cc-127875f9f4ac'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:58:04.489199 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-837016e1-ed5e-412c-a763-45592d4f0046 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Pushing event deleted for resources: {'Port': ['ID=be131926-c287-4b0b-a5cc-127875f9f4ac,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:58:04.507138 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-9268439c-6364-4bd4-9fd9-5a602dacc4dd tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:04.535603 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-0c7bfb38-4a67-4dd2-b8f1-df57ab0b5942 req-837016e1-ed5e-412c-a763-45592d4f0046 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] No DVR routers for this DVR port be131926-c287-4b0b-a5cc-127875f9f4ac on host hv-cinder-81632 {{(pid=108543) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 12:58:04.538708 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-0c7bfb38-4a67-4dd2-b8f1-df57ab0b5942 req-837016e1-ed5e-412c-a763-45592d4f0046 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:04.542084 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0c7bfb38-4a67-4dd2-b8f1-df57ab0b5942 req-837016e1-ed5e-412c-a763-45592d4f0046 tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.90 "DELETE /v2.0/ports/be131926-c287-4b0b-a5cc-127875f9f4ac HTTP/1.1" status: 204 len: 173 time: 0.5190756 Nov 02 12:58:04.542635 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'c255ff21-01f2-4710-911e-a3289a3fcc41', 'name': 'network-vif-deleted', 'tag': 'be131926-c287-4b0b-a5cc-127875f9f4ac'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:58:04.545143 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2272398e-bf2d-4387-a145-772175e7cf58" -d '{"events": [{"server_uuid": "c255ff21-01f2-4710-911e-a3289a3fcc41", "name": "network-vif-deleted", "tag": "be131926-c287-4b0b-a5cc-127875f9f4ac"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:58:04.573670 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-9268439c-6364-4bd4-9fd9-5a602dacc4dd tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1594992'] for floatingip, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:04.584444 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:58:04 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-c013d383-ca40-4131-bcbb-1a4f3a7f8cc6 x-openstack-request-id: req-c013d383-ca40-4131-bcbb-1a4f3a7f8cc6 {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:58:04.584774 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "c255ff21-01f2-4710-911e-a3289a3fcc41", "name": "network-vif-deleted", "tag": "be131926-c287-4b0b-a5cc-127875f9f4ac", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:58:04.585203 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-c013d383-ca40-4131-bcbb-1a4f3a7f8cc6 {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:58:04.585624 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'c255ff21-01f2-4710-911e-a3289a3fcc41', 'name': 'network-vif-deleted', 'tag': 'be131926-c287-4b0b-a5cc-127875f9f4ac', 'status': 'completed', 'code': 200} Nov 02 12:58:04.615305 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-24f4ceb9-aa67-4a38-8aa3-beaa1a365dbd req-0fc4ec09-da97-4116-b83e-803bf5fd952f tempest-VolumesSnapshotTestJSON-1225094046 tempest-VolumesSnapshotTestJSON-1225094046-project] 10.222.0.98 "GET /v2.0/ports?device_id=c255ff21-01f2-4710-911e-a3289a3fcc41 HTTP/1.1" status: 200 len: 210 time: 0.0287786 Nov 02 12:58:04.687866 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.db.l3_db [None req-9268439c-6364-4bd4-9fd9-5a602dacc4dd tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Floating IP 7ce5ff70-276a-4e8a-865e-af60cedcb077 associated. External IP: 172.27.0.22, port: 8001df2f-618b-4944-8995-ce83bb50997a. Nov 02 12:58:04.897013 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-9268439c-6364-4bd4-9fd9-5a602dacc4dd tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Router cf121ee7-8e7c-41c2-ad44-460321366ae3 has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108542) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 12:58:05.012313 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-9268439c-6364-4bd4-9fd9-5a602dacc4dd tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108542) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:58:05.017671 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-9268439c-6364-4bd4-9fd9-5a602dacc4dd tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for floatingip, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:05.022537 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae4f27ae-d362-4cd6-85e7-7b7f7a4b65f8 None None] Sync routers for ids ['cf121ee7-8e7c-41c2-ad44-460321366ae3'] in dv-cinder-816324-1-iscsi {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:58:05.034422 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae4f27ae-d362-4cd6-85e7-7b7f7a4b65f8 None None] Routers {'cf121ee7-8e7c-41c2-ad44-460321366ae3'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:58:05.035093 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-ae4f27ae-d362-4cd6-85e7-7b7f7a4b65f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:57:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['cf121ee7-8e7c-41c2-ad44-460321366ae3'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:58:05.046822 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-9268439c-6364-4bd4-9fd9-5a602dacc4dd tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "PUT /v2.0/floatingips/7ce5ff70-276a-4e8a-865e-af60cedcb077 HTTP/1.1" status: 200 len: 991 time: 1.0331488 Nov 02 12:58:05.047394 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'ae55bfa7-4aee-4816-acad-b828d2c6eb9c', 'tag': '8001df2f-618b-4944-8995-ce83bb50997a'}] {{(pid=108542) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:58:05.049824 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8fdc2194739644bb754d6b187539f80d2eba7dc5c5d5392f1a2d22d03c0a316c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-37687764-0953-4d56-88fe-d8852dd7fb2e" -d '{"events": [{"name": "network-changed", "server_uuid": "ae55bfa7-4aee-4816-acad-b828d2c6eb9c", "tag": "8001df2f-618b-4944-8995-ce83bb50997a"}]}' {{(pid=108542) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:58:05.087294 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:58:05 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-390a3e22-855c-4588-bbc0-3ba67ffdb0eb x-openstack-request-id: req-390a3e22-855c-4588-bbc0-3ba67ffdb0eb {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:58:05.087651 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "ae55bfa7-4aee-4816-acad-b828d2c6eb9c", "tag": "8001df2f-618b-4944-8995-ce83bb50997a", "status": "completed", "code": 200}]} {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:58:05.088115 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-390a3e22-855c-4588-bbc0-3ba67ffdb0eb {{(pid=108542) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:58:05.088716 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'ae55bfa7-4aee-4816-acad-b828d2c6eb9c', 'tag': '8001df2f-618b-4944-8995-ce83bb50997a', 'status': 'completed', 'code': 200} Nov 02 12:58:05.142644 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-ae4f27ae-d362-4cd6-85e7-7b7f7a4b65f8 None None] Set router cf121ee7-8e7c-41c2-ad44-460321366ae3 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:58:05.155296 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37687764-0953-4d56-88fe-d8852dd7fb2e req-0fad1e38-7836-4baa-8c57-122aaa941311 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:05.156708 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-37687764-0953-4d56-88fe-d8852dd7fb2e req-0fad1e38-7836-4baa-8c57-122aaa941311 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=6064269d26644d27aaf12fd0ae66c0a9&device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 1099 time: 0.0428102 Nov 02 12:58:05.256057 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37687764-0953-4d56-88fe-d8852dd7fb2e req-11771569-7041-440f-9e26-a1fb3e84630d service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:05.257589 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-37687764-0953-4d56-88fe-d8852dd7fb2e req-11771569-7041-440f-9e26-a1fb3e84630d service neutron] 10.222.0.90 "GET /v2.0/networks?id=4e122687-d2b4-4db2-bcc0-8820ad5e5b77 HTTP/1.1" status: 200 len: 912 time: 0.0927083 Nov 02 12:58:05.325273 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-37687764-0953-4d56-88fe-d8852dd7fb2e req-d39304a4-50f9-41e7-b71c-aebf6220f797 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=8001df2f-618b-4944-8995-ce83bb50997a HTTP/1.1" status: 200 len: 999 time: 0.0598094 Nov 02 12:58:05.373845 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-ae4f27ae-d362-4cd6-85e7-7b7f7a4b65f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'name': 'tempest-AttachVolumeTestJSON-1054401684-router', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:57:38Z', 'updated_at': '2021-11-02T12:57:42Z', 'revision_number': 4, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'gw_port': {'id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:0e:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:39Z', 'updated_at': '2021-11-02T12:57:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': '7ce5ff70-276a-4e8a-865e-af60cedcb077', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'floating_ip_address': '172.27.0.22', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'port_id': '8001df2f-618b-4944-8995-ce83bb50997a', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 604, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'mac_address': 'fa:16:3e:3d:fc:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae55bfa7-4aee-4816-acad-b828d2c6eb9c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:57:45Z', 'updated_at': '2021-11-02T12:58:04Z', 'revision_number': 1, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '29f4ed03-3784-40c8-9c15-00c1bd9d54cc', 'name': '', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'mac_address': 'fa:16:3e:db:98:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 597, 'fixed_ips': [{'subnet_id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:41Z', 'updated_at': '2021-11-02T12:57:45Z', 'revision_number': 5, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'subnets': [{'id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:58:05.380148 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37687764-0953-4d56-88fe-d8852dd7fb2e req-27573a35-2e4f-4239-a78f-465525b703b8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:05.381596 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-37687764-0953-4d56-88fe-d8852dd7fb2e req-27573a35-2e4f-4239-a78f-465525b703b8 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=0c2af8c2-0033-47ba-9f80-d43799d51067 HTTP/1.1" status: 200 len: 850 time: 0.0492344 Nov 02 12:58:05.400764 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae4f27ae-d362-4cd6-85e7-7b7f7a4b65f8 None None] Checking router: cf121ee7-8e7c-41c2-ad44-460321366ae3 for host: dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:58:05.411911 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ae4f27ae-d362-4cd6-85e7-7b7f7a4b65f8 None None] Routers {'cf121ee7-8e7c-41c2-ad44-460321366ae3'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:58:05.411911 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-ae4f27ae-d362-4cd6-85e7-7b7f7a4b65f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:57:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['cf121ee7-8e7c-41c2-ad44-460321366ae3'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:58:05.440594 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-37687764-0953-4d56-88fe-d8852dd7fb2e req-38c68f16-4ed3-450d-baf0-1268655e76f0 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:05.444497 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-37687764-0953-4d56-88fe-d8852dd7fb2e req-38c68f16-4ed3-450d-baf0-1268655e76f0 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=4e122687-d2b4-4db2-bcc0-8820ad5e5b77&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0535846 Nov 02 12:58:05.542511 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-37687764-0953-4d56-88fe-d8852dd7fb2e req-338bf1a3-ee43-4640-9ee4-63b10d8b8ce9 service neutron] 10.222.0.90 "GET /v2.0/networks/4e122687-d2b4-4db2-bcc0-8820ad5e5b77?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0912461 Nov 02 12:58:05.609157 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-ae4f27ae-d362-4cd6-85e7-7b7f7a4b65f8 None None] Set router cf121ee7-8e7c-41c2-ad44-460321366ae3 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:58:05.646773 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-37687764-0953-4d56-88fe-d8852dd7fb2e req-ab39d676-1e45-49e8-bbe1-ab83321cf547 service neutron] 10.222.0.90 "GET /v2.0/networks/4e122687-d2b4-4db2-bcc0-8820ad5e5b77?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0960891 Nov 02 12:58:05.849235 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-ae4f27ae-d362-4cd6-85e7-7b7f7a4b65f8 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'name': 'tempest-AttachVolumeTestJSON-1054401684-router', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:57:38Z', 'updated_at': '2021-11-02T12:57:42Z', 'revision_number': 4, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'gw_port': {'id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:0e:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:39Z', 'updated_at': '2021-11-02T12:57:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': '7ce5ff70-276a-4e8a-865e-af60cedcb077', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'floating_ip_address': '172.27.0.22', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'port_id': '8001df2f-618b-4944-8995-ce83bb50997a', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 604, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'mac_address': 'fa:16:3e:3d:fc:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae55bfa7-4aee-4816-acad-b828d2c6eb9c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:57:45Z', 'updated_at': '2021-11-02T12:58:04Z', 'revision_number': 1, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '29f4ed03-3784-40c8-9c15-00c1bd9d54cc', 'name': '', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'mac_address': 'fa:16:3e:db:98:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 597, 'fixed_ips': [{'subnet_id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:41Z', 'updated_at': '2021-11-02T12:57:45Z', 'revision_number': 5, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'subnets': [{'id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:58:05.875884 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ae4f27ae-d362-4cd6-85e7-7b7f7a4b65f8 None None] The sync data for ids ['cf121ee7-8e7c-41c2-ad44-460321366ae3'] in dv-cinder-816324-1-iscsi is: [{'id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'name': 'tempest-AttachVolumeTestJSON-1054401684-router', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:57:38Z', 'updated_at': '2021-11-02T12:57:42Z', 'revision_number': 4, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'gw_port': {'id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:0e:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:39Z', 'updated_at': '2021-11-02T12:57:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': '7ce5ff70-276a-4e8a-865e-af60cedcb077', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'floating_ip_address': '172.27.0.22', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'port_id': '8001df2f-618b-4944-8995-ce83bb50997a', 'fixed_ip_address': '172.20.0.10', 'status': 'DOWN', 'standard_attr_id': 604, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'mac_address': 'fa:16:3e:3d:fc:62', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'ae55bfa7-4aee-4816-acad-b828d2c6eb9c', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:57:45Z', 'updated_at': '2021-11-02T12:58:04Z', 'revision_number': 1, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '29f4ed03-3784-40c8-9c15-00c1bd9d54cc', 'name': '', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'mac_address': 'fa:16:3e:db:98:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 597, 'fixed_ips': [{'subnet_id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:41Z', 'updated_at': '2021-11-02T12:57:45Z', 'revision_number': 5, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'subnets': [{'id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:58:06.072596 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dc8a271e-7d3c-48e8-b007-9489d6976eff None None] New status for floating IP 7ce5ff70-276a-4e8a-865e-af60cedcb077: ACTIVE {{(pid=108544) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 02 12:58:07.044817 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device be131926-c287-4b0b-a5cc-127875f9f4ac no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 12:58:07.066031 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] No Port match for: be131926-c287-4b0b-a5cc-127875f9f4ac {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 12:58:07.066389 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device be131926-c287-4b0b-a5cc-127875f9f4ac not bound to the agent host hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 12:58:07.801083 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-755a8e7c-1979-4576-b806-699ecfbab883 req-4a419b14-b5b8-4ea2-a175-08cb14008b39 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0435979 Nov 02 12:58:07.868872 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-755a8e7c-1979-4576-b806-699ecfbab883 req-978637f5-fcf2-4a98-b04c-13a63f83a224 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:07.868872 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-755a8e7c-1979-4576-b806-699ecfbab883 req-978637f5-fcf2-4a98-b04c-13a63f83a224 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=697de566c0334435b902950f6f31da45&device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 1099 time: 0.0433929 Nov 02 12:58:07.982571 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-755a8e7c-1979-4576-b806-699ecfbab883 req-2f040ad3-2c65-45ec-b216-5f90bfbdabfa service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:07.984035 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-755a8e7c-1979-4576-b806-699ecfbab883 req-2f040ad3-2c65-45ec-b216-5f90bfbdabfa service neutron] 10.222.0.90 "GET /v2.0/networks?id=89f406ae-1b9f-4be7-8881-87075d7c5aa1 HTTP/1.1" status: 200 len: 913 time: 0.0936763 Nov 02 12:58:08.053403 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-755a8e7c-1979-4576-b806-699ecfbab883 req-00389db5-a602-478e-b4c1-985cc2efef71 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=a7cd13fe-71ea-4598-9aff-764b7f736afe HTTP/1.1" status: 200 len: 1001 time: 0.0608437 Nov 02 12:58:08.108192 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-755a8e7c-1979-4576-b806-699ecfbab883 req-8893302e-33ef-4922-a9e0-764d02cdcd2b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:08.109622 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-755a8e7c-1979-4576-b806-699ecfbab883 req-8893302e-33ef-4922-a9e0-764d02cdcd2b service neutron] 10.222.0.90 "GET /v2.0/subnets?id=ae24c2fe-abba-48cd-9d91-28a628d2ef95 HTTP/1.1" status: 200 len: 851 time: 0.0487120 Nov 02 12:58:08.157519 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-755a8e7c-1979-4576-b806-699ecfbab883 req-78289430-a18e-4cce-a9a8-a3da11e57b87 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:08.159089 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-755a8e7c-1979-4576-b806-699ecfbab883 req-78289430-a18e-4cce-a9a8-a3da11e57b87 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=89f406ae-1b9f-4be7-8881-87075d7c5aa1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0411396 Nov 02 12:58:08.251171 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-755a8e7c-1979-4576-b806-699ecfbab883 req-9da615d1-0653-4d56-a9f2-15a6c248e108 service neutron] 10.222.0.90 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0841994 Nov 02 12:58:08.349837 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-755a8e7c-1979-4576-b806-699ecfbab883 req-b8d44309-197c-4d05-a2fd-fd017da321e3 service neutron] 10.222.0.90 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0888746 Nov 02 12:58:23.487222 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-b6cad1f7-12d9-460a-9b2f-3b5b32473751 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:25.727358 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-702cdf96-b56d-4c46-acc4-dbc9591a6d3a None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:26.904837 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:28.367370 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:30.835584 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:33.412537 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:35.063618 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-0c197cad-ee73-4b23-bdda-3ea87bd44d0b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-167174139&fields=id&tenant_id=697de566c0334435b902950f6f31da45 HTTP/1.1" status: 200 len: 267 time: 0.0448780 Nov 02 12:58:35.178274 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-bf0a1a65-2f7b-4811-8c1b-47aab1aba76f tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:35.179742 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-bf0a1a65-2f7b-4811-8c1b-47aab1aba76f tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/networks?id=89f406ae-1b9f-4be7-8881-87075d7c5aa1 HTTP/1.1" status: 200 len: 812 time: 0.1085935 Nov 02 12:58:35.195762 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-cc69f215-2956-4e8c-a65a-558a14e8c1d8 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/quotas/697de566c0334435b902950f6f31da45 HTTP/1.1" status: 200 len: 375 time: 0.0101676 Nov 02 12:58:35.254442 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-441d3419-2b5a-4cfd-8b90-344f0909b736 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?tenant_id=697de566c0334435b902950f6f31da45&fields=id HTTP/1.1" status: 200 len: 440 time: 0.0529251 Nov 02 12:58:35.353607 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-8c0b2a73-10d5-400f-a141-454c7eb2ec75 service neutron] 10.222.0.98 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0877495 Nov 02 12:58:35.444447 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-ce449ced-f7d5-4270-a715-121ecbcf0639 service neutron] 10.222.0.98 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0846794 Nov 02 12:58:35.727779 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 35674) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:58:35.779104 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_v2 [None req-d2bce230-753b-4884-b3ce-ce7f45a7da81 admin admin] Deleting subnet c76b8d78-f8d1-4c53-8f06-2a9d4330c04a {{(pid=108542) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 02 12:58:35.782426 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d2bce230-753b-4884-b3ce-ce7f45a7da81 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:35.818252 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d2bce230-753b-4884-b3ce-ce7f45a7da81 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3344686'] for subnet, precommit_delete_associations {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:35.857613 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d2bce230-753b-4884-b3ce-ce7f45a7da81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-933154'] for subnet, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:36.001413 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d2bce230-753b-4884-b3ce-ce7f45a7da81 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-933141', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126478215', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126185624'] for subnet, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:36.033569 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d2bce230-753b-4884-b3ce-ce7f45a7da81 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=c76b8d78-f8d1-4c53-8f06-2a9d4330c04a,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:58:36.036671 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-d2bce230-753b-4884-b3ce-ce7f45a7da81 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:36.039201 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-d2bce230-753b-4884-b3ce-ce7f45a7da81 admin admin] 10.222.0.98 "DELETE /v2.0/subnets/c76b8d78-f8d1-4c53-8f06-2a9d4330c04a HTTP/1.1" status: 204 len: 168 time: 0.3103666 Nov 02 12:58:36.041923 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 35676) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:58:36.045562 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2bce230-753b-4884-b3ce-ce7f45a7da81 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:36.045904 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2bce230-753b-4884-b3ce-ce7f45a7da81 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:36.046241 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2bce230-753b-4884-b3ce-ce7f45a7da81 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:36.046597 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2bce230-753b-4884-b3ce-ce7f45a7da81 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:36.046920 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2bce230-753b-4884-b3ce-ce7f45a7da81 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:36.047239 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2bce230-753b-4884-b3ce-ce7f45a7da81 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:36.047560 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2bce230-753b-4884-b3ce-ce7f45a7da81 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:36.047879 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2bce230-753b-4884-b3ce-ce7f45a7da81 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:36.048226 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2bce230-753b-4884-b3ce-ce7f45a7da81 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:36.048731 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2bce230-753b-4884-b3ce-ce7f45a7da81 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:36.049057 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2bce230-753b-4884-b3ce-ce7f45a7da81 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:36.049370 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-d2bce230-753b-4884-b3ce-ce7f45a7da81 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:36.116429 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-99611624-2023-4690-8f64-e09496ba8df1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-972735'] for network, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:36.197875 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-99611624-2023-4690-8f64-e09496ba8df1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-930985', 'neutron.services.segments.db._delete_segments_for_network-8738449897966'] for network, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:36.217836 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.services.segments.db [None req-99611624-2023-4690-8f64-e09496ba8df1 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['8e873280-f41f-4e9c-a802-c6eb6e9e490f']}} {{(pid=108543) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:58:36.227033 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.services.segments.db [None req-99611624-2023-4690-8f64-e09496ba8df1 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'e33ebaf8-f9b3-489e-9197-c5c63e968f23') {'for_net_delete': True} {{(pid=108543) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:58:36.227324 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.services.segments.db [None req-99611624-2023-4690-8f64-e09496ba8df1 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'e33ebaf8-f9b3-489e-9197-c5c63e968f23') {} {{(pid=108543) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:58:36.240813 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-99611624-2023-4690-8f64-e09496ba8df1 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738449902583', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3308610'] for segment, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:36.254339 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-99611624-2023-4690-8f64-e09496ba8df1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:36.260365 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-99611624-2023-4690-8f64-e09496ba8df1 admin admin] Releasing vlan 863 on physical network physnet1 to pool {{(pid=108543) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 02 12:58:36.260769 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-99611624-2023-4690-8f64-e09496ba8df1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126393740'] for segment, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: Traceback (most recent call last): Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: timer() Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: cb(*args, **kw) Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: return func(*args, **kwargs) Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: self._notify() Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: self.callback(batched_events) Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: event.method(event) Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: aggregate_uuid = self.p_client.list_aggregates( Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: return f(self, *a, **k) Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: return self._get(url).json() Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: return self.request(url, 'GET', **kwargs) Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: base_url = self.get_endpoint(auth, allow=allow, Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 02 12:58:36.262452 dv-cinder-816324-1-iscsi neutron-server[108543]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 02 12:58:36.458524 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-99611624-2023-4690-8f64-e09496ba8df1 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-930976', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1594946'] for network, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:36.464217 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-99611624-2023-4690-8f64-e09496ba8df1 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:36.467487 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-99611624-2023-4690-8f64-e09496ba8df1 admin admin] 10.222.0.98 "DELETE /v2.0/networks/8e873280-f41f-4e9c-a802-c6eb6e9e490f HTTP/1.1" status: 204 len: 168 time: 0.4244795 Nov 02 12:58:36.478691 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99611624-2023-4690-8f64-e09496ba8df1 admin admin] Pushing event deleted for resources: {'Network': ['ID=8e873280-f41f-4e9c-a802-c6eb6e9e490f,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:58:36.486013 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99611624-2023-4690-8f64-e09496ba8df1 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:36.486356 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99611624-2023-4690-8f64-e09496ba8df1 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:36.486713 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99611624-2023-4690-8f64-e09496ba8df1 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:36.487648 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99611624-2023-4690-8f64-e09496ba8df1 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:36.487959 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99611624-2023-4690-8f64-e09496ba8df1 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:36.488284 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99611624-2023-4690-8f64-e09496ba8df1 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:36.488605 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99611624-2023-4690-8f64-e09496ba8df1 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:36.488924 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99611624-2023-4690-8f64-e09496ba8df1 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:36.489249 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99611624-2023-4690-8f64-e09496ba8df1 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:36.489561 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99611624-2023-4690-8f64-e09496ba8df1 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:36.489878 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99611624-2023-4690-8f64-e09496ba8df1 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:36.490189 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-99611624-2023-4690-8f64-e09496ba8df1 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:36.858137 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 35682) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:58:36.901057 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-5de08065-581e-4fd2-9ee6-d602581e58e0 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=577cab8b312e435c94d7b8d6c6f1929d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0399082 Nov 02 12:58:36.901750 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 35684) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:58:36.949995 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-4e9f6db5-7541-4208-8d8e-bd27ea86a274 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:36.976743 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-4e9f6db5-7541-4208-8d8e-bd27ea86a274 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:37.078798 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-912c53fd-0c6f-4b82-9550-5983009db050 req-42f3bddf-c9b8-4681-afac-359fddea7e7c tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 210 time: 0.0259001 Nov 02 12:58:37.126987 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-4e9f6db5-7541-4208-8d8e-bd27ea86a274 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:37.129673 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-4e9f6db5-7541-4208-8d8e-bd27ea86a274 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:37.130850 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-4e9f6db5-7541-4208-8d8e-bd27ea86a274 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d HTTP/1.1" status: 204 len: 168 time: 0.2282083 Nov 02 12:58:37.139135 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4e9f6db5-7541-4208-8d8e-bd27ea86a274 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=48ed19fd-f1ad-4ca7-84cc-9bc1fb3ecd3d,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:58:37.466577 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:58:38.173165 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-278abc5d-f469-437c-8638-fe3fae7c5b4a req-81c19785-442f-447b-b2be-dd39766ceabb tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 210 time: 0.0297763 Nov 02 12:58:39.267607 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f619af40-8db5-4d50-8275-e97f6e21e2fb req-bac858a4-5e69-4035-8fb5-14348e4b6f55 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 210 time: 0.0252526 Nov 02 12:58:39.440839 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-0dacafb3-688c-462e-80e7-502d3e8929e5 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:39.442778 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-0dacafb3-688c-462e-80e7-502d3e8929e5 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.90 "GET /v2.0/networks?id=89f406ae-1b9f-4be7-8881-87075d7c5aa1 HTTP/1.1" status: 200 len: 812 time: 0.1036444 Nov 02 12:58:39.512469 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-95d4c6f7-4d56-4a5c-87eb-bed3d27f5783 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.90 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=697de566c0334435b902950f6f31da45 HTTP/1.1" status: 200 len: 379 time: 0.0574541 Nov 02 12:58:39.524675 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-b74d7fd5-5cf1-4c2d-a4fd-17e6385a5973 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Request body: {'port': {'device_id': 'd9fae7d7-92b6-4dd7-ae9a-6655ae481917', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'admin_state_up': True, 'tenant_id': '697de566c0334435b902950f6f31da45', 'security_groups': ['9bcd6e2d-4fff-4ee2-aaee-41104c05def3']}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:58:39.709450 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-b74d7fd5-5cf1-4c2d-a4fd-17e6385a5973 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Made reservation on behalf of 697de566c0334435b902950f6f31da45 for: {'port': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 12:58:39.713084 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-b74d7fd5-5cf1-4c2d-a4fd-17e6385a5973 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:39.843701 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-b74d7fd5-5cf1-4c2d-a4fd-17e6385a5973 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Allocated IP 172.20.0.12 (89f406ae-1b9f-4be7-8881-87075d7c5aa1/ae24c2fe-abba-48cd-9d91-28a628d2ef95/81425ddb-f216-49de-bb01-7167c8d68e37) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:58:39.986329 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-b74d7fd5-5cf1-4c2d-a4fd-17e6385a5973 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:40.081259 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-b74d7fd5-5cf1-4c2d-a4fd-17e6385a5973 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:40.124754 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-b74d7fd5-5cf1-4c2d-a4fd-17e6385a5973 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Network 89f406ae-1b9f-4be7-8881-87075d7c5aa1 is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:58:40.128422 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-b74d7fd5-5cf1-4c2d-a4fd-17e6385a5973 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:58:40.131317 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-b74d7fd5-5cf1-4c2d-a4fd-17e6385a5973 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:58:40.174089 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b74d7fd5-5cf1-4c2d-a4fd-17e6385a5973 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Pushing event updated for resources: {'Port': ['ID=81425ddb-f216-49de-bb01-7167c8d68e37,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:58:40.203104 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-b74d7fd5-5cf1-4c2d-a4fd-17e6385a5973 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:40.203876 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-b74d7fd5-5cf1-4c2d-a4fd-17e6385a5973 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:40.323894 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-b74d7fd5-5cf1-4c2d-a4fd-17e6385a5973 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201 len: 934 time: 0.8035722 Nov 02 12:58:40.339072 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-9d5df078-e9f0-49d7-a4e2-23675c984462 service neutron] Request body: {'port': {'device_id': 'd9fae7d7-92b6-4dd7-ae9a-6655ae481917', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81632'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:58:40.377691 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-a5775b7b-a497-481c-ba5a-decb5feb3a6f None None] Provisioning complete for port 81425ddb-f216-49de-bb01-7167c8d68e37 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:58:40.378244 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-a5775b7b-a497-481c-ba5a-decb5feb3a6f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:40.418437 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-a5775b7b-a497-481c-ba5a-decb5feb3a6f None None] Port 81425ddb-f216-49de-bb01-7167c8d68e37 cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 12:58:40.433885 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-579fbab0-ef74-4c26-a0e3-f41b708e5070 req-3f681131-c2e7-486f-ad04-7a5d3e334c44 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:40.435471 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-579fbab0-ef74-4c26-a0e3-f41b708e5070 req-3f681131-c2e7-486f-ad04-7a5d3e334c44 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 932 time: 0.0937121 Nov 02 12:58:40.436224 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-9d5df078-e9f0-49d7-a4e2-23675c984462 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:40.532968 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-579fbab0-ef74-4c26-a0e3-f41b708e5070 req-8c6a085b-2f2e-4db6-9db7-7c707e5b18af tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0878863 Nov 02 12:58:40.742867 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-9d5df078-e9f0-49d7-a4e2-23675c984462 service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 81425ddb-f216-49de-bb01-7167c8d68e37 {{(pid=108543) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:58:40.750097 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-9d5df078-e9f0-49d7-a4e2-23675c984462 service neutron] Publish callbacks [] for port, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:40.761975 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.provisioning_blocks [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-9d5df078-e9f0-49d7-a4e2-23675c984462 service neutron] Transition to ACTIVE for port object 81425ddb-f216-49de-bb01-7167c8d68e37 will not be triggered until provisioned by entity L2. {{(pid=108543) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 02 12:58:40.864106 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-9d5df078-e9f0-49d7-a4e2-23675c984462 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:40.918256 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d5df078-e9f0-49d7-a4e2-23675c984462 service neutron] Pushing event updated for resources: {'Port': ['ID=81425ddb-f216-49de-bb01-7167c8d68e37,revision_number=2']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:58:40.995997 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-9d5df078-e9f0-49d7-a4e2-23675c984462 service neutron] Attempting to bind port 81425ddb-f216-49de-bb01-7167c8d68e37 on host hv-cinder-81632 for vnic_type normal with profile {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 12:58:40.996251 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-9d5df078-e9f0-49d7-a4e2-23675c984462 service neutron] Attempting to bind port 81425ddb-f216-49de-bb01-7167c8d68e37 by drivers openvswitch,hyperv on host hv-cinder-81632 at level 0 using segments [{'id': 'c8ecb7dc-9cc8-47a7-94e7-62f066a97c10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1'}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 12:58:40.996584 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-9d5df078-e9f0-49d7-a4e2-23675c984462 service neutron] Attempting to bind port 81425ddb-f216-49de-bb01-7167c8d68e37 on network 89f406ae-1b9f-4be7-8881-87075d7c5aa1 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:58:41.003518 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-9d5df078-e9f0-49d7-a4e2-23675c984462 service neutron] Port 81425ddb-f216-49de-bb01-7167c8d68e37 on network 89f406ae-1b9f-4be7-8881-87075d7c5aa1 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81632 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 02 12:58:41.003842 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-9d5df078-e9f0-49d7-a4e2-23675c984462 service neutron] Attempting to bind port 81425ddb-f216-49de-bb01-7167c8d68e37 on network 89f406ae-1b9f-4be7-8881-87075d7c5aa1 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 12:58:41.010221 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-9d5df078-e9f0-49d7-a4e2-23675c984462 service neutron] Checking agent: {'id': '0d57fa42-4660-4f08-b7dc-53a872c3c01c', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81632', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'started_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 12, 58, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 12:58:41.010629 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-9d5df078-e9f0-49d7-a4e2-23675c984462 service neutron] Checking segment: {'id': 'c8ecb7dc-9cc8-47a7-94e7-62f066a97c10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108543) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 12:58:41.011116 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-9d5df078-e9f0-49d7-a4e2-23675c984462 service neutron] Bound using segment: {'id': 'c8ecb7dc-9cc8-47a7-94e7-62f066a97c10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1'} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 12:58:41.011558 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-9d5df078-e9f0-49d7-a4e2-23675c984462 service neutron] Bound port: 81425ddb-f216-49de-bb01-7167c8d68e37, host: hv-cinder-81632, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': 'c8ecb7dc-9cc8-47a7-94e7-62f066a97c10', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 892, 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1'}}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 12:58:41.011913 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-9d5df078-e9f0-49d7-a4e2-23675c984462 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:41.093641 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-9d5df078-e9f0-49d7-a4e2-23675c984462 service neutron] For port 81425ddb-f216-49de-bb01-7167c8d68e37, host hv-cinder-81632, cleared binding levels {{(pid=108543) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 12:58:41.097049 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-9d5df078-e9f0-49d7-a4e2-23675c984462 service neutron] For port 81425ddb-f216-49de-bb01-7167c8d68e37, host hv-cinder-81632, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=81425ddb-f216-49de-bb01-7167c8d68e37,segment=NetworkSegment(c8ecb7dc-9cc8-47a7-94e7-62f066a97c10),segment_id=c8ecb7dc-9cc8-47a7-94e7-62f066a97c10)] {{(pid=108543) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 12:58:41.262739 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-9d5df078-e9f0-49d7-a4e2-23675c984462 service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:41.287702 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-9d5df078-e9f0-49d7-a4e2-23675c984462 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:41.288302 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-9d5df078-e9f0-49d7-a4e2-23675c984462 service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:41.289659 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-9d5df078-e9f0-49d7-a4e2-23675c984462 service neutron] 10.222.0.90 "PUT /v2.0/ports/81425ddb-f216-49de-bb01-7167c8d68e37 HTTP/1.1" status: 200 len: 1094 time: 0.9548945 Nov 02 12:58:41.290105 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd9fae7d7-92b6-4dd7-ae9a-6655ae481917', 'tag': '81425ddb-f216-49de-bb01-7167c8d68e37'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:58:41.292616 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4c24f0bc-cc7d-43a9-806c-592b8e0ebbe2" -d '{"events": [{"name": "network-changed", "server_uuid": "d9fae7d7-92b6-4dd7-ae9a-6655ae481917", "tag": "81425ddb-f216-49de-bb01-7167c8d68e37"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:58:41.325541 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-9d5df078-e9f0-49d7-a4e2-23675c984462 service neutron] Pushing event updated for resources: {'Port': ['ID=81425ddb-f216-49de-bb01-7167c8d68e37,revision_number=3']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:58:41.337655 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:58:41 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bd27e223-5984-4630-a76b-4519681d06d2 x-openstack-request-id: req-bd27e223-5984-4630-a76b-4519681d06d2 {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:58:41.337655 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d9fae7d7-92b6-4dd7-ae9a-6655ae481917", "tag": "81425ddb-f216-49de-bb01-7167c8d68e37", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:58:41.337987 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-bd27e223-5984-4630-a76b-4519681d06d2 {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:58:41.338455 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd9fae7d7-92b6-4dd7-ae9a-6655ae481917', 'tag': '81425ddb-f216-49de-bb01-7167c8d68e37', 'status': 'completed', 'code': 200} Nov 02 12:58:41.406438 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c24f0bc-cc7d-43a9-806c-592b8e0ebbe2 req-0542362b-abf5-4db7-9a34-92209db83c74 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:41.407959 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4c24f0bc-cc7d-43a9-806c-592b8e0ebbe2 req-0542362b-abf5-4db7-9a34-92209db83c74 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=697de566c0334435b902950f6f31da45&device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 1097 time: 0.0445864 Nov 02 12:58:41.808454 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c24f0bc-cc7d-43a9-806c-592b8e0ebbe2 req-564cf9b4-9612-4b88-b2ab-260dc93fb1eb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:41.809893 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4c24f0bc-cc7d-43a9-806c-592b8e0ebbe2 req-564cf9b4-9612-4b88-b2ab-260dc93fb1eb service neutron] 10.222.0.90 "GET /v2.0/networks?tenant_id=697de566c0334435b902950f6f31da45&shared=False HTTP/1.1" status: 200 len: 913 time: 0.3917785 Nov 02 12:58:41.818764 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f9dd6958-0c97-4883-975a-7dfad18e2b24 req-0b8db872-0d11-4ff5-abd2-351ea8a09ace tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:41.820127 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f9dd6958-0c97-4883-975a-7dfad18e2b24 req-0b8db872-0d11-4ff5-abd2-351ea8a09ace tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 944 time: 0.0755324 Nov 02 12:58:41.924040 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f9dd6958-0c97-4883-975a-7dfad18e2b24 req-365d6013-5498-436b-8ad6-da8b91f311e7 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0957396 Nov 02 12:58:41.945340 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4c24f0bc-cc7d-43a9-806c-592b8e0ebbe2 req-9616a036-0a0e-4076-a994-c54908b28edb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:41.946915 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4c24f0bc-cc7d-43a9-806c-592b8e0ebbe2 req-9616a036-0a0e-4076-a994-c54908b28edb service neutron] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1259675 Nov 02 12:58:42.042246 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-dc74c012-8772-48d2-b012-1b9ef228c40e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:42.043765 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-dc74c012-8772-48d2-b012-1b9ef228c40e service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=697de566c0334435b902950f6f31da45&device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 1097 time: 0.0563591 Nov 02 12:58:42.095426 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-20d8d393-1b91-443a-802d-9923a436c3a2 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=81425ddb-f216-49de-bb01-7167c8d68e37 HTTP/1.1" status: 200 len: 217 time: 0.0377021 Nov 02 12:58:42.147670 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-b2a6a1d0-49ef-493d-8747-d70566267223 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:42.149196 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-b2a6a1d0-49ef-493d-8747-d70566267223 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=ae24c2fe-abba-48cd-9d91-28a628d2ef95 HTTP/1.1" status: 200 len: 851 time: 0.0448103 Nov 02 12:58:42.198484 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-9876b444-146e-4c18-86e9-6ba5dda295cb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:42.199483 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-9876b444-146e-4c18-86e9-6ba5dda295cb service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=89f406ae-1b9f-4be7-8881-87075d7c5aa1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0427246 Nov 02 12:58:42.295820 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-9ef54064-3c26-4cad-ae67-8592ea4e1a7f service neutron] 10.222.0.90 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0876198 Nov 02 12:58:42.395390 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ea03d575-73a7-481d-abab-3d5990a5e74a req-77f65d58-3963-4711-9f56-c03d55caadc3 service neutron] 10.222.0.90 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0910056 Nov 02 12:58:43.047698 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fb7eecd1-d288-45d2-937d-5ec94727c806 req-b9aa2722-d616-4ada-b22f-c44e3c695f27 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:43.049582 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fb7eecd1-d288-45d2-937d-5ec94727c806 req-b9aa2722-d616-4ada-b22f-c44e3c695f27 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 944 time: 0.0538306 Nov 02 12:58:43.110207 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fb7eecd1-d288-45d2-937d-5ec94727c806 req-91e44aa8-a101-42d7-b461-bb11b7899fa6 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0541399 Nov 02 12:58:44.225163 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b76b6be2-76f7-427e-8d30-4e48e57f9a4b req-88979ec1-0988-4905-b332-c2a8ac651f55 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:44.227125 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b76b6be2-76f7-427e-8d30-4e48e57f9a4b req-88979ec1-0988-4905-b332-c2a8ac651f55 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 944 time: 0.0495672 Nov 02 12:58:44.279547 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b76b6be2-76f7-427e-8d30-4e48e57f9a4b req-143c8887-507c-4358-a73f-155be8aed0b7 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0448821 Nov 02 12:58:45.409067 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3dd09dbb-be5c-413b-9c8e-279e3a2b2024 req-6cfab29a-4ba6-45cf-808d-ee9556a8da5f tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:45.410628 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3dd09dbb-be5c-413b-9c8e-279e3a2b2024 req-6cfab29a-4ba6-45cf-808d-ee9556a8da5f tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 944 time: 0.0561633 Nov 02 12:58:45.463199 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3dd09dbb-be5c-413b-9c8e-279e3a2b2024 req-29ff7ade-e4f8-4627-b1e4-3b783d7ab387 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0450265 Nov 02 12:58:46.576650 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-19c42a39-5900-47ed-8bbb-66f1fb44b221 req-8f979f8e-86de-478b-ae62-c5c7a8deb611 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:46.578061 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-19c42a39-5900-47ed-8bbb-66f1fb44b221 req-8f979f8e-86de-478b-ae62-c5c7a8deb611 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 944 time: 0.0484858 Nov 02 12:58:46.628831 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-19c42a39-5900-47ed-8bbb-66f1fb44b221 req-80af460f-48ac-4609-b185-5bbc38297080 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0442474 Nov 02 12:58:47.749502 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-32ecf4c6-abd6-4fa1-a618-3e2611272a76 req-ff8a55d3-e6a1-4cba-a118-6e7a7e64d2e1 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:47.751046 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-32ecf4c6-abd6-4fa1-a618-3e2611272a76 req-ff8a55d3-e6a1-4cba-a118-6e7a7e64d2e1 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 944 time: 0.0539687 Nov 02 12:58:47.808898 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-32ecf4c6-abd6-4fa1-a618-3e2611272a76 req-812f284c-231d-4abf-a0d0-cacb1f910fff tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0500829 Nov 02 12:58:48.923718 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-61e43bbc-587f-49bd-9667-7e6daef1057a req-d2b82b07-9572-45af-80b3-424b41a7d594 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:48.925248 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-61e43bbc-587f-49bd-9667-7e6daef1057a req-d2b82b07-9572-45af-80b3-424b41a7d594 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 944 time: 0.0492716 Nov 02 12:58:48.981415 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-61e43bbc-587f-49bd-9667-7e6daef1057a req-7e9a5791-f169-4b7a-a7b4-cef957898298 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0467124 Nov 02 12:58:49.220863 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 81425ddb-f216-49de-bb01-7167c8d68e37 details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 12:58:49.316039 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 81425ddb-f216-49de-bb01-7167c8d68e37, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=81425ddb-f216-49de-bb01-7167c8d68e37,segment=NetworkSegment(c8ecb7dc-9cc8-47a7-94e7-62f066a97c10),segment_id=c8ecb7dc-9cc8-47a7-94e7-62f066a97c10)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:58:49.330811 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': '81425ddb-f216-49de-bb01-7167c8d68e37', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'port_id': '81425ddb-f216-49de-bb01-7167c8d68e37', 'mac_address': 'fa:16:3e:f6:6d:2d', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 892, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'ip_address': '172.20.0.12'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 12:58:49.369654 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:49.382197 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 81425ddb-f216-49de-bb01-7167c8d68e37 {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 12:58:49.401339 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 81425ddb-f216-49de-bb01-7167c8d68e37, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=81425ddb-f216-49de-bb01-7167c8d68e37,segment=NetworkSegment(c8ecb7dc-9cc8-47a7-94e7-62f066a97c10),segment_id=c8ecb7dc-9cc8-47a7-94e7-62f066a97c10)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:58:49.492705 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:49.539863 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=81425ddb-f216-49de-bb01-7167c8d68e37,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:58:49.546786 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:49.547138 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:49.547478 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:49.547865 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:49.548220 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:49.548554 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:49.548881 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:49.549206 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:49.549532 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:49.549853 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:49.550174 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:49.550526 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 12:58:49.781608 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['81425ddb-f216-49de-bb01-7167c8d68e37'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 12:58:50.103198 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a61b48a7-d7f2-490f-85d8-fed097e30875 req-ef2ecf0b-c5d0-4e74-a461-ce814c3ee0a1 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:50.104713 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a61b48a7-d7f2-490f-85d8-fed097e30875 req-ef2ecf0b-c5d0-4e74-a461-ce814c3ee0a1 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 945 time: 0.0518098 Nov 02 12:58:50.156734 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a61b48a7-d7f2-490f-85d8-fed097e30875 req-ba210829-3f67-4aeb-bc73-eaf8a86eb852 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0460856 Nov 02 12:58:51.229211 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 81425ddb-f216-49de-bb01-7167c8d68e37 up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 12:58:51.287339 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5dfdaf9-ce5b-45ac-b01b-3cdf42b32076 req-83642b2e-2c0f-4128-bffd-8b61409d8408 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:51.288943 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d5dfdaf9-ce5b-45ac-b01b-3cdf42b32076 req-83642b2e-2c0f-4128-bffd-8b61409d8408 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 945 time: 0.0591831 Nov 02 12:58:51.340035 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d5dfdaf9-ce5b-45ac-b01b-3cdf42b32076 req-18456287-b657-4f7b-9ecf-c68d00313bf1 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446095 Nov 02 12:58:51.406020 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning for port 81425ddb-f216-49de-bb01-7167c8d68e37 completed by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 02 12:58:51.410853 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port 81425ddb-f216-49de-bb01-7167c8d68e37 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 12:58:51.410853 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:51.487698 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:51.513128 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd9fae7d7-92b6-4dd7-ae9a-6655ae481917', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '81425ddb-f216-49de-bb01-7167c8d68e37'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:58:51.515435 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6d26187e-0ce5-432f-a981-0caa7046a916" -d '{"events": [{"server_uuid": "d9fae7d7-92b6-4dd7-ae9a-6655ae481917", "name": "network-vif-plugged", "status": "completed", "tag": "81425ddb-f216-49de-bb01-7167c8d68e37"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:58:51.529623 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 81425ddb-f216-49de-bb01-7167c8d68e37, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=81425ddb-f216-49de-bb01-7167c8d68e37,segment=NetworkSegment(c8ecb7dc-9cc8-47a7-94e7-62f066a97c10),segment_id=c8ecb7dc-9cc8-47a7-94e7-62f066a97c10)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 12:58:51.551258 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 12:58:51 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-1f659b0b-dec6-449a-a774-b2be988f434c x-openstack-request-id: req-1f659b0b-dec6-449a-a774-b2be988f434c {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:58:51.551556 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d9fae7d7-92b6-4dd7-ae9a-6655ae481917", "name": "network-vif-plugged", "status": "completed", "tag": "81425ddb-f216-49de-bb01-7167c8d68e37", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:58:51.551813 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-1f659b0b-dec6-449a-a774-b2be988f434c {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:58:51.552712 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd9fae7d7-92b6-4dd7-ae9a-6655ae481917', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '81425ddb-f216-49de-bb01-7167c8d68e37', 'code': 200} Nov 02 12:58:51.647149 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:51.696126 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=81425ddb-f216-49de-bb01-7167c8d68e37,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:58:51.983620 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1b91e62c-c9c3-4951-8c5e-9aeb1df70f58 req-9efc237b-b9ae-4f65-b8df-80a86756190a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:51.985015 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1b91e62c-c9c3-4951-8c5e-9aeb1df70f58 req-9efc237b-b9ae-4f65-b8df-80a86756190a service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 1099 time: 0.0443447 Nov 02 12:58:52.036271 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1b91e62c-c9c3-4951-8c5e-9aeb1df70f58 req-cc18c72e-40e6-4bf4-a8ed-93468f95e01f service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0419536 Nov 02 12:58:52.458127 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9d09d85-758e-4573-99c7-e2023d5811c2 req-bdec69f2-80d8-462c-b435-c498603312c0 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:52.459770 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e9d09d85-758e-4573-99c7-e2023d5811c2 req-bdec69f2-80d8-462c-b435-c498603312c0 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 946 time: 0.0521405 Nov 02 12:58:52.524823 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e9d09d85-758e-4573-99c7-e2023d5811c2 req-0df3ca71-cf24-4b5c-81e7-ce009b7591fc tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0545073 Nov 02 12:58:53.543751 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-087df95a-aa22-4c99-bada-de1e7ddc5e19 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:53.647693 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d22ced5a-4df2-4925-99e5-f52dab9d0fa7 req-97dc2849-e28c-4d6b-af38-66b2114909cc tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:53.649179 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d22ced5a-4df2-4925-99e5-f52dab9d0fa7 req-97dc2849-e28c-4d6b-af38-66b2114909cc tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 946 time: 0.0498013 Nov 02 12:58:53.700190 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d22ced5a-4df2-4925-99e5-f52dab9d0fa7 req-14e54071-239b-4223-8be1-226071aa2fad tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0446634 Nov 02 12:58:53.817552 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7b49f730-cff3-4b6d-afd3-9b2758197943 req-21c72c42-0116-46e4-869e-f23682f49c88 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:53.819554 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7b49f730-cff3-4b6d-afd3-9b2758197943 req-21c72c42-0116-46e4-869e-f23682f49c88 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 946 time: 0.0536103 Nov 02 12:58:53.868771 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7b49f730-cff3-4b6d-afd3-9b2758197943 req-264efdc0-fc1a-4fc2-bb19-6efcc8c6b80a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0432878 Nov 02 12:58:53.890997 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 35772) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:58:54.138485 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-0440e570-1248-46bf-8355-391ff41f0aa1 tempest-TestVolumeBootPattern-1047552789 tempest-TestVolumeBootPattern-1047552789-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:54.139984 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-0440e570-1248-46bf-8355-391ff41f0aa1 tempest-TestVolumeBootPattern-1047552789 tempest-TestVolumeBootPattern-1047552789-project-admin] 10.222.0.98 "GET /v2.0/ports?device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 1094 time: 0.2480142 Nov 02 12:58:54.142871 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 35782) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 12:58:54.147143 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-ba410f00-c75d-4b43-83a3-691415dd5105 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Request body: {'floatingip': {'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'port_id': '81425ddb-f216-49de-bb01-7167c8d68e37', 'tenant_id': '697de566c0334435b902950f6f31da45', 'fixed_ip_address': '172.20.0.12'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 12:58:54.297896 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ba410f00-c75d-4b43-83a3-691415dd5105 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for floatingip, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:54.399615 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ba410f00-c75d-4b43-83a3-691415dd5105 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:54.506974 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [None req-ba410f00-c75d-4b43-83a3-691415dd5105 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Allocated IP 172.27.0.134 (43464fa8-eb00-46fb-9ca0-be7342f9ddbf/44a807bc-f2b6-41f0-b765-e5d3393fe305/d6c77673-6a3d-4168-957c-98298662e774) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 12:58:54.609166 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ba410f00-c75d-4b43-83a3-691415dd5105 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:54.744150 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ba410f00-c75d-4b43-83a3-691415dd5105 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:54.785507 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-ba410f00-c75d-4b43-83a3-691415dd5105 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 12:58:54.791088 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [None req-ba410f00-c75d-4b43-83a3-691415dd5105 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 12:58:54.794838 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [None req-ba410f00-c75d-4b43-83a3-691415dd5105 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 12:58:54.817955 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba410f00-c75d-4b43-83a3-691415dd5105 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Pushing event updated for resources: {'Port': ['ID=d6c77673-6a3d-4168-957c-98298662e774,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:58:55.167696 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ba410f00-c75d-4b43-83a3-691415dd5105 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:55.363468 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ba410f00-c75d-4b43-83a3-691415dd5105 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:55.520577 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ba410f00-c75d-4b43-83a3-691415dd5105 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for port, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:55.629279 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ba410f00-c75d-4b43-83a3-691415dd5105 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:55.657716 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-136796a2-a1ad-4e35-9e5e-b934dec49cec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:55.699565 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ba410f00-c75d-4b43-83a3-691415dd5105 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Pushing event updated for resources: {'Port': ['ID=d6c77673-6a3d-4168-957c-98298662e774,revision_number=2']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 12:58:55.715428 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ba410f00-c75d-4b43-83a3-691415dd5105 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1594992'] for floatingip, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:55.816300 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.db.l3_db [None req-ba410f00-c75d-4b43-83a3-691415dd5105 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Floating IP 1c504a47-4c8b-4d0d-a631-4b18b01ede1a associated. External IP: 172.27.0.134, port: 81425ddb-f216-49de-bb01-7167c8d68e37. Nov 02 12:58:56.029375 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-ba410f00-c75d-4b43-83a3-691415dd5105 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108543) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 12:58:56.143893 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-ba410f00-c75d-4b43-83a3-691415dd5105 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108543) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 12:58:56.154346 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9802759f-ab2e-4b74-8590-bb69f7bbf669 None None] Sync routers for ids ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'] in dv-cinder-816324-1-iscsi {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 12:58:56.165679 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9802759f-ab2e-4b74-8590-bb69f7bbf669 None None] Routers {'2a2f63fd-e512-4ad2-9007-46e6ab6e8134'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:58:56.166263 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-9802759f-ab2e-4b74-8590-bb69f7bbf669 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:58:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:58:56.214137 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-ba410f00-c75d-4b43-83a3-691415dd5105 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for floatingip, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:56.243445 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-ba410f00-c75d-4b43-83a3-691415dd5105 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 997 time: 2.0995362 Nov 02 12:58:56.244240 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd9fae7d7-92b6-4dd7-ae9a-6655ae481917', 'tag': '81425ddb-f216-49de-bb01-7167c8d68e37'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 12:58:56.246755 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6b01d68f-a3a0-42ea-ad79-e72ad36a8257" -d '{"events": [{"name": "network-changed", "server_uuid": "d9fae7d7-92b6-4dd7-ae9a-6655ae481917", "tag": "81425ddb-f216-49de-bb01-7167c8d68e37"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 12:58:56.275759 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-9802759f-ab2e-4b74-8590-bb69f7bbf669 None None] Set router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:58:56.284338 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 12:58:56 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-11a77391-ff94-49b3-a197-dcedd81ef59f x-openstack-request-id: req-11a77391-ff94-49b3-a197-dcedd81ef59f {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 12:58:56.284634 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d9fae7d7-92b6-4dd7-ae9a-6655ae481917", "tag": "81425ddb-f216-49de-bb01-7167c8d68e37", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 12:58:56.284886 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-11a77391-ff94-49b3-a197-dcedd81ef59f {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 12:58:56.285291 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd9fae7d7-92b6-4dd7-ae9a-6655ae481917', 'tag': '81425ddb-f216-49de-bb01-7167c8d68e37', 'status': 'completed', 'code': 200} Nov 02 12:58:56.351153 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b01d68f-a3a0-42ea-ad79-e72ad36a8257 req-75a905ed-529e-44fc-9d15-775e3d348b85 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:56.352568 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6b01d68f-a3a0-42ea-ad79-e72ad36a8257 req-75a905ed-529e-44fc-9d15-775e3d348b85 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=697de566c0334435b902950f6f31da45&device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 1099 time: 0.0410419 Nov 02 12:58:56.452728 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b01d68f-a3a0-42ea-ad79-e72ad36a8257 req-a5e3320c-28b3-42d8-a8ea-9c72813e9f64 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:56.454221 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6b01d68f-a3a0-42ea-ad79-e72ad36a8257 req-a5e3320c-28b3-42d8-a8ea-9c72813e9f64 service neutron] 10.222.0.90 "GET /v2.0/networks?id=89f406ae-1b9f-4be7-8881-87075d7c5aa1 HTTP/1.1" status: 200 len: 913 time: 0.0925965 Nov 02 12:58:56.517965 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-9802759f-ab2e-4b74-8590-bb69f7bbf669 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port': {'id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:1f:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:31Z', 'updated_at': '2021-11-02T12:51:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': '1c504a47-4c8b-4d0d-a631-4b18b01ede1a', 'tenant_id': '697de566c0334435b902950f6f31da45', 'floating_ip_address': '172.27.0.134', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'port_id': '81425ddb-f216-49de-bb01-7167c8d68e37', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 608, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'mac_address': 'fa:16:3e:f6:6d:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9fae7d7-92b6-4dd7-ae9a-6655ae481917', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:58:55Z', 'updated_at': '2021-11-02T12:58:55Z', 'revision_number': 0, 'project_id': '697de566c0334435b902950f6f31da45', 'fixed_ip_address_scope': None}, {'id': '5fd4585f-d4f7-4f9e-971e-e5d255fd0c1d', 'tenant_id': '697de566c0334435b902950f6f31da45', 'floating_ip_address': '172.27.0.37', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'port_id': 'a7cd13fe-71ea-4598-9aff-764b7f736afe', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 584, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'mac_address': 'fa:16:3e:e9:fc:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93ad83e9-3682-4f82-b83f-f511d5942f94', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:56:33Z', 'updated_at': '2021-11-02T12:56:35Z', 'revision_number': 1, 'project_id': '697de566c0334435b902950f6f31da45', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '80a55893-6272-4299-8834-e840aa37d37b', 'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'tenant_id': '697de566c0334435b902950f6f31da45', 'mac_address': 'fa:16:3e:64:ef:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_interface', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:48Z', 'updated_at': '2021-11-02T12:52:07Z', 'revision_number': 5, 'project_id': '697de566c0334435b902950f6f31da45', 'subnets': [{'id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:58:56.525681 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6b01d68f-a3a0-42ea-ad79-e72ad36a8257 req-cc79486d-93c8-42bb-8846-e3bc0a6e387b service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=81425ddb-f216-49de-bb01-7167c8d68e37 HTTP/1.1" status: 200 len: 1000 time: 0.0628273 Nov 02 12:58:56.548766 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9802759f-ab2e-4b74-8590-bb69f7bbf669 None None] Checking router: 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 for host: dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 12:58:56.556949 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-9802759f-ab2e-4b74-8590-bb69f7bbf669 None None] Routers {'2a2f63fd-e512-4ad2-9007-46e6ab6e8134'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 12:58:56.557535 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-9802759f-ab2e-4b74-8590-bb69f7bbf669 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 2, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T12:58:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:58:56.579090 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b01d68f-a3a0-42ea-ad79-e72ad36a8257 req-f9f1a359-ad44-44b3-8db8-fb0c944e887f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:56.580535 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6b01d68f-a3a0-42ea-ad79-e72ad36a8257 req-f9f1a359-ad44-44b3-8db8-fb0c944e887f service neutron] 10.222.0.90 "GET /v2.0/subnets?id=ae24c2fe-abba-48cd-9d91-28a628d2ef95 HTTP/1.1" status: 200 len: 851 time: 0.0477734 Nov 02 12:58:56.629535 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-6b01d68f-a3a0-42ea-ad79-e72ad36a8257 req-1080ad25-d1ee-46e2-a770-f3cc3068a8ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:58:56.631096 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6b01d68f-a3a0-42ea-ad79-e72ad36a8257 req-1080ad25-d1ee-46e2-a770-f3cc3068a8ac service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=89f406ae-1b9f-4be7-8881-87075d7c5aa1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0431089 Nov 02 12:58:56.664211 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-9802759f-ab2e-4b74-8590-bb69f7bbf669 None None] Set router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 12:58:56.726038 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6b01d68f-a3a0-42ea-ad79-e72ad36a8257 req-146fc981-d061-463b-af51-80a0b4577e26 service neutron] 10.222.0.90 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0871801 Nov 02 12:58:56.822754 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6b01d68f-a3a0-42ea-ad79-e72ad36a8257 req-2bd3c4e3-a920-4f06-9a24-2684f4fc6160 service neutron] 10.222.0.90 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0892994 Nov 02 12:58:56.869376 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:58:56.892157 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-9802759f-ab2e-4b74-8590-bb69f7bbf669 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port': {'id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:1f:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:31Z', 'updated_at': '2021-11-02T12:51:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': '1c504a47-4c8b-4d0d-a631-4b18b01ede1a', 'tenant_id': '697de566c0334435b902950f6f31da45', 'floating_ip_address': '172.27.0.134', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'port_id': '81425ddb-f216-49de-bb01-7167c8d68e37', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 608, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'mac_address': 'fa:16:3e:f6:6d:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9fae7d7-92b6-4dd7-ae9a-6655ae481917', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:58:55Z', 'updated_at': '2021-11-02T12:58:55Z', 'revision_number': 0, 'project_id': '697de566c0334435b902950f6f31da45', 'fixed_ip_address_scope': None}, {'id': '5fd4585f-d4f7-4f9e-971e-e5d255fd0c1d', 'tenant_id': '697de566c0334435b902950f6f31da45', 'floating_ip_address': '172.27.0.37', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'port_id': 'a7cd13fe-71ea-4598-9aff-764b7f736afe', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 584, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'mac_address': 'fa:16:3e:e9:fc:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93ad83e9-3682-4f82-b83f-f511d5942f94', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:56:33Z', 'updated_at': '2021-11-02T12:56:35Z', 'revision_number': 1, 'project_id': '697de566c0334435b902950f6f31da45', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '80a55893-6272-4299-8834-e840aa37d37b', 'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'tenant_id': '697de566c0334435b902950f6f31da45', 'mac_address': 'fa:16:3e:64:ef:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_interface', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:48Z', 'updated_at': '2021-11-02T12:52:07Z', 'revision_number': 5, 'project_id': '697de566c0334435b902950f6f31da45', 'subnets': [{'id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 12:58:56.923649 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-9802759f-ab2e-4b74-8590-bb69f7bbf669 None None] The sync data for ids ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'] in dv-cinder-816324-1-iscsi is: [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port': {'id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:1f:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:31Z', 'updated_at': '2021-11-02T12:51:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': '1c504a47-4c8b-4d0d-a631-4b18b01ede1a', 'tenant_id': '697de566c0334435b902950f6f31da45', 'floating_ip_address': '172.27.0.134', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'port_id': '81425ddb-f216-49de-bb01-7167c8d68e37', 'fixed_ip_address': '172.20.0.12', 'status': 'DOWN', 'standard_attr_id': 608, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'mac_address': 'fa:16:3e:f6:6d:2d', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'd9fae7d7-92b6-4dd7-ae9a-6655ae481917', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:58:55Z', 'updated_at': '2021-11-02T12:58:55Z', 'revision_number': 0, 'project_id': '697de566c0334435b902950f6f31da45', 'fixed_ip_address_scope': None}, {'id': '5fd4585f-d4f7-4f9e-971e-e5d255fd0c1d', 'tenant_id': '697de566c0334435b902950f6f31da45', 'floating_ip_address': '172.27.0.37', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'port_id': 'a7cd13fe-71ea-4598-9aff-764b7f736afe', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 584, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'mac_address': 'fa:16:3e:e9:fc:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93ad83e9-3682-4f82-b83f-f511d5942f94', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:56:33Z', 'updated_at': '2021-11-02T12:56:35Z', 'revision_number': 1, 'project_id': '697de566c0334435b902950f6f31da45', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '80a55893-6272-4299-8834-e840aa37d37b', 'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'tenant_id': '697de566c0334435b902950f6f31da45', 'mac_address': 'fa:16:3e:64:ef:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_interface', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:48Z', 'updated_at': '2021-11-02T12:52:07Z', 'revision_number': 5, 'project_id': '697de566c0334435b902950f6f31da45', 'subnets': [{'id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 12:58:57.107789 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-4a113319-a68d-4411-b79f-2398229c74ce None None] New status for floating IP 1c504a47-4c8b-4d0d-a631-4b18b01ede1a: ACTIVE {{(pid=108544) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 02 12:58:58.354902 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:59:00.823995 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:59:02.837613 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f788d045-175e-4e91-9412-0fdb098e6c0e req-405db129-9dd8-4f81-b64c-466351b5b990 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:02.839207 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f788d045-175e-4e91-9412-0fdb098e6c0e req-405db129-9dd8-4f81-b64c-466351b5b990 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0520542 Nov 02 12:59:02.891442 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f788d045-175e-4e91-9412-0fdb098e6c0e req-36acb9d9-2d3f-49db-8c47-8626e604a3fe tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0461657 Nov 02 12:59:03.422941 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:59:04.020880 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0fde30db-0067-4725-b2e4-df88e76f4418 req-cab1f1cf-ed31-4f32-b5d8-350dd5f0c386 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:04.022541 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0fde30db-0067-4725-b2e4-df88e76f4418 req-cab1f1cf-ed31-4f32-b5d8-350dd5f0c386 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0535266 Nov 02 12:59:04.070964 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0fde30db-0067-4725-b2e4-df88e76f4418 req-ddb895ea-4213-48ce-9d56-c4ce830eb2cf tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424972 Nov 02 12:59:05.188335 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c6ea85f7-c513-44ac-b4a5-3d21d78df98d req-a4742e7c-1d35-43e7-a696-b89f93a25a7b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:05.189783 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c6ea85f7-c513-44ac-b4a5-3d21d78df98d req-a4742e7c-1d35-43e7-a696-b89f93a25a7b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0500445 Nov 02 12:59:05.238320 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c6ea85f7-c513-44ac-b4a5-3d21d78df98d req-497bfae0-47c3-413a-a618-93e6e44da204 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424337 Nov 02 12:59:06.355261 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8366474f-6808-46d7-ae17-5a5862f6e7a2 req-7f056985-df07-4a63-a8b5-d79933f7b29a tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:06.356922 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8366474f-6808-46d7-ae17-5a5862f6e7a2 req-7f056985-df07-4a63-a8b5-d79933f7b29a tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0502462 Nov 02 12:59:06.409416 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8366474f-6808-46d7-ae17-5a5862f6e7a2 req-2a608fc8-dcb0-4754-a318-17046828803a tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0466921 Nov 02 12:59:07.525321 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4637a663-2a2d-4ed9-a9f3-270e603d00e2 req-5aea3fd9-69e5-46de-b882-df3201e45b06 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:07.526785 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4637a663-2a2d-4ed9-a9f3-270e603d00e2 req-5aea3fd9-69e5-46de-b882-df3201e45b06 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0500407 Nov 02 12:59:07.575621 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4637a663-2a2d-4ed9-a9f3-270e603d00e2 req-6ad31e72-e4c3-4e5b-a131-73ba41ab26e5 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0419190 Nov 02 12:59:08.808153 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdfbfc98-1171-4e0b-9c47-ba8c417cd7e4 req-b107a1a7-367e-4018-97e9-dffb7b66695c tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:08.809660 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fdfbfc98-1171-4e0b-9c47-ba8c417cd7e4 req-b107a1a7-367e-4018-97e9-dffb7b66695c tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.1630895 Nov 02 12:59:08.857006 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fdfbfc98-1171-4e0b-9c47-ba8c417cd7e4 req-d3aa321c-6289-4516-9404-759df5946d79 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0414028 Nov 02 12:59:09.782405 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-80b90fb2-c796-43f9-b8c9-ed472ee28f46 req-02bf2ec7-fb3d-45fb-9ed4-6c44108edda9 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0453980 Nov 02 12:59:09.871824 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80b90fb2-c796-43f9-b8c9-ed472ee28f46 req-46d5d6e1-a2e5-4fd1-8721-f07b2814bd5a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:09.873242 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-80b90fb2-c796-43f9-b8c9-ed472ee28f46 req-46d5d6e1-a2e5-4fd1-8721-f07b2814bd5a service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=697de566c0334435b902950f6f31da45&device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 1099 time: 0.0416443 Nov 02 12:59:10.030552 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e9dfbfb0-05db-4566-85dd-414689c2f153 req-20c90355-7ba6-4eab-bf3a-fca3db5f1ea2 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:10.032151 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e9dfbfb0-05db-4566-85dd-414689c2f153 req-20c90355-7ba6-4eab-bf3a-fca3db5f1ea2 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0760453 Nov 02 12:59:10.033740 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80b90fb2-c796-43f9-b8c9-ed472ee28f46 req-a14b7bc4-2886-45cd-875e-e94ff024dc6e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:10.035127 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-80b90fb2-c796-43f9-b8c9-ed472ee28f46 req-a14b7bc4-2886-45cd-875e-e94ff024dc6e service neutron] 10.222.0.90 "GET /v2.0/networks?id=89f406ae-1b9f-4be7-8881-87075d7c5aa1 HTTP/1.1" status: 200 len: 913 time: 0.1341047 Nov 02 12:59:10.130298 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e9dfbfb0-05db-4566-85dd-414689c2f153 req-8019e281-dc10-4ef1-8a90-ad8988eff0ab tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0918536 Nov 02 12:59:10.131921 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-80b90fb2-c796-43f9-b8c9-ed472ee28f46 req-2ebda3dc-4c5a-4681-b132-ffd39d3115c8 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=a7cd13fe-71ea-4598-9aff-764b7f736afe HTTP/1.1" status: 200 len: 1001 time: 0.0865676 Nov 02 12:59:10.190772 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80b90fb2-c796-43f9-b8c9-ed472ee28f46 req-c13e7e3d-8d67-4f8d-ba41-def8b4ffdfae service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:10.192243 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-80b90fb2-c796-43f9-b8c9-ed472ee28f46 req-c13e7e3d-8d67-4f8d-ba41-def8b4ffdfae service neutron] 10.222.0.90 "GET /v2.0/subnets?id=ae24c2fe-abba-48cd-9d91-28a628d2ef95 HTTP/1.1" status: 200 len: 851 time: 0.0490792 Nov 02 12:59:10.241204 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80b90fb2-c796-43f9-b8c9-ed472ee28f46 req-9e81a39c-80c0-4f09-acb3-871a93b7329b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:10.242664 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-80b90fb2-c796-43f9-b8c9-ed472ee28f46 req-9e81a39c-80c0-4f09-acb3-871a93b7329b service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=89f406ae-1b9f-4be7-8881-87075d7c5aa1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0429795 Nov 02 12:59:10.341427 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-80b90fb2-c796-43f9-b8c9-ed472ee28f46 req-18893909-13b8-4812-8acf-65117a683025 service neutron] 10.222.0.90 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0906060 Nov 02 12:59:10.436732 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-80b90fb2-c796-43f9-b8c9-ed472ee28f46 req-4e2dd386-5338-4cca-a15b-4ffba70e7488 service neutron] 10.222.0.90 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0859859 Nov 02 12:59:11.248255 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b6fb1736-f635-47d3-a8e8-72f276db0699 req-086bf88c-0cb2-49a2-9de7-3f9736cac426 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:11.249734 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b6fb1736-f635-47d3-a8e8-72f276db0699 req-086bf88c-0cb2-49a2-9de7-3f9736cac426 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0502191 Nov 02 12:59:11.302524 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b6fb1736-f635-47d3-a8e8-72f276db0699 req-9608f6b4-a746-4bce-a2ed-ad351e579223 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0465405 Nov 02 12:59:12.424783 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a370547-dfab-49cd-a143-b24d45a7ee22 req-55c50865-76c4-4b7d-98c7-dd6854a3094f tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:12.426288 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8a370547-dfab-49cd-a143-b24d45a7ee22 req-55c50865-76c4-4b7d-98c7-dd6854a3094f tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0535369 Nov 02 12:59:12.477043 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8a370547-dfab-49cd-a143-b24d45a7ee22 req-bd54a8fc-6e48-41b4-b155-931d604756fa tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0444474 Nov 02 12:59:13.607284 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d6127c42-c0e3-4c07-aff3-bd8c0df7a7a2 req-829839f4-c7c2-4033-894f-f447ef584738 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:13.609417 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d6127c42-c0e3-4c07-aff3-bd8c0df7a7a2 req-829839f4-c7c2-4033-894f-f447ef584738 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0521326 Nov 02 12:59:13.666401 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d6127c42-c0e3-4c07-aff3-bd8c0df7a7a2 req-4239d8c2-4de8-42c5-830e-12e319cb845d tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0494518 Nov 02 12:59:14.134146 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3b94abb0-8169-4c3e-8dcb-ccc7a202738a req-5eb60a66-3fe3-45ca-9a6e-577e19a82927 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:14.135653 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3b94abb0-8169-4c3e-8dcb-ccc7a202738a req-5eb60a66-3fe3-45ca-9a6e-577e19a82927 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0568197 Nov 02 12:59:14.191562 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3b94abb0-8169-4c3e-8dcb-ccc7a202738a req-590d5a48-79f5-4675-bb41-9008d2e2c731 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0487628 Nov 02 12:59:14.317944 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a0d753c-1012-4f2f-9620-78447587549c req-2fa60f86-9d29-4088-99ba-8cc3f8558d70 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:14.319401 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7a0d753c-1012-4f2f-9620-78447587549c req-2fa60f86-9d29-4088-99ba-8cc3f8558d70 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=6064269d26644d27aaf12fd0ae66c0a9&device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 1099 time: 0.0448072 Nov 02 12:59:14.421551 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a0d753c-1012-4f2f-9620-78447587549c req-a7b71eaf-e2da-4b1b-a857-46eccceb8761 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:14.423408 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7a0d753c-1012-4f2f-9620-78447587549c req-a7b71eaf-e2da-4b1b-a857-46eccceb8761 service neutron] 10.222.0.90 "GET /v2.0/networks?id=4e122687-d2b4-4db2-bcc0-8820ad5e5b77 HTTP/1.1" status: 200 len: 912 time: 0.0950656 Nov 02 12:59:14.471905 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:59:14.515480 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7a0d753c-1012-4f2f-9620-78447587549c req-2faabdcf-455c-4ee6-b49a-840aef02d8b3 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=8001df2f-618b-4944-8995-ce83bb50997a HTTP/1.1" status: 200 len: 1001 time: 0.0795317 Nov 02 12:59:14.575293 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a0d753c-1012-4f2f-9620-78447587549c req-32896d9a-e4a4-4a07-951b-d9512ce88d74 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:14.576703 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7a0d753c-1012-4f2f-9620-78447587549c req-32896d9a-e4a4-4a07-951b-d9512ce88d74 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=0c2af8c2-0033-47ba-9f80-d43799d51067 HTTP/1.1" status: 200 len: 850 time: 0.0520551 Nov 02 12:59:14.940650 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a0d753c-1012-4f2f-9620-78447587549c req-ebc29122-cc88-4b91-a371-ce2b362069b2 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:14.942421 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7a0d753c-1012-4f2f-9620-78447587549c req-ebc29122-cc88-4b91-a371-ce2b362069b2 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=4e122687-d2b4-4db2-bcc0-8820ad5e5b77&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.3558247 Nov 02 12:59:15.039655 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7a0d753c-1012-4f2f-9620-78447587549c req-a48ef2fc-5621-4ed4-aaa4-031ca5ac8ffa service neutron] 10.222.0.90 "GET /v2.0/networks/4e122687-d2b4-4db2-bcc0-8820ad5e5b77?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0861337 Nov 02 12:59:15.148899 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7a0d753c-1012-4f2f-9620-78447587549c req-88937f77-82d9-4705-911d-718b2d02cb89 service neutron] 10.222.0.90 "GET /v2.0/networks/4e122687-d2b4-4db2-bcc0-8820ad5e5b77?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0978403 Nov 02 12:59:15.314244 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fdef94ab-5ff2-4ae1-85d2-f4ecbe507184 req-928f9be4-a444-4466-9b6e-52c74f52f59b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:15.315813 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fdef94ab-5ff2-4ae1-85d2-f4ecbe507184 req-928f9be4-a444-4466-9b6e-52c74f52f59b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0508082 Nov 02 12:59:15.367893 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fdef94ab-5ff2-4ae1-85d2-f4ecbe507184 req-68d21383-c5b6-42f0-bbf5-3d3ff1c99b94 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0455196 Nov 02 12:59:16.484374 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0baf5ed5-25e1-460c-a812-f05aa8c91070 req-2a9e1e03-f682-47fc-acab-35dad1c7928e tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:16.485983 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0baf5ed5-25e1-460c-a812-f05aa8c91070 req-2a9e1e03-f682-47fc-acab-35dad1c7928e tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0497999 Nov 02 12:59:16.539967 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0baf5ed5-25e1-460c-a812-f05aa8c91070 req-765c33ed-26a3-41ae-a857-3cd0e0e6cfc5 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0477250 Nov 02 12:59:23.496813 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-fc898e10-23a6-43a2-b4f9-5cb011cf99cd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:59:25.703283 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-32005328-cfe6-4c44-bd7e-535b07ba3ebc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:59:26.925523 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:59:28.371475 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:59:30.816298 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:59:33.451333 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:59:51.470769 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 12:59:53.491472 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-504bf76a-866d-4280-9a67-21870f304561 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:59:55.001992 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1254bb50-16de-456f-8328-4514311dab85 req-0606b4db-4126-4a55-b415-fd1ab8ffde98 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:55.003492 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1254bb50-16de-456f-8328-4514311dab85 req-0606b4db-4126-4a55-b415-fd1ab8ffde98 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0492156 Nov 02 12:59:55.051619 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1254bb50-16de-456f-8328-4514311dab85 req-c3225035-4d31-4b65-b23a-27332a7a19ab tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0418482 Nov 02 12:59:55.673567 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-57e1d92c-fe54-4a93-aa0e-e5e4bdabdeda None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:59:56.169930 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-54c80ef7-69d4-4877-8ca7-cdd047fe59d1 req-9872820c-caf8-4e72-ba6b-a432344b6fc4 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:56.171438 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-54c80ef7-69d4-4877-8ca7-cdd047fe59d1 req-9872820c-caf8-4e72-ba6b-a432344b6fc4 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0503030 Nov 02 12:59:56.219429 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-54c80ef7-69d4-4877-8ca7-cdd047fe59d1 req-a0c765ae-31da-46a8-83b8-b4c5b07a9a15 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0417631 Nov 02 12:59:56.879057 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:59:57.339011 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e2c068ad-17db-4914-8c09-1c680700bd2f req-7a9af409-59e5-40ed-9fdd-031770be2dff tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:57.340486 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e2c068ad-17db-4914-8c09-1c680700bd2f req-7a9af409-59e5-40ed-9fdd-031770be2dff tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0540280 Nov 02 12:59:57.387702 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e2c068ad-17db-4914-8c09-1c680700bd2f req-48b03ca8-7f41-481c-80cf-e8d475f3ef21 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0412042 Nov 02 12:59:58.353169 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 12:59:58.503205 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4063f823-893b-45e6-a6cb-d3b344bcbd11 req-091da05c-9e95-45ed-97ff-db61514d8608 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:58.505310 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4063f823-893b-45e6-a6cb-d3b344bcbd11 req-091da05c-9e95-45ed-97ff-db61514d8608 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0486777 Nov 02 12:59:58.552878 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4063f823-893b-45e6-a6cb-d3b344bcbd11 req-1d5a7dfd-fc1e-4c92-9580-814604e9eb71 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0413702 Nov 02 12:59:59.669775 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1ae97bed-1caa-4b92-aefc-545879ffefb1 req-9ddaca9c-b4ea-4601-83ce-3aa37214b6ab tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 12:59:59.671282 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1ae97bed-1caa-4b92-aefc-545879ffefb1 req-9ddaca9c-b4ea-4601-83ce-3aa37214b6ab tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0518594 Nov 02 12:59:59.722711 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1ae97bed-1caa-4b92-aefc-545879ffefb1 req-882b6ea5-5e3d-4185-8224-c7e4e13c3807 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0454512 Nov 02 13:00:00.804994 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:00.841583 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8a1cf5f8-dab4-45da-a366-8d382aa290e1 req-0dac4af5-61f0-4f2d-9557-2469191a9c7d tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:00.843107 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8a1cf5f8-dab4-45da-a366-8d382aa290e1 req-0dac4af5-61f0-4f2d-9557-2469191a9c7d tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0499115 Nov 02 13:00:00.891795 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8a1cf5f8-dab4-45da-a366-8d382aa290e1 req-06e05199-6b15-49c5-b2c7-a147069ef6d4 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0428417 Nov 02 13:00:02.005006 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-03ff12ba-5f74-46f6-bb2d-305553fa9de3 req-83585332-2b35-415c-9bb4-301138b02c59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:02.006479 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-03ff12ba-5f74-46f6-bb2d-305553fa9de3 req-83585332-2b35-415c-9bb4-301138b02c59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0492561 Nov 02 13:00:02.055564 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-03ff12ba-5f74-46f6-bb2d-305553fa9de3 req-b2336a3d-f3f6-441f-aaba-1422af0a745d tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0424635 Nov 02 13:00:03.176552 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-e3f0f2df-1b40-4521-abab-61d875b83198 req-28ca1de9-138b-4117-937a-394c64d068c1 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:03.178032 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e3f0f2df-1b40-4521-abab-61d875b83198 req-28ca1de9-138b-4117-937a-394c64d068c1 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0530288 Nov 02 13:00:03.229851 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e3f0f2df-1b40-4521-abab-61d875b83198 req-acce5b43-3435-4bf0-bf31-9e713cdf9a97 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0458417 Nov 02 13:00:03.455865 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:04.343877 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-467b78ec-126d-4119-8cba-aac2c4bb45a4 req-0f5cd5c5-1ecb-48f2-a4a0-d501aa1429dc tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:04.345334 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-467b78ec-126d-4119-8cba-aac2c4bb45a4 req-0f5cd5c5-1ecb-48f2-a4a0-d501aa1429dc tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0478983 Nov 02 13:00:04.391718 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-467b78ec-126d-4119-8cba-aac2c4bb45a4 req-bf78d154-276c-436c-989f-477e10e0c304 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0404737 Nov 02 13:00:05.518539 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4950fc2b-964a-4e7b-a458-4cafab4883cd req-99f7cdf6-3618-49d7-aa54-a0aeac5ce1ee tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:05.520233 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4950fc2b-964a-4e7b-a458-4cafab4883cd req-99f7cdf6-3618-49d7-aa54-a0aeac5ce1ee tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0590651 Nov 02 13:00:05.578758 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4950fc2b-964a-4e7b-a458-4cafab4883cd req-9b391d7a-25d2-4846-bef5-d7be599d6f97 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0520437 Nov 02 13:00:06.696126 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-850b321e-d324-459c-a383-998d2bdc6458 req-0c06e319-e842-4119-8b96-50de0df90097 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:06.697522 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-850b321e-d324-459c-a383-998d2bdc6458 req-0c06e319-e842-4119-8b96-50de0df90097 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0503693 Nov 02 13:00:06.751872 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-850b321e-d324-459c-a383-998d2bdc6458 req-c6e0d36a-3a9a-4ae3-939e-a4e079000364 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0482724 Nov 02 13:00:07.181690 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a3e4485-e3db-4c53-8e5f-9c39ad2c976d req-9e1f07f4-5137-4d72-80fa-9b8fbb9bb923 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:07.183174 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3a3e4485-e3db-4c53-8e5f-9c39ad2c976d req-9e1f07f4-5137-4d72-80fa-9b8fbb9bb923 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0503314 Nov 02 13:00:07.233811 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3a3e4485-e3db-4c53-8e5f-9c39ad2c976d req-a4c1ee50-06df-4390-9de3-374b0a2fe7aa tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440536 Nov 02 13:00:07.423177 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a146ca95-9367-4814-a7ad-3204e44979df req-da8ad697-cad1-4c24-8286-2bc6d081cb1c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:07.424668 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a146ca95-9367-4814-a7ad-3204e44979df req-da8ad697-cad1-4c24-8286-2bc6d081cb1c service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=6064269d26644d27aaf12fd0ae66c0a9&device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 1099 time: 0.0841446 Nov 02 13:00:07.519816 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a146ca95-9367-4814-a7ad-3204e44979df req-9b7b7d32-442a-44b9-b1cc-10c775448408 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:07.521285 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a146ca95-9367-4814-a7ad-3204e44979df req-9b7b7d32-442a-44b9-b1cc-10c775448408 service neutron] 10.222.0.90 "GET /v2.0/networks?id=4e122687-d2b4-4db2-bcc0-8820ad5e5b77 HTTP/1.1" status: 200 len: 912 time: 0.0873671 Nov 02 13:00:07.596921 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a146ca95-9367-4814-a7ad-3204e44979df req-5cc79de1-b0d5-4b36-85d2-33d91e2e5b6e service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=8001df2f-618b-4944-8995-ce83bb50997a HTTP/1.1" status: 200 len: 1001 time: 0.0633700 Nov 02 13:00:07.655542 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a146ca95-9367-4814-a7ad-3204e44979df req-0a98a983-23c8-4bb5-9325-daa2c68ab497 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:07.657011 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a146ca95-9367-4814-a7ad-3204e44979df req-0a98a983-23c8-4bb5-9325-daa2c68ab497 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=0c2af8c2-0033-47ba-9f80-d43799d51067 HTTP/1.1" status: 200 len: 850 time: 0.0468042 Nov 02 13:00:07.709834 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a146ca95-9367-4814-a7ad-3204e44979df req-32e2e936-3985-441d-8bc8-da63ce004df1 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:07.711398 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a146ca95-9367-4814-a7ad-3204e44979df req-32e2e936-3985-441d-8bc8-da63ce004df1 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=4e122687-d2b4-4db2-bcc0-8820ad5e5b77&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0411930 Nov 02 13:00:07.729399 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [req-a146ca95-9367-4814-a7ad-3204e44979df req-8e6c6b64-b4b4-4a6a-b6f1-e7e7135acc58 service neutron] http://10.222.0.98:9696/v2.0/extensions returned with HTTP 200 {{(pid=108543) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 02 13:00:07.730409 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a146ca95-9367-4814-a7ad-3204e44979df req-8e6c6b64-b4b4-4a6a-b6f1-e7e7135acc58 service neutron] 10.222.0.90 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13869 time: 0.0050931 Nov 02 13:00:07.831711 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a146ca95-9367-4814-a7ad-3204e44979df req-d3bc89a1-9d96-4ab6-8dae-a37e3a826236 service neutron] 10.222.0.90 "GET /v2.0/networks/4e122687-d2b4-4db2-bcc0-8820ad5e5b77?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0881898 Nov 02 13:00:07.934142 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a146ca95-9367-4814-a7ad-3204e44979df req-d5d77b5c-b761-460f-9057-d590036bdd9d service neutron] 10.222.0.90 "GET /v2.0/networks/4e122687-d2b4-4db2-bcc0-8820ad5e5b77?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0895765 Nov 02 13:00:08.353915 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ad4058de-f19a-4683-95ec-ec064ab74e4b req-fd82a7b3-811a-41b7-bae2-3c152340155e tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:08.356076 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ad4058de-f19a-4683-95ec-ec064ab74e4b req-fd82a7b3-811a-41b7-bae2-3c152340155e tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0513945 Nov 02 13:00:08.404432 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ad4058de-f19a-4683-95ec-ec064ab74e4b req-ce2fb2ac-9d85-4c65-ba47-83e56f964e3b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0425568 Nov 02 13:00:09.525004 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-52560e05-4c88-486c-80a4-821ca8fd517b req-c7019136-42d2-4bce-9d2a-d00b15335456 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:09.526650 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-52560e05-4c88-486c-80a4-821ca8fd517b req-c7019136-42d2-4bce-9d2a-d00b15335456 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0528898 Nov 02 13:00:09.576427 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-52560e05-4c88-486c-80a4-821ca8fd517b req-8699448f-d28d-4ac0-918d-c0e727a75ec0 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429842 Nov 02 13:00:10.774246 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c184a7e0-763f-4de3-bfcd-1e2e708e147f req-16edab44-74b6-4ed6-8057-5fdc7accb064 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0438321 Nov 02 13:00:10.838211 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c184a7e0-763f-4de3-bfcd-1e2e708e147f req-e620dad4-de7d-4e6a-928b-b785168257ac service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:10.841356 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c184a7e0-763f-4de3-bfcd-1e2e708e147f req-e620dad4-de7d-4e6a-928b-b785168257ac service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=6064269d26644d27aaf12fd0ae66c0a9&device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 1099 time: 0.0446770 Nov 02 13:00:10.951543 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c184a7e0-763f-4de3-bfcd-1e2e708e147f req-5823511b-88e0-484d-baa8-74cd4de66208 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:10.953009 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c184a7e0-763f-4de3-bfcd-1e2e708e147f req-5823511b-88e0-484d-baa8-74cd4de66208 service neutron] 10.222.0.90 "GET /v2.0/networks?id=4e122687-d2b4-4db2-bcc0-8820ad5e5b77 HTTP/1.1" status: 200 len: 912 time: 0.0891464 Nov 02 13:00:11.025524 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c184a7e0-763f-4de3-bfcd-1e2e708e147f req-8b8e55e6-d6c1-425d-8b47-702f22d5006f service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.10&port_id=8001df2f-618b-4944-8995-ce83bb50997a HTTP/1.1" status: 200 len: 1001 time: 0.0645540 Nov 02 13:00:11.076388 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c184a7e0-763f-4de3-bfcd-1e2e708e147f req-21a01db7-9764-4248-a14a-acef84132e8f service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:11.077990 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c184a7e0-763f-4de3-bfcd-1e2e708e147f req-21a01db7-9764-4248-a14a-acef84132e8f service neutron] 10.222.0.90 "GET /v2.0/subnets?id=0c2af8c2-0033-47ba-9f80-d43799d51067 HTTP/1.1" status: 200 len: 850 time: 0.0455251 Nov 02 13:00:11.123894 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c184a7e0-763f-4de3-bfcd-1e2e708e147f req-886ebd3a-481f-4016-ba21-9b0277982248 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:11.125357 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c184a7e0-763f-4de3-bfcd-1e2e708e147f req-886ebd3a-481f-4016-ba21-9b0277982248 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=4e122687-d2b4-4db2-bcc0-8820ad5e5b77&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0398853 Nov 02 13:00:11.221928 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c184a7e0-763f-4de3-bfcd-1e2e708e147f req-56ad42dc-ca92-4196-b7f6-21f48d2f50e6 service neutron] 10.222.0.90 "GET /v2.0/networks/4e122687-d2b4-4db2-bcc0-8820ad5e5b77?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0894504 Nov 02 13:00:11.318213 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c184a7e0-763f-4de3-bfcd-1e2e708e147f req-01c51b79-6e46-439e-9a1e-8fc97b6ef98c service neutron] 10.222.0.90 "GET /v2.0/networks/4e122687-d2b4-4db2-bcc0-8820ad5e5b77?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0879288 Nov 02 13:00:23.529870 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-477e4580-2d07-4347-be46-4a00781cc19e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:25.638324 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-43c08d9c-118a-4be7-bf2d-b500d9c89c79 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:26.878188 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:28.400032 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:28.469957 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 13:00:30.815754 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:33.449331 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:35.491986 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 35914) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:00:35.689794 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-aa39114f-ce38-47b4-87c2-bd1c61a86b5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Deleting port d6c77673-6a3d-4168-957c-98298662e774 {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:00:35.690135 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-aa39114f-ce38-47b4-87c2-bd1c61a86b5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:35.771523 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-aa39114f-ce38-47b4-87c2-bd1c61a86b5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:35.771772 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-aa39114f-ce38-47b4-87c2-bd1c61a86b5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:35.793635 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-aa39114f-ce38-47b4-87c2-bd1c61a86b5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Calling delete_port for d6c77673-6a3d-4168-957c-98298662e774 owned by network:floatingip {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:00:36.009509 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-aa39114f-ce38-47b4-87c2-bd1c61a86b5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:36.034445 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aa39114f-ce38-47b4-87c2-bd1c61a86b5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Pushing event deleted for resources: {'Port': ['ID=d6c77673-6a3d-4168-957c-98298662e774,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:00:36.048052 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa39114f-ce38-47b4-87c2-bd1c61a86b5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:36.048404 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa39114f-ce38-47b4-87c2-bd1c61a86b5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:36.048748 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa39114f-ce38-47b4-87c2-bd1c61a86b5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:36.049084 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa39114f-ce38-47b4-87c2-bd1c61a86b5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:36.049418 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa39114f-ce38-47b4-87c2-bd1c61a86b5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:36.049751 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa39114f-ce38-47b4-87c2-bd1c61a86b5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:36.050076 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa39114f-ce38-47b4-87c2-bd1c61a86b5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:36.050497 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa39114f-ce38-47b4-87c2-bd1c61a86b5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:36.050826 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa39114f-ce38-47b4-87c2-bd1c61a86b5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:36.051151 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa39114f-ce38-47b4-87c2-bd1c61a86b5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:36.051486 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa39114f-ce38-47b4-87c2-bd1c61a86b5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:36.051805 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-aa39114f-ce38-47b4-87c2-bd1c61a86b5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:36.113287 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-aa39114f-ce38-47b4-87c2-bd1c61a86b5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for floatingip, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:36.113287 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.db.l3_db [None req-aa39114f-ce38-47b4-87c2-bd1c61a86b5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Floating IP 1c504a47-4c8b-4d0d-a631-4b18b01ede1a disassociated (deleted). External IP: 172.27.0.134, port: 81425ddb-f216-49de-bb01-7167c8d68e37. Nov 02 13:00:36.331261 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-aa39114f-ce38-47b4-87c2-bd1c61a86b5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108543) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 13:00:36.443391 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-aa39114f-ce38-47b4-87c2-bd1c61a86b5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108543) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 13:00:36.448910 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-aa39114f-ce38-47b4-87c2-bd1c61a86b5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for floatingip, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:36.453659 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80c656d3-6496-4e80-afea-a574ffc51234 None None] Sync routers for ids ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'] in dv-cinder-816324-1-iscsi {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 13:00:36.465310 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80c656d3-6496-4e80-afea-a574ffc51234 None None] Routers {'2a2f63fd-e512-4ad2-9007-46e6ab6e8134'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:00:36.465844 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-80c656d3-6496-4e80-afea-a574ffc51234 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:00:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:00:36.480843 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-aa39114f-ce38-47b4-87c2-bd1c61a86b5a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "DELETE /v2.0/floatingips/1c504a47-4c8b-4d0d-a631-4b18b01ede1a HTTP/1.1" status: 204 len: 168 time: 0.9876781 Nov 02 13:00:36.481422 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': 'd9fae7d7-92b6-4dd7-ae9a-6655ae481917', 'tag': '81425ddb-f216-49de-bb01-7167c8d68e37'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 13:00:36.483790 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-f0b5d0b6-fbe8-4149-9450-9bfab96636cd" -d '{"events": [{"name": "network-changed", "server_uuid": "d9fae7d7-92b6-4dd7-ae9a-6655ae481917", "tag": "81425ddb-f216-49de-bb01-7167c8d68e37"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 13:00:36.529128 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 13:00:36 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-cecc3a19-8efe-4061-a27a-b298fe82d5fa x-openstack-request-id: req-cecc3a19-8efe-4061-a27a-b298fe82d5fa {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 13:00:36.529719 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "d9fae7d7-92b6-4dd7-ae9a-6655ae481917", "tag": "81425ddb-f216-49de-bb01-7167c8d68e37", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 13:00:36.529719 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-cecc3a19-8efe-4061-a27a-b298fe82d5fa {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 13:00:36.530360 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': 'd9fae7d7-92b6-4dd7-ae9a-6655ae481917', 'tag': '81425ddb-f216-49de-bb01-7167c8d68e37', 'status': 'completed', 'code': 200} Nov 02 13:00:36.580982 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-80c656d3-6496-4e80-afea-a574ffc51234 None None] Set router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:00:36.595179 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0b5d0b6-fbe8-4149-9450-9bfab96636cd req-8fe66ea5-01c3-4398-8f08-b80a1799540e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:36.596599 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f0b5d0b6-fbe8-4149-9450-9bfab96636cd req-8fe66ea5-01c3-4398-8f08-b80a1799540e service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=697de566c0334435b902950f6f31da45&device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 1099 time: 0.0445249 Nov 02 13:00:36.715922 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0b5d0b6-fbe8-4149-9450-9bfab96636cd req-31f4afc2-90f5-4952-8ed5-48badaa882ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:36.717461 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f0b5d0b6-fbe8-4149-9450-9bfab96636cd req-31f4afc2-90f5-4952-8ed5-48badaa882ff service neutron] 10.222.0.90 "GET /v2.0/networks?id=89f406ae-1b9f-4be7-8881-87075d7c5aa1 HTTP/1.1" status: 200 len: 913 time: 0.1082146 Nov 02 13:00:36.760564 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f0b5d0b6-fbe8-4149-9450-9bfab96636cd req-1a489344-7945-496b-afd0-fd2c106c5db3 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.12&port_id=81425ddb-f216-49de-bb01-7167c8d68e37 HTTP/1.1" status: 200 len: 217 time: 0.0355628 Nov 02 13:00:36.811934 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0b5d0b6-fbe8-4149-9450-9bfab96636cd req-c74edf97-787f-43d9-932a-72690608e3d0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:36.813448 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f0b5d0b6-fbe8-4149-9450-9bfab96636cd req-c74edf97-787f-43d9-932a-72690608e3d0 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=ae24c2fe-abba-48cd-9d91-28a628d2ef95 HTTP/1.1" status: 200 len: 851 time: 0.0459559 Nov 02 13:00:36.828856 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-80c656d3-6496-4e80-afea-a574ffc51234 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port': {'id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:1f:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:31Z', 'updated_at': '2021-11-02T12:51:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': '5fd4585f-d4f7-4f9e-971e-e5d255fd0c1d', 'tenant_id': '697de566c0334435b902950f6f31da45', 'floating_ip_address': '172.27.0.37', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'port_id': 'a7cd13fe-71ea-4598-9aff-764b7f736afe', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 584, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'mac_address': 'fa:16:3e:e9:fc:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93ad83e9-3682-4f82-b83f-f511d5942f94', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:56:33Z', 'updated_at': '2021-11-02T12:56:35Z', 'revision_number': 1, 'project_id': '697de566c0334435b902950f6f31da45', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '80a55893-6272-4299-8834-e840aa37d37b', 'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'tenant_id': '697de566c0334435b902950f6f31da45', 'mac_address': 'fa:16:3e:64:ef:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_interface', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:48Z', 'updated_at': '2021-11-02T12:52:07Z', 'revision_number': 5, 'project_id': '697de566c0334435b902950f6f31da45', 'subnets': [{'id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:00:36.856228 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80c656d3-6496-4e80-afea-a574ffc51234 None None] Checking router: 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 for host: dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 13:00:36.861131 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f0b5d0b6-fbe8-4149-9450-9bfab96636cd req-bd008f35-1239-4239-b536-9f15ef074de8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:36.862683 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f0b5d0b6-fbe8-4149-9450-9bfab96636cd req-bd008f35-1239-4239-b536-9f15ef074de8 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=89f406ae-1b9f-4be7-8881-87075d7c5aa1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0419776 Nov 02 13:00:36.864571 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-80c656d3-6496-4e80-afea-a574ffc51234 None None] Routers {'2a2f63fd-e512-4ad2-9007-46e6ab6e8134'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:00:36.865188 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-80c656d3-6496-4e80-afea-a574ffc51234 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:00:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:00:36.978122 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f0b5d0b6-fbe8-4149-9450-9bfab96636cd req-45bf20ba-07ab-4d28-99b5-cfeea3193f02 service neutron] 10.222.0.90 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1070669 Nov 02 13:00:37.006912 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-80c656d3-6496-4e80-afea-a574ffc51234 None None] Set router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:00:37.101187 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3ca47044-daaf-410e-978a-49f159d61634 req-aaafc420-0440-41f7-a1b0-8df2c9d26b9f tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:37.102782 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3ca47044-daaf-410e-978a-49f159d61634 req-aaafc420-0440-41f7-a1b0-8df2c9d26b9f tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 946 time: 0.1088386 Nov 02 13:00:37.131502 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f0b5d0b6-fbe8-4149-9450-9bfab96636cd req-be891ae6-6912-4d2f-86c3-320547e58767 service neutron] 10.222.0.90 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1453097 Nov 02 13:00:37.164968 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3ca47044-daaf-410e-978a-49f159d61634 req-980af410-fc51-4f69-b870-9f9c41c2e13b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0553796 Nov 02 13:00:37.244700 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-80c656d3-6496-4e80-afea-a574ffc51234 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port': {'id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:1f:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:31Z', 'updated_at': '2021-11-02T12:51:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': '5fd4585f-d4f7-4f9e-971e-e5d255fd0c1d', 'tenant_id': '697de566c0334435b902950f6f31da45', 'floating_ip_address': '172.27.0.37', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'port_id': 'a7cd13fe-71ea-4598-9aff-764b7f736afe', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 584, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'mac_address': 'fa:16:3e:e9:fc:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93ad83e9-3682-4f82-b83f-f511d5942f94', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:56:33Z', 'updated_at': '2021-11-02T12:56:35Z', 'revision_number': 1, 'project_id': '697de566c0334435b902950f6f31da45', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '80a55893-6272-4299-8834-e840aa37d37b', 'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'tenant_id': '697de566c0334435b902950f6f31da45', 'mac_address': 'fa:16:3e:64:ef:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_interface', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:48Z', 'updated_at': '2021-11-02T12:52:07Z', 'revision_number': 5, 'project_id': '697de566c0334435b902950f6f31da45', 'subnets': [{'id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:00:37.271485 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-80c656d3-6496-4e80-afea-a574ffc51234 None None] The sync data for ids ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'] in dv-cinder-816324-1-iscsi is: [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port': {'id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:1f:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:31Z', 'updated_at': '2021-11-02T12:51:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': '5fd4585f-d4f7-4f9e-971e-e5d255fd0c1d', 'tenant_id': '697de566c0334435b902950f6f31da45', 'floating_ip_address': '172.27.0.37', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'port_id': 'a7cd13fe-71ea-4598-9aff-764b7f736afe', 'fixed_ip_address': '172.20.0.13', 'status': 'ACTIVE', 'standard_attr_id': 584, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'mac_address': 'fa:16:3e:e9:fc:c4', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '93ad83e9-3682-4f82-b83f-f511d5942f94', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T12:56:33Z', 'updated_at': '2021-11-02T12:56:35Z', 'revision_number': 1, 'project_id': '697de566c0334435b902950f6f31da45', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '80a55893-6272-4299-8834-e840aa37d37b', 'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'tenant_id': '697de566c0334435b902950f6f31da45', 'mac_address': 'fa:16:3e:64:ef:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_interface', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:48Z', 'updated_at': '2021-11-02T12:52:07Z', 'revision_number': 5, 'project_id': '697de566c0334435b902950f6f31da45', 'subnets': [{'id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 13:00:37.518626 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-f6f82ac5-20d8-4339-91fe-742209556ed3 None None] New status for floating IP 1c504a47-4c8b-4d0d-a631-4b18b01ede1a: DOWN {{(pid=108544) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 02 13:00:38.284659 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-71e2efae-0a07-4a30-a50a-6a551f2567e6 req-456b34c3-1d09-454e-965b-3e0d31de1cd3 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:38.286127 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-71e2efae-0a07-4a30-a50a-6a551f2567e6 req-456b34c3-1d09-454e-965b-3e0d31de1cd3 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 946 time: 0.0481594 Nov 02 13:00:38.339659 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-71e2efae-0a07-4a30-a50a-6a551f2567e6 req-6bfb758f-3de7-4003-8290-fd433ce29e12 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0475552 Nov 02 13:00:38.666604 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ff55955c-5230-4917-8cc2-446388f7e02c req-077f56be-dd42-4a26-b457-5887f1044a49 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:38.668559 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ff55955c-5230-4917-8cc2-446388f7e02c req-077f56be-dd42-4a26-b457-5887f1044a49 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.90 "GET /v2.0/ports?device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 946 time: 0.0498888 Nov 02 13:00:38.769631 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-ff55955c-5230-4917-8cc2-446388f7e02c req-4290d51b-3fbb-4fbe-a504-4c808758def7 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Deleting port 81425ddb-f216-49de-bb01-7167c8d68e37 {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:00:38.769920 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ff55955c-5230-4917-8cc2-446388f7e02c req-4290d51b-3fbb-4fbe-a504-4c808758def7 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:38.863299 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-ff55955c-5230-4917-8cc2-446388f7e02c req-4290d51b-3fbb-4fbe-a504-4c808758def7 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] For port 81425ddb-f216-49de-bb01-7167c8d68e37, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=81425ddb-f216-49de-bb01-7167c8d68e37,segment=NetworkSegment(c8ecb7dc-9cc8-47a7-94e7-62f066a97c10),segment_id=c8ecb7dc-9cc8-47a7-94e7-62f066a97c10)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:00:38.863661 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ff55955c-5230-4917-8cc2-446388f7e02c req-4290d51b-3fbb-4fbe-a504-4c808758def7 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:38.877652 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-ff55955c-5230-4917-8cc2-446388f7e02c req-4290d51b-3fbb-4fbe-a504-4c808758def7 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Calling delete_port for 81425ddb-f216-49de-bb01-7167c8d68e37 owned by compute:nova {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:00:39.118435 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ff55955c-5230-4917-8cc2-446388f7e02c req-4290d51b-3fbb-4fbe-a504-4c808758def7 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:39.148795 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4290d51b-3fbb-4fbe-a504-4c808758def7 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Pushing event deleted for resources: {'Port': ['ID=81425ddb-f216-49de-bb01-7167c8d68e37,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:00:39.189468 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-ff55955c-5230-4917-8cc2-446388f7e02c req-4290d51b-3fbb-4fbe-a504-4c808758def7 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] No DVR routers for this DVR port 81425ddb-f216-49de-bb01-7167c8d68e37 on host hv-cinder-81632 {{(pid=108543) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 13:00:39.192203 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ff55955c-5230-4917-8cc2-446388f7e02c req-4290d51b-3fbb-4fbe-a504-4c808758def7 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:39.195536 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ff55955c-5230-4917-8cc2-446388f7e02c req-4290d51b-3fbb-4fbe-a504-4c808758def7 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.90 "DELETE /v2.0/ports/81425ddb-f216-49de-bb01-7167c8d68e37 HTTP/1.1" status: 204 len: 173 time: 0.5184577 Nov 02 13:00:39.195977 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'd9fae7d7-92b6-4dd7-ae9a-6655ae481917', 'name': 'network-vif-deleted', 'tag': '81425ddb-f216-49de-bb01-7167c8d68e37'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 13:00:39.198730 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a7dc0fdd-cda6-48cb-bf72-4e5b9e525537" -d '{"events": [{"server_uuid": "d9fae7d7-92b6-4dd7-ae9a-6655ae481917", "name": "network-vif-deleted", "tag": "81425ddb-f216-49de-bb01-7167c8d68e37"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 13:00:39.235630 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 13:00:39 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-ff04fef5-2cf4-4f6e-8169-0e7cfcf6cddc x-openstack-request-id: req-ff04fef5-2cf4-4f6e-8169-0e7cfcf6cddc {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 13:00:39.235964 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "d9fae7d7-92b6-4dd7-ae9a-6655ae481917", "name": "network-vif-deleted", "tag": "81425ddb-f216-49de-bb01-7167c8d68e37", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 13:00:39.236201 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-ff04fef5-2cf4-4f6e-8169-0e7cfcf6cddc {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 13:00:39.236626 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'd9fae7d7-92b6-4dd7-ae9a-6655ae481917', 'name': 'network-vif-deleted', 'tag': '81425ddb-f216-49de-bb01-7167c8d68e37', 'status': 'completed', 'code': 200} Nov 02 13:00:39.438685 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4adf524b-57d5-4857-9577-66a05127e140 req-5cb205f5-4248-424b-8184-a1a4096ef902 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 210 time: 0.0264435 Nov 02 13:00:40.549252 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b3de74d4-4b98-4cb2-adfd-24898aaf0d8d req-80ef546d-9648-4d11-b51b-56fc9e9dcab0 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=d9fae7d7-92b6-4dd7-ae9a-6655ae481917 HTTP/1.1" status: 200 len: 210 time: 0.0290704 Nov 02 13:00:41.930067 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 81425ddb-f216-49de-bb01-7167c8d68e37 no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 13:00:41.951385 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] No Port match for: 81425ddb-f216-49de-bb01-7167c8d68e37 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 13:00:41.951722 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 81425ddb-f216-49de-bb01-7167c8d68e37 not bound to the agent host hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 13:00:43.326542 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-3a3c5129-54ed-4bef-8b88-c5771c367f3a req-7b0db9b6-e2b0-4deb-a0bc-2d17d609f742 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:43.328080 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3a3c5129-54ed-4bef-8b88-c5771c367f3a req-7b0db9b6-e2b0-4deb-a0bc-2d17d609f742 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0560582 Nov 02 13:00:43.378160 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3a3c5129-54ed-4bef-8b88-c5771c367f3a req-c2c18e70-bbaf-458c-ac7a-457c5bbbff2f tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0430086 Nov 02 13:00:44.131824 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 35958) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:00:44.300223 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-394ed895-c94c-4e9b-87d5-1fdfbbbe771b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Deleting port 7b92754b-5682-48b4-a9c5-cced29cd2261 {{(pid=108542) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:00:44.300579 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-394ed895-c94c-4e9b-87d5-1fdfbbbe771b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:44.377664 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-394ed895-c94c-4e9b-87d5-1fdfbbbe771b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:44.377934 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-394ed895-c94c-4e9b-87d5-1fdfbbbe771b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:44.390840 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-394ed895-c94c-4e9b-87d5-1fdfbbbe771b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Calling delete_port for 7b92754b-5682-48b4-a9c5-cced29cd2261 owned by network:floatingip {{(pid=108542) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:00:44.501163 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0f162faa-a26b-4088-9009-5e0831f067a0 req-0eee8a31-e768-42e5-bc53-bffaab3aca2c tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:44.502712 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0f162faa-a26b-4088-9009-5e0831f067a0 req-0eee8a31-e768-42e5-bc53-bffaab3aca2c tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0521128 Nov 02 13:00:44.553706 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0f162faa-a26b-4088-9009-5e0831f067a0 req-1b124397-0e4b-4a6c-aeef-44026213e17f tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0440776 Nov 02 13:00:44.678140 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-394ed895-c94c-4e9b-87d5-1fdfbbbe771b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:44.707949 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-394ed895-c94c-4e9b-87d5-1fdfbbbe771b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Pushing event deleted for resources: {'Port': ['ID=7b92754b-5682-48b4-a9c5-cced29cd2261,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:00:44.720151 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-394ed895-c94c-4e9b-87d5-1fdfbbbe771b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:44.720498 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-394ed895-c94c-4e9b-87d5-1fdfbbbe771b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:44.720836 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-394ed895-c94c-4e9b-87d5-1fdfbbbe771b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:44.721168 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-394ed895-c94c-4e9b-87d5-1fdfbbbe771b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:44.721625 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-394ed895-c94c-4e9b-87d5-1fdfbbbe771b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:44.721954 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-394ed895-c94c-4e9b-87d5-1fdfbbbe771b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:44.722282 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-394ed895-c94c-4e9b-87d5-1fdfbbbe771b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:44.722634 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-394ed895-c94c-4e9b-87d5-1fdfbbbe771b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:44.722958 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-394ed895-c94c-4e9b-87d5-1fdfbbbe771b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:44.723277 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-394ed895-c94c-4e9b-87d5-1fdfbbbe771b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:44.723596 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-394ed895-c94c-4e9b-87d5-1fdfbbbe771b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:44.723913 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-394ed895-c94c-4e9b-87d5-1fdfbbbe771b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:44.778110 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-394ed895-c94c-4e9b-87d5-1fdfbbbe771b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for floatingip, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:44.778457 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.db.l3_db [None req-394ed895-c94c-4e9b-87d5-1fdfbbbe771b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Floating IP 5fd4585f-d4f7-4f9e-971e-e5d255fd0c1d disassociated (deleted). External IP: 172.27.0.37, port: a7cd13fe-71ea-4598-9aff-764b7f736afe. Nov 02 13:00:44.990705 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-394ed895-c94c-4e9b-87d5-1fdfbbbe771b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108542) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 13:00:45.445587 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-394ed895-c94c-4e9b-87d5-1fdfbbbe771b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108542) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 13:00:45.450432 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-394ed895-c94c-4e9b-87d5-1fdfbbbe771b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for floatingip, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:45.455264 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ccc709d-2523-4bd1-af4f-b538214b0479 None None] Sync routers for ids ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'] in dv-cinder-816324-1-iscsi {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 13:00:45.466911 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ccc709d-2523-4bd1-af4f-b538214b0479 None None] Routers {'2a2f63fd-e512-4ad2-9007-46e6ab6e8134'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:00:45.467533 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-6ccc709d-2523-4bd1-af4f-b538214b0479 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:00:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:00:45.486409 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-394ed895-c94c-4e9b-87d5-1fdfbbbe771b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "DELETE /v2.0/floatingips/5fd4585f-d4f7-4f9e-971e-e5d255fd0c1d HTTP/1.1" status: 204 len: 168 time: 1.3489630 Nov 02 13:00:45.486409 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '93ad83e9-3682-4f82-b83f-f511d5942f94', 'tag': 'a7cd13fe-71ea-4598-9aff-764b7f736afe'}] {{(pid=108542) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 13:00:45.486409 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8fdc2194739644bb754d6b187539f80d2eba7dc5c5d5392f1a2d22d03c0a316c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-68cf5cf0-31ab-40bb-b18d-4f3bdd2d3091" -d '{"events": [{"name": "network-changed", "server_uuid": "93ad83e9-3682-4f82-b83f-f511d5942f94", "tag": "a7cd13fe-71ea-4598-9aff-764b7f736afe"}]}' {{(pid=108542) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 13:00:45.546509 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 13:00:45 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-d0747236-2b93-4984-8733-4e7b82c1f60a x-openstack-request-id: req-d0747236-2b93-4984-8733-4e7b82c1f60a {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 13:00:45.547088 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "93ad83e9-3682-4f82-b83f-f511d5942f94", "tag": "a7cd13fe-71ea-4598-9aff-764b7f736afe", "status": "completed", "code": 200}]} {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 13:00:45.547565 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-d0747236-2b93-4984-8733-4e7b82c1f60a {{(pid=108542) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 13:00:45.548169 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '93ad83e9-3682-4f82-b83f-f511d5942f94', 'tag': 'a7cd13fe-71ea-4598-9aff-764b7f736afe', 'status': 'completed', 'code': 200} Nov 02 13:00:45.559449 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4487f463-cc7f-42d7-bd72-2bf1cba6e951 req-f4cd72e1-2cdb-4bc6-b76b-b975a5094879 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:45.562329 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4487f463-cc7f-42d7-bd72-2bf1cba6e951 req-f4cd72e1-2cdb-4bc6-b76b-b975a5094879 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.90 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.1029701 Nov 02 13:00:45.603796 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-6ccc709d-2523-4bd1-af4f-b538214b0479 None None] Set router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:00:45.642136 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68cf5cf0-31ab-40bb-b18d-4f3bdd2d3091 req-1625fd44-f778-403f-82b6-28c7ffeb9e39 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:45.644174 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-68cf5cf0-31ab-40bb-b18d-4f3bdd2d3091 req-1625fd44-f778-403f-82b6-28c7ffeb9e39 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=697de566c0334435b902950f6f31da45&device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 1099 time: 0.0656402 Nov 02 13:00:45.769985 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-76655b76-de55-4f9e-9371-a6a5ee25d9fc req-e73c09e1-237c-4eb0-acb2-201e270707e4 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:45.771397 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-76655b76-de55-4f9e-9371-a6a5ee25d9fc req-e73c09e1-237c-4eb0-acb2-201e270707e4 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 946 time: 0.0897477 Nov 02 13:00:45.777097 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68cf5cf0-31ab-40bb-b18d-4f3bdd2d3091 req-b169c50d-cdea-4ce0-8aa3-ff2aa5c7a6fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:45.778604 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-68cf5cf0-31ab-40bb-b18d-4f3bdd2d3091 req-b169c50d-cdea-4ce0-8aa3-ff2aa5c7a6fb service neutron] 10.222.0.90 "GET /v2.0/networks?id=89f406ae-1b9f-4be7-8881-87075d7c5aa1 HTTP/1.1" status: 200 len: 913 time: 0.1200361 Nov 02 13:00:45.790550 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-4487f463-cc7f-42d7-bd72-2bf1cba6e951 req-31acd2f5-f776-4419-b1b0-12b506dbd32b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Deleting port 8001df2f-618b-4944-8995-ce83bb50997a {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:00:45.791515 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-4487f463-cc7f-42d7-bd72-2bf1cba6e951 req-31acd2f5-f776-4419-b1b0-12b506dbd32b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:45.846487 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-68cf5cf0-31ab-40bb-b18d-4f3bdd2d3091 req-bbb84392-8cd8-4f3d-8970-fe28b05bcea5 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.13&port_id=a7cd13fe-71ea-4598-9aff-764b7f736afe HTTP/1.1" status: 200 len: 217 time: 0.0453515 Nov 02 13:00:45.854736 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-6ccc709d-2523-4bd1-af4f-b538214b0479 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port': {'id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:1f:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:31Z', 'updated_at': '2021-11-02T12:51:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '80a55893-6272-4299-8834-e840aa37d37b', 'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'tenant_id': '697de566c0334435b902950f6f31da45', 'mac_address': 'fa:16:3e:64:ef:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_interface', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:48Z', 'updated_at': '2021-11-02T12:52:07Z', 'revision_number': 5, 'project_id': '697de566c0334435b902950f6f31da45', 'subnets': [{'id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:00:45.884652 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ccc709d-2523-4bd1-af4f-b538214b0479 None None] Checking router: 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 for host: dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 13:00:45.895310 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6ccc709d-2523-4bd1-af4f-b538214b0479 None None] Routers {'2a2f63fd-e512-4ad2-9007-46e6ab6e8134'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:00:45.896019 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-6ccc709d-2523-4bd1-af4f-b538214b0479 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:00:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:00:45.944231 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68cf5cf0-31ab-40bb-b18d-4f3bdd2d3091 req-2ea3e2e2-0d26-48ae-98f1-1dd5427151fb service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:45.945897 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-68cf5cf0-31ab-40bb-b18d-4f3bdd2d3091 req-2ea3e2e2-0d26-48ae-98f1-1dd5427151fb service neutron] 10.222.0.90 "GET /v2.0/subnets?id=ae24c2fe-abba-48cd-9d91-28a628d2ef95 HTTP/1.1" status: 200 len: 851 time: 0.0858688 Nov 02 13:00:45.999483 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-68cf5cf0-31ab-40bb-b18d-4f3bdd2d3091 req-7005e4d6-daad-4047-a8ce-1643ba1a76a6 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:46.001516 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-68cf5cf0-31ab-40bb-b18d-4f3bdd2d3091 req-7005e4d6-daad-4047-a8ce-1643ba1a76a6 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=89f406ae-1b9f-4be7-8881-87075d7c5aa1&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0467451 Nov 02 13:00:46.024954 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-6ccc709d-2523-4bd1-af4f-b538214b0479 None None] Set router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:00:46.104314 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-68cf5cf0-31ab-40bb-b18d-4f3bdd2d3091 req-a05c5e5d-86db-49d2-9656-03b56bfd4783 service neutron] 10.222.0.90 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0922537 Nov 02 13:00:46.214493 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [req-68cf5cf0-31ab-40bb-b18d-4f3bdd2d3091 req-8ab7c080-a7b1-4ec5-a121-b2a3148a3976 service neutron] 10.222.0.90 "GET /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1012328 Nov 02 13:00:46.215373 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-76655b76-de55-4f9e-9371-a6a5ee25d9fc req-9729ca68-0912-45da-9a65-b1e0656f8d78 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=feb93c53-c828-40b9-b292-5bcae1f79883&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.4342165 Nov 02 13:00:46.237029 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-706ab686-4c42-4421-bf9a-9213d10f2e59 req-1f41871b-0127-4e2c-beb2-e1e4833d266a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:46.238470 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-706ab686-4c42-4421-bf9a-9213d10f2e59 req-1f41871b-0127-4e2c-beb2-e1e4833d266a tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 946 time: 0.1315429 Nov 02 13:00:46.260651 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-6ccc709d-2523-4bd1-af4f-b538214b0479 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port': {'id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:1f:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:31Z', 'updated_at': '2021-11-02T12:51:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '80a55893-6272-4299-8834-e840aa37d37b', 'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'tenant_id': '697de566c0334435b902950f6f31da45', 'mac_address': 'fa:16:3e:64:ef:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_interface', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:48Z', 'updated_at': '2021-11-02T12:52:07Z', 'revision_number': 5, 'project_id': '697de566c0334435b902950f6f31da45', 'subnets': [{'id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:00:46.262089 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-4487f463-cc7f-42d7-bd72-2bf1cba6e951 req-31acd2f5-f776-4419-b1b0-12b506dbd32b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] For port 8001df2f-618b-4944-8995-ce83bb50997a, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=8001df2f-618b-4944-8995-ce83bb50997a,segment=NetworkSegment(0271db13-2254-4db8-b649-9b3f1a40557a),segment_id=0271db13-2254-4db8-b649-9b3f1a40557a)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:00:46.262480 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-4487f463-cc7f-42d7-bd72-2bf1cba6e951 req-31acd2f5-f776-4419-b1b0-12b506dbd32b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:46.297926 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6ccc709d-2523-4bd1-af4f-b538214b0479 None None] The sync data for ids ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'] in dv-cinder-816324-1-iscsi is: [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T12:51:54Z', 'revision_number': 4, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port': {'id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:1f:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:31Z', 'updated_at': '2021-11-02T12:51:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '80a55893-6272-4299-8834-e840aa37d37b', 'name': '', 'network_id': '89f406ae-1b9f-4be7-8881-87075d7c5aa1', 'tenant_id': '697de566c0334435b902950f6f31da45', 'mac_address': 'fa:16:3e:64:ef:b6', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_interface', 'standard_attr_id': 415, 'fixed_ips': [{'subnet_id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:48Z', 'updated_at': '2021-11-02T12:52:07Z', 'revision_number': 5, 'project_id': '697de566c0334435b902950f6f31da45', 'subnets': [{'id': 'ae24c2fe-abba-48cd-9d91-28a628d2ef95', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 13:00:46.349692 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-706ab686-4c42-4421-bf9a-9213d10f2e59 req-bf87116d-f044-4110-b048-ca61b457eae4 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.1007330 Nov 02 13:00:46.481858 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-4487f463-cc7f-42d7-bd72-2bf1cba6e951 req-31acd2f5-f776-4419-b1b0-12b506dbd32b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:46.482210 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-4487f463-cc7f-42d7-bd72-2bf1cba6e951 req-31acd2f5-f776-4419-b1b0-12b506dbd32b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1594992'] for floatingip, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:46.482558 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.db.l3_db [req-4487f463-cc7f-42d7-bd72-2bf1cba6e951 req-31acd2f5-f776-4419-b1b0-12b506dbd32b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Floating IP 7ce5ff70-276a-4e8a-865e-af60cedcb077 disassociated. External IP: 172.27.0.22, port: 8001df2f-618b-4944-8995-ce83bb50997a. Nov 02 13:00:46.482899 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-4487f463-cc7f-42d7-bd72-2bf1cba6e951 req-31acd2f5-f776-4419-b1b0-12b506dbd32b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Calling delete_port for 8001df2f-618b-4944-8995-ce83bb50997a owned by compute:nova {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:00:46.559538 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-a6a42ebe-4078-4ffe-b732-4835ee2c2c6b None None] New status for floating IP 5fd4585f-d4f7-4f9e-971e-e5d255fd0c1d: DOWN {{(pid=108544) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 02 13:00:46.695166 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-4487f463-cc7f-42d7-bd72-2bf1cba6e951 req-31acd2f5-f776-4419-b1b0-12b506dbd32b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:46.725221 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-31acd2f5-f776-4419-b1b0-12b506dbd32b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Pushing event deleted for resources: {'Port': ['ID=8001df2f-618b-4944-8995-ce83bb50997a,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:00:46.842011 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.l3_agent_scheduler [req-4487f463-cc7f-42d7-bd72-2bf1cba6e951 req-31acd2f5-f776-4419-b1b0-12b506dbd32b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Router cf121ee7-8e7c-41c2-ad44-460321366ae3 has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108543) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 13:00:46.956615 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-4487f463-cc7f-42d7-bd72-2bf1cba6e951 req-31acd2f5-f776-4419-b1b0-12b506dbd32b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108543) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 13:00:46.968056 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d427f495-abea-428b-bce1-32ceee9b513e None None] Sync routers for ids ['cf121ee7-8e7c-41c2-ad44-460321366ae3'] in dv-cinder-816324-1-iscsi {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 13:00:46.978306 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d427f495-abea-428b-bce1-32ceee9b513e None None] Routers {'cf121ee7-8e7c-41c2-ad44-460321366ae3'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:00:46.978945 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-d427f495-abea-428b-bce1-32ceee9b513e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:00:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['cf121ee7-8e7c-41c2-ad44-460321366ae3'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:00:46.997945 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-4487f463-cc7f-42d7-bd72-2bf1cba6e951 req-31acd2f5-f776-4419-b1b0-12b506dbd32b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] No DVR routers for this DVR port 8001df2f-618b-4944-8995-ce83bb50997a on host hv-cinder-81632 {{(pid=108543) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 13:00:47.000334 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-4487f463-cc7f-42d7-bd72-2bf1cba6e951 req-31acd2f5-f776-4419-b1b0-12b506dbd32b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:47.003789 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4487f463-cc7f-42d7-bd72-2bf1cba6e951 req-31acd2f5-f776-4419-b1b0-12b506dbd32b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.90 "DELETE /v2.0/ports/8001df2f-618b-4944-8995-ce83bb50997a HTTP/1.1" status: 204 len: 173 time: 1.4295285 Nov 02 13:00:47.004264 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': 'ae55bfa7-4aee-4816-acad-b828d2c6eb9c', 'name': 'network-vif-deleted', 'tag': '8001df2f-618b-4944-8995-ce83bb50997a'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 13:00:47.006736 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3d6ff02c-f7b4-4bf8-9edb-9e41addab417" -d '{"events": [{"server_uuid": "ae55bfa7-4aee-4816-acad-b828d2c6eb9c", "name": "network-vif-deleted", "tag": "8001df2f-618b-4944-8995-ce83bb50997a"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 13:00:47.051178 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 13:00:47 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-56d19e41-6042-4692-94dc-40ce5c91ac4f x-openstack-request-id: req-56d19e41-6042-4692-94dc-40ce5c91ac4f {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 13:00:47.051467 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "ae55bfa7-4aee-4816-acad-b828d2c6eb9c", "name": "network-vif-deleted", "tag": "8001df2f-618b-4944-8995-ce83bb50997a", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 13:00:47.051712 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-56d19e41-6042-4692-94dc-40ce5c91ac4f {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 13:00:47.052116 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': 'ae55bfa7-4aee-4816-acad-b828d2c6eb9c', 'name': 'network-vif-deleted', 'tag': '8001df2f-618b-4944-8995-ce83bb50997a', 'status': 'completed', 'code': 200} Nov 02 13:00:47.180253 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-d427f495-abea-428b-bce1-32ceee9b513e None None] Set router cf121ee7-8e7c-41c2-ad44-460321366ae3 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:00:47.319513 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f6c88183-e635-4ece-b446-67256009a8d0 req-539301ec-5c0e-4d5e-994e-5bf6a2956c19 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=ae55bfa7-4aee-4816-acad-b828d2c6eb9c HTTP/1.1" status: 200 len: 210 time: 0.0316157 Nov 02 13:00:47.446975 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-d427f495-abea-428b-bce1-32ceee9b513e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'name': 'tempest-AttachVolumeTestJSON-1054401684-router', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:57:38Z', 'updated_at': '2021-11-02T12:57:42Z', 'revision_number': 4, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'gw_port': {'id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:0e:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:39Z', 'updated_at': '2021-11-02T12:57:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '29f4ed03-3784-40c8-9c15-00c1bd9d54cc', 'name': '', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'mac_address': 'fa:16:3e:db:98:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 597, 'fixed_ips': [{'subnet_id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:41Z', 'updated_at': '2021-11-02T12:57:45Z', 'revision_number': 5, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'subnets': [{'id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:00:47.477028 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d427f495-abea-428b-bce1-32ceee9b513e None None] Checking router: cf121ee7-8e7c-41c2-ad44-460321366ae3 for host: dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 13:00:47.486565 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-d427f495-abea-428b-bce1-32ceee9b513e None None] Routers {'cf121ee7-8e7c-41c2-ad44-460321366ae3'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:00:47.487076 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-d427f495-abea-428b-bce1-32ceee9b513e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:00:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['cf121ee7-8e7c-41c2-ad44-460321366ae3'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:00:47.502478 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-255e1bb5-4c5b-498a-8c3d-ac020dd21670 req-2fd55bc7-0e4d-4d6f-91e2-9327a4f5d134 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:47.504201 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-255e1bb5-4c5b-498a-8c3d-ac020dd21670 req-2fd55bc7-0e4d-4d6f-91e2-9327a4f5d134 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 946 time: 0.0587599 Nov 02 13:00:47.556585 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-255e1bb5-4c5b-498a-8c3d-ac020dd21670 req-62ec4f97-3ea5-4996-b36f-786189396c9c tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/security-groups?id=9bcd6e2d-4fff-4ee2-aaee-41104c05def3&fields=id&fields=name HTTP/1.1" status: 200 len: 312 time: 0.0462563 Nov 02 13:00:47.600983 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-d427f495-abea-428b-bce1-32ceee9b513e None None] Set router cf121ee7-8e7c-41c2-ad44-460321366ae3 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:00:47.679981 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-69d21cdb-4732-4477-9378-cb80955893b8 req-c84e882e-4fb6-4fc0-a5c7-0cf0b55485a5 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:47.681393 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-69d21cdb-4732-4477-9378-cb80955893b8 req-c84e882e-4fb6-4fc0-a5c7-0cf0b55485a5 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.90 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 946 time: 0.0535572 Nov 02 13:00:47.800651 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-69d21cdb-4732-4477-9378-cb80955893b8 req-4ae74fd0-887d-42b2-a57c-c7a3f84c0864 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Deleting port a7cd13fe-71ea-4598-9aff-764b7f736afe {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:00:47.801642 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-69d21cdb-4732-4477-9378-cb80955893b8 req-4ae74fd0-887d-42b2-a57c-c7a3f84c0864 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:47.848846 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-d427f495-abea-428b-bce1-32ceee9b513e None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'name': 'tempest-AttachVolumeTestJSON-1054401684-router', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:57:38Z', 'updated_at': '2021-11-02T12:57:42Z', 'revision_number': 4, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'gw_port': {'id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:0e:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:39Z', 'updated_at': '2021-11-02T12:57:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '29f4ed03-3784-40c8-9c15-00c1bd9d54cc', 'name': '', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'mac_address': 'fa:16:3e:db:98:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 597, 'fixed_ips': [{'subnet_id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:41Z', 'updated_at': '2021-11-02T12:57:45Z', 'revision_number': 5, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'subnets': [{'id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:00:47.875868 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-d427f495-abea-428b-bce1-32ceee9b513e None None] The sync data for ids ['cf121ee7-8e7c-41c2-ad44-460321366ae3'] in dv-cinder-816324-1-iscsi is: [{'id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'name': 'tempest-AttachVolumeTestJSON-1054401684-router', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:57:38Z', 'updated_at': '2021-11-02T12:57:42Z', 'revision_number': 4, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'gw_port': {'id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:0e:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:39Z', 'updated_at': '2021-11-02T12:57:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '29f4ed03-3784-40c8-9c15-00c1bd9d54cc', 'name': '', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'mac_address': 'fa:16:3e:db:98:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 597, 'fixed_ips': [{'subnet_id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:41Z', 'updated_at': '2021-11-02T12:57:45Z', 'revision_number': 5, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'subnets': [{'id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 13:00:47.905358 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-69d21cdb-4732-4477-9378-cb80955893b8 req-4ae74fd0-887d-42b2-a57c-c7a3f84c0864 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] For port a7cd13fe-71ea-4598-9aff-764b7f736afe, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=a7cd13fe-71ea-4598-9aff-764b7f736afe,segment=NetworkSegment(c8ecb7dc-9cc8-47a7-94e7-62f066a97c10),segment_id=c8ecb7dc-9cc8-47a7-94e7-62f066a97c10)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:00:47.905735 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-69d21cdb-4732-4477-9378-cb80955893b8 req-4ae74fd0-887d-42b2-a57c-c7a3f84c0864 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:47.922638 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-69d21cdb-4732-4477-9378-cb80955893b8 req-4ae74fd0-887d-42b2-a57c-c7a3f84c0864 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Calling delete_port for a7cd13fe-71ea-4598-9aff-764b7f736afe owned by compute:nova {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:00:47.953838 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device a7cd13fe-71ea-4598-9aff-764b7f736afe no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 13:00:48.056245 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:48.124642 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-69d21cdb-4732-4477-9378-cb80955893b8 req-4ae74fd0-887d-42b2-a57c-c7a3f84c0864 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:48.152793 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 8001df2f-618b-4944-8995-ce83bb50997a no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 13:00:48.172951 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4ae74fd0-887d-42b2-a57c-c7a3f84c0864 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Pushing event deleted for resources: {'Port': ['ID=a7cd13fe-71ea-4598-9aff-764b7f736afe,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:00:48.173596 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] No Port match for: 8001df2f-618b-4944-8995-ce83bb50997a {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 13:00:48.174192 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 8001df2f-618b-4944-8995-ce83bb50997a not bound to the agent host hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 13:00:48.202342 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-81e4fea5-f693-4149-9ac3-1394903bfff9 None None] New status for floating IP 7ce5ff70-276a-4e8a-865e-af60cedcb077: DOWN {{(pid=108544) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 02 13:00:48.234588 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-69d21cdb-4732-4477-9378-cb80955893b8 req-4ae74fd0-887d-42b2-a57c-c7a3f84c0864 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] No DVR routers for this DVR port a7cd13fe-71ea-4598-9aff-764b7f736afe on host hv-cinder-81632 {{(pid=108543) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 13:00:48.237629 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-69d21cdb-4732-4477-9378-cb80955893b8 req-4ae74fd0-887d-42b2-a57c-c7a3f84c0864 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:48.241104 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-69d21cdb-4732-4477-9378-cb80955893b8 req-4ae74fd0-887d-42b2-a57c-c7a3f84c0864 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.90 "DELETE /v2.0/ports/a7cd13fe-71ea-4598-9aff-764b7f736afe HTTP/1.1" status: 204 len: 173 time: 0.5468061 Nov 02 13:00:48.496831 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 35982) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:00:48.558937 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-628b71c2-f86f-4d25-b1f7-da5766b35bc1 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:48.587586 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-628b71c2-f86f-4d25-b1f7-da5766b35bc1 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:48.668819 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-efb7b63c-d070-4e26-86d6-4aad79452b89 req-60fb973f-0c58-4e26-98a6-f35aa6e2ddc0 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "GET /v2.0/ports?device_id=93ad83e9-3682-4f82-b83f-f511d5942f94 HTTP/1.1" status: 200 len: 210 time: 0.0355289 Nov 02 13:00:48.741725 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-628b71c2-f86f-4d25-b1f7-da5766b35bc1 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:48.744503 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-628b71c2-f86f-4d25-b1f7-da5766b35bc1 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:48.746194 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-628b71c2-f86f-4d25-b1f7-da5766b35bc1 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "DELETE /v2.0/security-groups/feb93c53-c828-40b9-b292-5bcae1f79883 HTTP/1.1" status: 204 len: 168 time: 0.2483389 Nov 02 13:00:48.749351 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 35986) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:00:48.756213 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-628b71c2-f86f-4d25-b1f7-da5766b35bc1 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=feb93c53-c828-40b9-b292-5bcae1f79883,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:00:48.766524 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.api.v2.resource [None req-b27f33fa-b645-4aa4-accd-31c0cb70c5b4 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] show failed (client error): The resource could not be found. Nov 02 13:00:48.768357 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-b27f33fa-b645-4aa4-accd-31c0cb70c5b4 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups/feb93c53-c828-40b9-b292-5bcae1f79883 HTTP/1.1" status: 404 len: 347 time: 0.0178597 Nov 02 13:00:48.771593 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 35988) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:00:48.899837 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-2bcf4627-b02f-426b-bf6b-c6d412ed54e3 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Deleting port 51d9b5ad-9f20-4815-892b-b44055629750 {{(pid=108542) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:00:48.900177 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2bcf4627-b02f-426b-bf6b-c6d412ed54e3 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:48.980684 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2bcf4627-b02f-426b-bf6b-c6d412ed54e3 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:48.980909 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2bcf4627-b02f-426b-bf6b-c6d412ed54e3 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:48.993035 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-2bcf4627-b02f-426b-bf6b-c6d412ed54e3 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Calling delete_port for 51d9b5ad-9f20-4815-892b-b44055629750 owned by network:floatingip {{(pid=108542) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:00:49.053599 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '93ad83e9-3682-4f82-b83f-f511d5942f94', 'name': 'network-vif-deleted', 'tag': 'a7cd13fe-71ea-4598-9aff-764b7f736afe'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 13:00:49.056193 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-00984ea8-0302-41db-8b11-a55243914491" -d '{"events": [{"server_uuid": "93ad83e9-3682-4f82-b83f-f511d5942f94", "name": "network-vif-deleted", "tag": "a7cd13fe-71ea-4598-9aff-764b7f736afe"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 13:00:49.105584 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 13:00:49 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-2f088640-056d-403f-9419-07da1f1413c0 x-openstack-request-id: req-2f088640-056d-403f-9419-07da1f1413c0 {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 13:00:49.105877 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "93ad83e9-3682-4f82-b83f-f511d5942f94", "name": "network-vif-deleted", "tag": "a7cd13fe-71ea-4598-9aff-764b7f736afe", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 13:00:49.106126 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-2f088640-056d-403f-9419-07da1f1413c0 {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 13:00:49.106619 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '93ad83e9-3682-4f82-b83f-f511d5942f94', 'name': 'network-vif-deleted', 'tag': 'a7cd13fe-71ea-4598-9aff-764b7f736afe', 'status': 'completed', 'code': 200} Nov 02 13:00:49.243801 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2bcf4627-b02f-426b-bf6b-c6d412ed54e3 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:49.273428 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2bcf4627-b02f-426b-bf6b-c6d412ed54e3 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Pushing event deleted for resources: {'Port': ['ID=51d9b5ad-9f20-4815-892b-b44055629750,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:00:49.340324 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2bcf4627-b02f-426b-bf6b-c6d412ed54e3 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for floatingip, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:49.342996 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2bcf4627-b02f-426b-bf6b-c6d412ed54e3 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for floatingip, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:49.344178 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-2bcf4627-b02f-426b-bf6b-c6d412ed54e3 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "DELETE /v2.0/floatingips/7ce5ff70-276a-4e8a-865e-af60cedcb077 HTTP/1.1" status: 204 len: 168 time: 0.5715976 Nov 02 13:00:49.743101 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 35996) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:00:49.833589 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 35998) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:00:49.838432 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-267a297b-c646-48e4-9c33-38031e0f5e1f tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Request body: {'security_group': {'name': 'tempest-securitygroup--1114787928', 'description': 'tempest-description--923781120'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 13:00:49.875985 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-0eb081e1-afff-4683-84ba-379b7a0b7d9b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Deleting port da6a05e1-fb58-46cf-b287-1333614c13a8 {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:00:49.876231 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0eb081e1-afff-4683-84ba-379b7a0b7d9b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:49.912255 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-267a297b-c646-48e4-9c33-38031e0f5e1f tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:49.953405 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0eb081e1-afff-4683-84ba-379b7a0b7d9b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:49.953923 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0eb081e1-afff-4683-84ba-379b7a0b7d9b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:49.970676 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-0eb081e1-afff-4683-84ba-379b7a0b7d9b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Calling delete_port for da6a05e1-fb58-46cf-b287-1333614c13a8 owned by network:floatingip {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:00:49.980749 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-267a297b-c646-48e4-9c33-38031e0f5e1f tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:50.066507 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-267a297b-c646-48e4-9c33-38031e0f5e1f tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:50.099832 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-267a297b-c646-48e4-9c33-38031e0f5e1f tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Pushing event updated for resources: {'SecurityGroup': ['ID=325ce627-98ec-42f4-b6e6-18cfdf6d084e,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:00:50.183276 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-267a297b-c646-48e4-9c33-38031e0f5e1f tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:50.184589 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-267a297b-c646-48e4-9c33-38031e0f5e1f tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1796 time: 0.3498991 Nov 02 13:00:50.187600 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36000) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:00:50.192033 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-c1286124-f669-40ef-bd38-f711ae90ee2d tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Request body: {'security_group_rule': {'security_group_id': '325ce627-98ec-42f4-b6e6-18cfdf6d084e', 'protocol': 'tcp', 'ethertype': 'IPv4', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 13:00:50.198776 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0eb081e1-afff-4683-84ba-379b7a0b7d9b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:50.225615 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0eb081e1-afff-4683-84ba-379b7a0b7d9b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Pushing event deleted for resources: {'Port': ['ID=da6a05e1-fb58-46cf-b287-1333614c13a8,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:00:50.291160 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0eb081e1-afff-4683-84ba-379b7a0b7d9b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for floatingip, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:50.294341 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0eb081e1-afff-4683-84ba-379b7a0b7d9b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for floatingip, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:50.295502 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-0eb081e1-afff-4683-84ba-379b7a0b7d9b tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "DELETE /v2.0/floatingips/bff9f016-a411-4056-a280-4f387caba2b4 HTTP/1.1" status: 204 len: 168 time: 0.5514686 Nov 02 13:00:50.335986 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c1286124-f669-40ef-bd38-f711ae90ee2d tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:50.395754 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c1286124-f669-40ef-bd38-f711ae90ee2d tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:50.482956 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c1286124-f669-40ef-bd38-f711ae90ee2d tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:50.503392 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c1286124-f669-40ef-bd38-f711ae90ee2d tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=88123b0e-a0c3-4335-8c6b-ce49522fbeea,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:00:50.590390 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c1286124-f669-40ef-bd38-f711ae90ee2d tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:50.591363 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-c1286124-f669-40ef-bd38-f711ae90ee2d tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.4027700 Nov 02 13:00:50.594532 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36010) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:00:50.599362 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-bb9a5eb8-e28a-4fd9-b2b4-f084032a4337 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Request body: {'security_group_rule': {'security_group_id': '325ce627-98ec-42f4-b6e6-18cfdf6d084e', 'protocol': 'icmp', 'ethertype': 'IPv4', 'direction': 'ingress'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 13:00:50.728704 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-bb9a5eb8-e28a-4fd9-b2b4-f084032a4337 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:50.789527 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-bb9a5eb8-e28a-4fd9-b2b4-f084032a4337 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:50.867210 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-bb9a5eb8-e28a-4fd9-b2b4-f084032a4337 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:50.889527 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bb9a5eb8-e28a-4fd9-b2b4-f084032a4337 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=0d0cf485-dd45-4d83-b0c9-1ae4f55b6d8a,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:00:50.959712 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-bb9a5eb8-e28a-4fd9-b2b4-f084032a4337 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:50.960962 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-bb9a5eb8-e28a-4fd9-b2b4-f084032a4337 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3653932 Nov 02 13:00:50.964710 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36012) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:00:50.970426 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-730e28a8-652e-4a15-8a4d-1ab7e37314e9 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Request body: {'floatingip': {'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 13:00:51.100744 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-730e28a8-652e-4a15-8a4d-1ab7e37314e9 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for floatingip, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:51.221701 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-730e28a8-652e-4a15-8a4d-1ab7e37314e9 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:51.334011 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_common [None req-730e28a8-652e-4a15-8a4d-1ab7e37314e9 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Allocated IP 172.27.0.185 (43464fa8-eb00-46fb-9ca0-be7342f9ddbf/44a807bc-f2b6-41f0-b765-e5d3393fe305/fd363d5b-45d7-4741-8379-8650e2925edc) {{(pid=108542) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 13:00:51.441245 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-730e28a8-652e-4a15-8a4d-1ab7e37314e9 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for port, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:51.597809 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-730e28a8-652e-4a15-8a4d-1ab7e37314e9 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:51.635080 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-730e28a8-652e-4a15-8a4d-1ab7e37314e9 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 13:00:51.637957 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-730e28a8-652e-4a15-8a4d-1ab7e37314e9 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 13:00:51.640473 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [None req-730e28a8-652e-4a15-8a4d-1ab7e37314e9 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Received port after_create {{(pid=108542) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 13:00:51.672640 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36016) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:00:51.681197 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-730e28a8-652e-4a15-8a4d-1ab7e37314e9 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Pushing event updated for resources: {'Port': ['ID=fd363d5b-45d7-4741-8379-8650e2925edc,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:00:51.783890 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5c77bb9b-ceed-44cc-b284-a9fb5225a982 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:51.808850 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-730e28a8-652e-4a15-8a4d-1ab7e37314e9 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:51.824818 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5c77bb9b-ceed-44cc-b284-a9fb5225a982 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:51.996010 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-730e28a8-652e-4a15-8a4d-1ab7e37314e9 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:52.019431 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5c77bb9b-ceed-44cc-b284-a9fb5225a982 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:52.023612 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5c77bb9b-ceed-44cc-b284-a9fb5225a982 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:52.023612 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-5c77bb9b-ceed-44cc-b284-a9fb5225a982 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] 10.222.0.98 "DELETE /v2.0/security-groups/9bcd6e2d-4fff-4ee2-aaee-41104c05def3 HTTP/1.1" status: 204 len: 168 time: 0.3496978 Nov 02 13:00:52.039365 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5c77bb9b-ceed-44cc-b284-a9fb5225a982 tempest-TestVolumeBootPattern-565716880 tempest-TestVolumeBootPattern-565716880-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=9bcd6e2d-4fff-4ee2-aaee-41104c05def3,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:00:52.161423 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 36020) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:00:52.212347 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-730e28a8-652e-4a15-8a4d-1ab7e37314e9 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for port, precommit_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:52.329226 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-730e28a8-652e-4a15-8a4d-1ab7e37314e9 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126476609'] for port, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:52.412079 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-730e28a8-652e-4a15-8a4d-1ab7e37314e9 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Pushing event updated for resources: {'Port': ['ID=fd363d5b-45d7-4741-8379-8650e2925edc,revision_number=2']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:00:52.420376 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-730e28a8-652e-4a15-8a4d-1ab7e37314e9 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1594992'] for floatingip, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:52.560157 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-730e28a8-652e-4a15-8a4d-1ab7e37314e9 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for floatingip, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:52.561426 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-730e28a8-652e-4a15-8a4d-1ab7e37314e9 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 693 time: 1.5954549 Nov 02 13:00:52.709990 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-2daa443e-b96c-4e0f-9750-fc221971433f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1590128'] for router_interface, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:52.852851 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-a2b13c8c-532f-4c9a-be80-4b964e045767 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?name=tempest-securitygroup--1114787928&fields=id&tenant_id=6064269d26644d27aaf12fd0ae66c0a9 HTTP/1.1" status: 200 len: 267 time: 0.0930295 Nov 02 13:00:53.100649 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-e4f86b66-a50b-46d9-9429-8e331a26b068 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:53.102532 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-e4f86b66-a50b-46d9-9429-8e331a26b068 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/networks?id=4e122687-d2b4-4db2-bcc0-8820ad5e5b77 HTTP/1.1" status: 200 len: 811 time: 0.2409379 Nov 02 13:00:53.125570 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-40bffb64-3f9e-4686-89ed-0c76177cb729 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/quotas/6064269d26644d27aaf12fd0ae66c0a9 HTTP/1.1" status: 200 len: 375 time: 0.0158949 Nov 02 13:00:53.225228 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-d2c32b6d-7a3a-436d-8b39-3c8e9593e637 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?tenant_id=6064269d26644d27aaf12fd0ae66c0a9&fields=id HTTP/1.1" status: 200 len: 348 time: 0.0809195 Nov 02 13:00:53.247874 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-511b25fd-f69d-4b70-a58b-1d963d351855 service neutron] http://10.222.0.98:9696/v2.0/extensions returned with HTTP 200 {{(pid=108543) __call__ /opt/stack/neutron/neutron/wsgi.py:729}} Nov 02 13:00:53.249245 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-511b25fd-f69d-4b70-a58b-1d963d351855 service neutron] 10.222.0.98 "GET /v2.0/extensions HTTP/1.1" status: 200 len: 13869 time: 0.0072103 Nov 02 13:00:53.261807 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-2daa443e-b96c-4e0f-9750-fc221971433f admin admin] Deleting port 80a55893-6272-4299-8834-e840aa37d37b {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:00:53.262332 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-2daa443e-b96c-4e0f-9750-fc221971433f admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:53.455352 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [None req-2daa443e-b96c-4e0f-9750-fc221971433f admin admin] For port 80a55893-6272-4299-8834-e840aa37d37b, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=80a55893-6272-4299-8834-e840aa37d37b,segment=NetworkSegment(c8ecb7dc-9cc8-47a7-94e7-62f066a97c10),segment_id=c8ecb7dc-9cc8-47a7-94e7-62f066a97c10)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:00:53.455726 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-2daa443e-b96c-4e0f-9750-fc221971433f admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:53.460307 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-f09e6af3-9bdd-4443-b962-27289bfb1bed service neutron] 10.222.0.98 "GET /v2.0/networks/4e122687-d2b4-4db2-bcc0-8820ad5e5b77?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2014096 Nov 02 13:00:53.485355 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-2daa443e-b96c-4e0f-9750-fc221971433f admin admin] Calling delete_port for 80a55893-6272-4299-8834-e840aa37d37b owned by network:router_interface {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:00:53.489912 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-f55b96f6-26e1-43cd-8bb0-f06d66c8f2cd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:53.638870 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-bbd4a570-2122-42ce-834c-eab9c2a1908b service neutron] 10.222.0.98 "GET /v2.0/networks/4e122687-d2b4-4db2-bcc0-8820ad5e5b77?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1648371 Nov 02 13:00:53.891244 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-2daa443e-b96c-4e0f-9750-fc221971433f admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:53.934682 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2daa443e-b96c-4e0f-9750-fc221971433f admin admin] Pushing event deleted for resources: {'Port': ['ID=80a55893-6272-4299-8834-e840aa37d37b,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:00:53.981095 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-67585812-288d-4c89-bb59-755cc7aeca57 req-5a9b9842-382a-4fe8-acca-e8e5d16f57eb tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 210 time: 0.0574725 Nov 02 13:00:54.492676 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-2daa443e-b96c-4e0f-9750-fc221971433f admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1649147', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1591488'] for router_interface, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:54.844176 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-2daa443e-b96c-4e0f-9750-fc221971433f admin admin] Router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108543) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 13:00:55.013581 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-2daa443e-b96c-4e0f-9750-fc221971433f admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108543) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 13:00:55.030805 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c674ac6b-87fd-425c-841b-e714909a8e52 None None] Sync routers for ids ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'] in dv-cinder-816324-1-iscsi {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 13:00:55.033223 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-2daa443e-b96c-4e0f-9750-fc221971433f admin admin] 10.222.0.98 "PUT /v2.0/routers/2a2f63fd-e512-4ad2-9007-46e6ab6e8134/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.8699391 Nov 02 13:00:55.037209 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 36050) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:00:55.043835 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c674ac6b-87fd-425c-841b-e714909a8e52 None None] Routers {'2a2f63fd-e512-4ad2-9007-46e6ab6e8134'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:00:55.044638 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-c674ac6b-87fd-425c-841b-e714909a8e52 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:00:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:00:55.144904 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-eb631cce-9b6a-46e9-ac94-4fa46ba89b5c req-1bde7c92-a144-481e-8525-f08b2272c744 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 210 time: 0.0434687 Nov 02 13:00:55.199786 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-c674ac6b-87fd-425c-841b-e714909a8e52 None None] Set router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:00:55.270026 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-edc8cdcd-331f-45eb-8d6f-c844309fc937 admin admin] Publish callbacks [] for router, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:55.403713 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-edc8cdcd-331f-45eb-8d6f-c844309fc937 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:55.476305 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-c674ac6b-87fd-425c-841b-e714909a8e52 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227'}], 'enable_snat': True}, 'gw_port_id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T13:00:53Z', 'revision_number': 5, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port': {'id': 'c81df0e3-6336-4caa-8387-60c3321fe152', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:d0:1f:c3', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'device_owner': 'network:router_gateway', 'standard_attr_id': 395, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.227', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:51:31Z', 'updated_at': '2021-11-02T12:51:51Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:00:55.505281 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c674ac6b-87fd-425c-841b-e714909a8e52 None None] Checking router: 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 for host: dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 13:00:55.515620 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c674ac6b-87fd-425c-841b-e714909a8e52 None None] Routers {'2a2f63fd-e512-4ad2-9007-46e6ab6e8134'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:00:55.516233 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-c674ac6b-87fd-425c-841b-e714909a8e52 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 3, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:00:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:00:55.544841 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-edc8cdcd-331f-45eb-8d6f-c844309fc937 admin admin] Deleting port c81df0e3-6336-4caa-8387-60c3321fe152 {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:00:55.545483 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-edc8cdcd-331f-45eb-8d6f-c844309fc937 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:55.622695 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-c674ac6b-87fd-425c-841b-e714909a8e52 None None] Set router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 gateway port host: None {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:00:55.647998 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [None req-edc8cdcd-331f-45eb-8d6f-c844309fc937 admin admin] For port c81df0e3-6336-4caa-8387-60c3321fe152, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=c81df0e3-6336-4caa-8387-60c3321fe152,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:00:55.648394 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-edc8cdcd-331f-45eb-8d6f-c844309fc937 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:55.655150 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-641ad3e0-aa6c-418e-b0f9-24fe2c9f07ac None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:55.667948 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-edc8cdcd-331f-45eb-8d6f-c844309fc937 admin admin] Calling delete_port for c81df0e3-6336-4caa-8387-60c3321fe152 owned by network:router_gateway {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:00:55.682827 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-c674ac6b-87fd-425c-841b-e714909a8e52 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T13:00:55Z', 'revision_number': 6, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port_host': None}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:00:55.711048 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c674ac6b-87fd-425c-841b-e714909a8e52 None None] The sync data for ids ['2a2f63fd-e512-4ad2-9007-46e6ab6e8134'] in dv-cinder-816324-1-iscsi is: [{'id': '2a2f63fd-e512-4ad2-9007-46e6ab6e8134', 'name': 'tempest-TestVolumeBootPattern-2134929835-router', 'tenant_id': '697de566c0334435b902950f6f31da45', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:51:28Z', 'updated_at': '2021-11-02T13:00:55Z', 'revision_number': 6, 'project_id': '697de566c0334435b902950f6f31da45', 'gw_port_host': None}] {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 13:00:55.929327 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-edc8cdcd-331f-45eb-8d6f-c844309fc937 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:55.957071 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-edc8cdcd-331f-45eb-8d6f-c844309fc937 admin admin] Pushing event deleted for resources: {'Port': ['ID=c81df0e3-6336-4caa-8387-60c3321fe152,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:00:56.037752 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-edc8cdcd-331f-45eb-8d6f-c844309fc937 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1595046'] for router_gateway, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:56.155840 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-edc8cdcd-331f-45eb-8d6f-c844309fc937 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1593116', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-25699'] for router, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:56.158567 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-edc8cdcd-331f-45eb-8d6f-c844309fc937 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:56.273707 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-e878dd80-2d80-408c-b950-1112636e6937 req-d04c505c-22bd-461b-b2b0-23d43b126c0f tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 210 time: 0.0462520 Nov 02 13:00:56.300861 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-edc8cdcd-331f-45eb-8d6f-c844309fc937 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1593093'] for router, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:56.301535 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-edc8cdcd-331f-45eb-8d6f-c844309fc937 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 2a2f63fd-e512-4ad2-9007-46e6ab6e8134 {{(pid=108543) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 02 13:00:56.308875 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-edc8cdcd-331f-45eb-8d6f-c844309fc937 admin admin] Publish callbacks [] for router, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:56.310659 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-edc8cdcd-331f-45eb-8d6f-c844309fc937 admin admin] 10.222.0.98 "DELETE /v2.0/routers/2a2f63fd-e512-4ad2-9007-46e6ab6e8134 HTTP/1.1" status: 204 len: 168 time: 1.2719030 Nov 02 13:00:56.323072 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 36056) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:00:56.399333 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_v2 [None req-58b2b1e9-6c4d-4580-b9e6-1ec686118d70 admin admin] Deleting subnet ae24c2fe-abba-48cd-9d91-28a628d2ef95 {{(pid=108543) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 02 13:00:56.403874 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-58b2b1e9-6c4d-4580-b9e6-1ec686118d70 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:56.449847 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-58b2b1e9-6c4d-4580-b9e6-1ec686118d70 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3308629'] for subnet, precommit_delete_associations {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:56.591186 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-58b2b1e9-6c4d-4580-b9e6-1ec686118d70 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-933154'] for subnet, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:56.637212 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 80a55893-6272-4299-8834-e840aa37d37b no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 13:00:56.672021 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: 80a55893-6272-4299-8834-e840aa37d37b {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 13:00:56.673876 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 80a55893-6272-4299-8834-e840aa37d37b not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 13:00:56.675158 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device c81df0e3-6336-4caa-8387-60c3321fe152 no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 13:00:56.719535 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: c81df0e3-6336-4caa-8387-60c3321fe152 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 13:00:56.719535 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device c81df0e3-6336-4caa-8387-60c3321fe152 not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 13:00:56.791185 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-58b2b1e9-6c4d-4580-b9e6-1ec686118d70 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-933141', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126393134', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126244844'] for subnet, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:56.835462 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58b2b1e9-6c4d-4580-b9e6-1ec686118d70 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ae24c2fe-abba-48cd-9d91-28a628d2ef95,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:00:56.842242 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-58b2b1e9-6c4d-4580-b9e6-1ec686118d70 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for subnet, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:56.851648 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-58b2b1e9-6c4d-4580-b9e6-1ec686118d70 admin admin] 10.222.0.98 "DELETE /v2.0/subnets/ae24c2fe-abba-48cd-9d91-28a628d2ef95 HTTP/1.1" status: 204 len: 168 time: 0.5237639 Nov 02 13:00:56.853075 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 36064) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:00:56.853258 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-9edc76e9-47b1-47c1-84d5-25da4d2ddbd8 None None] Network 89f406ae-1b9f-4be7-8881-87075d7c5aa1 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 13:00:56.962562 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:56.973726 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-740e1334-4eea-4d23-b987-0a3caba4dfdf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-972735'] for network, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:57.079706 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-740e1334-4eea-4d23-b987-0a3caba4dfdf admin admin] Deleting port 135dfe61-cf29-438c-a3e1-47697452f814 {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:00:57.080400 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-740e1334-4eea-4d23-b987-0a3caba4dfdf admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:57.180431 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [None req-740e1334-4eea-4d23-b987-0a3caba4dfdf admin admin] For port 135dfe61-cf29-438c-a3e1-47697452f814, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=135dfe61-cf29-438c-a3e1-47697452f814,segment=NetworkSegment(c8ecb7dc-9cc8-47a7-94e7-62f066a97c10),segment_id=c8ecb7dc-9cc8-47a7-94e7-62f066a97c10)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:00:57.180781 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-740e1334-4eea-4d23-b987-0a3caba4dfdf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:57.193261 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-27b01413-0064-4b7c-8d24-e9c0c4480b07 None None] DHCP port deletion for 89f406ae-1b9f-4be7-8881-87075d7c5aa1 request from dv-cinder-816324-1-iscsi {{(pid=108544) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 02 13:00:57.206628 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-740e1334-4eea-4d23-b987-0a3caba4dfdf admin admin] Calling delete_port for 135dfe61-cf29-438c-a3e1-47697452f814 owned by network:dhcp {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:00:57.259624 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-27b01413-0064-4b7c-8d24-e9c0c4480b07 None None] Deleting port 135dfe61-cf29-438c-a3e1-47697452f814 {{(pid=108544) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:00:57.260012 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-27b01413-0064-4b7c-8d24-e9c0c4480b07 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:57.357576 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-27b01413-0064-4b7c-8d24-e9c0c4480b07 None None] For port 135dfe61-cf29-438c-a3e1-47697452f814, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=135dfe61-cf29-438c-a3e1-47697452f814,segment=NetworkSegment(c8ecb7dc-9cc8-47a7-94e7-62f066a97c10),segment_id=c8ecb7dc-9cc8-47a7-94e7-62f066a97c10)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:00:57.358292 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-27b01413-0064-4b7c-8d24-e9c0c4480b07 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:57.374846 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-27b01413-0064-4b7c-8d24-e9c0c4480b07 None None] Calling delete_port for 135dfe61-cf29-438c-a3e1-47697452f814 owned by network:dhcp {{(pid=108544) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:00:57.378204 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-75775864-6342-4c5e-a759-6645a0facc38 req-918bfc88-d53f-48bb-9f37-0b596618773b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 210 time: 0.0423331 Nov 02 13:00:57.467348 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-740e1334-4eea-4d23-b987-0a3caba4dfdf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:57.515274 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740e1334-4eea-4d23-b987-0a3caba4dfdf admin admin] Pushing event deleted for resources: {'Port': ['ID=135dfe61-cf29-438c-a3e1-47697452f814,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:00:57.518100 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [None req-740e1334-4eea-4d23-b987-0a3caba4dfdf admin admin] No DVR routers for this DVR port 135dfe61-cf29-438c-a3e1-47697452f814 on host dv-cinder-816324-1-iscsi {{(pid=108543) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 13:00:57.605530 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-740e1334-4eea-4d23-b987-0a3caba4dfdf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-930985', 'neutron.services.segments.db._delete_segments_for_network-8738449897966'] for network, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:57.625267 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-27b01413-0064-4b7c-8d24-e9c0c4480b07 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678'] for port, after_delete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:57.637415 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.services.segments.db [None req-740e1334-4eea-4d23-b987-0a3caba4dfdf admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['89f406ae-1b9f-4be7-8881-87075d7c5aa1']}} {{(pid=108543) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:00:57.655431 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.services.segments.db [None req-740e1334-4eea-4d23-b987-0a3caba4dfdf admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, 'c8ecb7dc-9cc8-47a7-94e7-62f066a97c10') {'for_net_delete': True} {{(pid=108543) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:00:57.655910 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.services.segments.db [None req-740e1334-4eea-4d23-b987-0a3caba4dfdf admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, 'c8ecb7dc-9cc8-47a7-94e7-62f066a97c10') {} {{(pid=108543) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:00:57.666852 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-27b01413-0064-4b7c-8d24-e9c0c4480b07 None None] Pushing event deleted for resources: {'Port': ['ID=135dfe61-cf29-438c-a3e1-47697452f814,revision_number=None']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:00:57.673267 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-740e1334-4eea-4d23-b987-0a3caba4dfdf admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738449902583', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3308610'] for segment, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:57.680124 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-27b01413-0064-4b7c-8d24-e9c0c4480b07 None None] No DVR routers for this DVR port 135dfe61-cf29-438c-a3e1-47697452f814 on host dv-cinder-816324-1-iscsi {{(pid=108544) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 13:00:57.684394 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27b01413-0064-4b7c-8d24-e9c0c4480b07 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:57.684790 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27b01413-0064-4b7c-8d24-e9c0c4480b07 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:57.685335 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27b01413-0064-4b7c-8d24-e9c0c4480b07 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:57.685885 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27b01413-0064-4b7c-8d24-e9c0c4480b07 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:57.686468 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27b01413-0064-4b7c-8d24-e9c0c4480b07 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:57.687028 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27b01413-0064-4b7c-8d24-e9c0c4480b07 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:57.687511 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27b01413-0064-4b7c-8d24-e9c0c4480b07 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:57.688102 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27b01413-0064-4b7c-8d24-e9c0c4480b07 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:57.688881 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27b01413-0064-4b7c-8d24-e9c0c4480b07 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:57.689437 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27b01413-0064-4b7c-8d24-e9c0c4480b07 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:57.689972 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27b01413-0064-4b7c-8d24-e9c0c4480b07 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:57.690548 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-27b01413-0064-4b7c-8d24-e9c0c4480b07 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:00:57.698908 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-740e1334-4eea-4d23-b987-0a3caba4dfdf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:57.707587 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-740e1334-4eea-4d23-b987-0a3caba4dfdf admin admin] Releasing vlan 892 on physical network physnet1 to pool {{(pid=108543) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 02 13:00:57.708023 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-740e1334-4eea-4d23-b987-0a3caba4dfdf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126393740'] for segment, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: Traceback (most recent call last): Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: timer() Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: cb(*args, **kw) Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: return func(*args, **kwargs) Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: self._notify() Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: self.callback(batched_events) Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: event.method(event) Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: aggregate_uuid = self.p_client.list_aggregates( Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: return f(self, *a, **k) Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: return self._get(url).json() Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: return self.request(url, 'GET', **kwargs) Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: base_url = self.get_endpoint(auth, allow=allow, Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 02 13:00:57.711028 dv-cinder-816324-1-iscsi neutron-server[108543]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 02 13:00:57.842880 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-740e1334-4eea-4d23-b987-0a3caba4dfdf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-930976', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1594946'] for network, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:57.849674 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-740e1334-4eea-4d23-b987-0a3caba4dfdf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:57.852786 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-740e1334-4eea-4d23-b987-0a3caba4dfdf admin admin] 10.222.0.98 "DELETE /v2.0/networks/89f406ae-1b9f-4be7-8881-87075d7c5aa1 HTTP/1.1" status: 204 len: 168 time: 0.9983230 Nov 02 13:00:57.856847 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36070) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:00:57.862779 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-740e1334-4eea-4d23-b987-0a3caba4dfdf admin admin] Pushing event deleted for resources: {'Network': ['ID=89f406ae-1b9f-4be7-8881-87075d7c5aa1,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:00:58.256078 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-134a80a3-261d-4714-8278-0cf0e7f8af29 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1590128'] for router_interface, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:58.421216 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:58.515751 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-6425e1ca-1557-451b-bdf4-7f9380fae9fd req-58113131-b88c-413a-a5f7-a99cf780a9a9 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 210 time: 0.0281398 Nov 02 13:00:58.568367 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 135dfe61-cf29-438c-a3e1-47697452f814 no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 13:00:58.594741 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: 135dfe61-cf29-438c-a3e1-47697452f814 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 13:00:58.595327 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 135dfe61-cf29-438c-a3e1-47697452f814 not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 13:00:58.608940 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-134a80a3-261d-4714-8278-0cf0e7f8af29 admin admin] Deleting port b65f9b1f-06b2-4ae0-8e61-2d41782bdb81 {{(pid=108542) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:00:58.609388 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-134a80a3-261d-4714-8278-0cf0e7f8af29 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:58.708056 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [None req-134a80a3-261d-4714-8278-0cf0e7f8af29 admin admin] For port b65f9b1f-06b2-4ae0-8e61-2d41782bdb81, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=b65f9b1f-06b2-4ae0-8e61-2d41782bdb81,segment=NetworkSegment(3e37c0fd-0450-430c-9dfb-997dc0399ff6),segment_id=3e37c0fd-0450-430c-9dfb-997dc0399ff6)] {{(pid=108542) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:00:58.708420 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-134a80a3-261d-4714-8278-0cf0e7f8af29 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:58.722403 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-134a80a3-261d-4714-8278-0cf0e7f8af29 admin admin] Calling delete_port for b65f9b1f-06b2-4ae0-8e61-2d41782bdb81 owned by network:router_interface {{(pid=108542) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:00:59.009198 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-134a80a3-261d-4714-8278-0cf0e7f8af29 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:59.036832 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-134a80a3-261d-4714-8278-0cf0e7f8af29 admin admin] Pushing event deleted for resources: {'Port': ['ID=b65f9b1f-06b2-4ae0-8e61-2d41782bdb81,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:00:59.238023 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-134a80a3-261d-4714-8278-0cf0e7f8af29 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1649147', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1591488'] for router_interface, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:00:59.556405 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-134a80a3-261d-4714-8278-0cf0e7f8af29 admin admin] Router 7136daee-e271-4adc-ae87-6a06dffa51dd has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108542) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 13:00:59.682143 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0eafcdcd-7eef-428b-a829-4c6c86eadad3 req-d4b3e790-e8b6-4f55-9992-b37b37068de0 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 210 time: 0.0542557 Nov 02 13:00:59.762933 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-134a80a3-261d-4714-8278-0cf0e7f8af29 admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108542) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 13:00:59.777751 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-134a80a3-261d-4714-8278-0cf0e7f8af29 admin admin] 10.222.0.98 "PUT /v2.0/routers/7136daee-e271-4adc-ae87-6a06dffa51dd/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.9139023 Nov 02 13:00:59.777751 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36078) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:00:59.782401 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd6c2549-2221-4e23-80b6-750e46021dab None None] Sync routers for ids ['7136daee-e271-4adc-ae87-6a06dffa51dd'] in dv-cinder-816324-1-iscsi {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 13:00:59.814002 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd6c2549-2221-4e23-80b6-750e46021dab None None] Routers {'7136daee-e271-4adc-ae87-6a06dffa51dd'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:00:59.816478 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-dd6c2549-2221-4e23-80b6-750e46021dab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:00:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['7136daee-e271-4adc-ae87-6a06dffa51dd'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:00:59.874511 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-7399357d-aa06-4d7e-badf-30685c5ca6b4 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:00:59.876960 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-7399357d-aa06-4d7e-badf-30685c5ca6b4 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.90 "GET /v2.0/networks?id=4e122687-d2b4-4db2-bcc0-8820ad5e5b77 HTTP/1.1" status: 200 len: 811 time: 0.2008862 Nov 02 13:00:59.975214 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f3c3eb81-45dc-4d1b-a790-7942734c18c3 admin admin] Publish callbacks [] for router, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:00.008839 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-4bbc37bb-df58-4d7d-9966-4c62957f4482 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.90 "GET /v2.0/security-groups?fields=id&fields=name&tenant_id=6064269d26644d27aaf12fd0ae66c0a9 HTTP/1.1" status: 200 len: 380 time: 0.1136544 Nov 02 13:01:00.012328 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-dd6c2549-2221-4e23-80b6-750e46021dab None None] Set router 7136daee-e271-4adc-ae87-6a06dffa51dd gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:01:00.024878 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-b7e51867-0675-4d89-8e8f-ad8bc1923cad tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Request body: {'port': {'device_id': '5e9b362d-0d25-4a07-b397-4336433e27ae', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'admin_state_up': True, 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'security_groups': ['325ce627-98ec-42f4-b6e6-18cfdf6d084e']}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 13:01:00.173326 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f3c3eb81-45dc-4d1b-a790-7942734c18c3 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:00.280557 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-dd6c2549-2221-4e23-80b6-750e46021dab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7136daee-e271-4adc-ae87-6a06dffa51dd', 'name': 'tempest-TestVolumeBootPattern-1795464367-router', 'tenant_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.101'}], 'enable_snat': True}, 'gw_port_id': '3248239a-54d8-4ba4-81f9-a3fa983dd829', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:52:07Z', 'updated_at': '2021-11-02T13:00:58Z', 'revision_number': 5, 'project_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'gw_port': {'id': '3248239a-54d8-4ba4-81f9-a3fa983dd829', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:c9:d8:39', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '7136daee-e271-4adc-ae87-6a06dffa51dd', 'device_owner': 'network:router_gateway', 'standard_attr_id': 436, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.101', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:52:09Z', 'updated_at': '2021-11-02T12:52:16Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:01:00.302341 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-f3c3eb81-45dc-4d1b-a790-7942734c18c3 admin admin] Deleting port 3248239a-54d8-4ba4-81f9-a3fa983dd829 {{(pid=108542) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:01:00.302813 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f3c3eb81-45dc-4d1b-a790-7942734c18c3 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:00.313575 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd6c2549-2221-4e23-80b6-750e46021dab None None] Checking router: 7136daee-e271-4adc-ae87-6a06dffa51dd for host: dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 13:01:00.323680 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-b7e51867-0675-4d89-8e8f-ad8bc1923cad tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Made reservation on behalf of 6064269d26644d27aaf12fd0ae66c0a9 for: {'port': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 13:01:00.332547 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-b7e51867-0675-4d89-8e8f-ad8bc1923cad tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:00.332795 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-dd6c2549-2221-4e23-80b6-750e46021dab None None] Routers {'7136daee-e271-4adc-ae87-6a06dffa51dd'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:01:00.333851 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-dd6c2549-2221-4e23-80b6-750e46021dab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:00:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['7136daee-e271-4adc-ae87-6a06dffa51dd'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:01:00.427943 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [None req-f3c3eb81-45dc-4d1b-a790-7942734c18c3 admin admin] For port 3248239a-54d8-4ba4-81f9-a3fa983dd829, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=3248239a-54d8-4ba4-81f9-a3fa983dd829,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108542) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:01:00.428477 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f3c3eb81-45dc-4d1b-a790-7942734c18c3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:00.438756 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-dd6c2549-2221-4e23-80b6-750e46021dab None None] Set router 7136daee-e271-4adc-ae87-6a06dffa51dd gateway port host: None {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:01:00.453032 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-f3c3eb81-45dc-4d1b-a790-7942734c18c3 admin admin] Calling delete_port for 3248239a-54d8-4ba4-81f9-a3fa983dd829 owned by network:router_gateway {{(pid=108542) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:01:00.485357 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-b7e51867-0675-4d89-8e8f-ad8bc1923cad tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Allocated IP 172.20.0.9 (4e122687-d2b4-4db2-bcc0-8820ad5e5b77/0c2af8c2-0033-47ba-9f80-d43799d51067/55861a7a-72d5-4966-9353-256005697a2c) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 13:01:00.505153 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-dd6c2549-2221-4e23-80b6-750e46021dab None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '7136daee-e271-4adc-ae87-6a06dffa51dd', 'name': 'tempest-TestVolumeBootPattern-1795464367-router', 'tenant_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:52:07Z', 'updated_at': '2021-11-02T13:01:00Z', 'revision_number': 6, 'project_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'gw_port_host': None}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:01:00.536764 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-dd6c2549-2221-4e23-80b6-750e46021dab None None] The sync data for ids ['7136daee-e271-4adc-ae87-6a06dffa51dd'] in dv-cinder-816324-1-iscsi is: [{'id': '7136daee-e271-4adc-ae87-6a06dffa51dd', 'name': 'tempest-TestVolumeBootPattern-1795464367-router', 'tenant_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:52:07Z', 'updated_at': '2021-11-02T13:01:00Z', 'revision_number': 6, 'project_id': 'ba62faa6d50348199fe5a7f1ef451ddf', 'gw_port_host': None}] {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 13:01:00.810456 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2af31693-31dd-4948-bab5-daecb1c3f574 req-ad461258-107e-478c-89e2-1e160a41632e tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 210 time: 0.0374393 Nov 02 13:01:00.823276 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f3c3eb81-45dc-4d1b-a790-7942734c18c3 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:00.840725 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-b7e51867-0675-4d89-8e8f-ad8bc1923cad tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:00.857140 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f3c3eb81-45dc-4d1b-a790-7942734c18c3 admin admin] Pushing event deleted for resources: {'Port': ['ID=3248239a-54d8-4ba4-81f9-a3fa983dd829,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:01:00.872603 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:00.940061 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f3c3eb81-45dc-4d1b-a790-7942734c18c3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1595046'] for router_gateway, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:00.987479 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-b7e51867-0675-4d89-8e8f-ad8bc1923cad tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:01.046330 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-b7e51867-0675-4d89-8e8f-ad8bc1923cad tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Network 4e122687-d2b4-4db2-bcc0-8820ad5e5b77 is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 13:01:01.052819 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-b7e51867-0675-4d89-8e8f-ad8bc1923cad tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 13:01:01.055526 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-b7e51867-0675-4d89-8e8f-ad8bc1923cad tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 13:01:01.088692 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b7e51867-0675-4d89-8e8f-ad8bc1923cad tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Pushing event updated for resources: {'Port': ['ID=55861a7a-72d5-4966-9353-256005697a2c,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:01:01.133094 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-b7e51867-0675-4d89-8e8f-ad8bc1923cad tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:01:01.133779 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-b7e51867-0675-4d89-8e8f-ad8bc1923cad tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:01.219981 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-b7e51867-0675-4d89-8e8f-ad8bc1923cad tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 1.2019351 Nov 02 13:01:01.239750 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-96f5e93a-befb-49b8-8b93-96d909d7e63c service neutron] Request body: {'port': {'device_id': '5e9b362d-0d25-4a07-b397-4336433e27ae', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81632'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 13:01:01.332088 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-96f5e93a-befb-49b8-8b93-96d909d7e63c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:01.337568 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-329efee9-fea8-4996-8f2f-7af4b65bf1e1 None None] Provisioning complete for port 55861a7a-72d5-4966-9353-256005697a2c triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:01:01.337883 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-329efee9-fea8-4996-8f2f-7af4b65bf1e1 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:01.411349 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f3c3eb81-45dc-4d1b-a790-7942734c18c3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1593116', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-25699'] for router, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:01.412351 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-329efee9-fea8-4996-8f2f-7af4b65bf1e1 None None] Port 55861a7a-72d5-4966-9353-256005697a2c cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 13:01:01.414215 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f3c3eb81-45dc-4d1b-a790-7942734c18c3 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:01.558755 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f3c3eb81-45dc-4d1b-a790-7942734c18c3 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1593093'] for router, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:01.559305 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f3c3eb81-45dc-4d1b-a790-7942734c18c3 admin admin] Fanout notify agent at l3_agent the message router_deleted on router 7136daee-e271-4adc-ae87-6a06dffa51dd {{(pid=108542) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 02 13:01:01.564610 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f3c3eb81-45dc-4d1b-a790-7942734c18c3 admin admin] Publish callbacks [] for router, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:01.566555 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-f3c3eb81-45dc-4d1b-a790-7942734c18c3 admin admin] 10.222.0.98 "DELETE /v2.0/routers/7136daee-e271-4adc-ae87-6a06dffa51dd HTTP/1.1" status: 204 len: 168 time: 1.7883644 Nov 02 13:01:01.569809 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36086) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:01:01.629510 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_v2 [None req-17475800-4303-4e6d-96e4-477105492dda admin admin] Deleting subnet 236de1ed-65f6-4f82-93a7-8c065c469c7f {{(pid=108542) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 02 13:01:01.635635 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-17475800-4303-4e6d-96e4-477105492dda admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:01.701737 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-17475800-4303-4e6d-96e4-477105492dda admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3344686'] for subnet, precommit_delete_associations {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:01.803286 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-96f5e93a-befb-49b8-8b93-96d909d7e63c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id 55861a7a-72d5-4966-9353-256005697a2c {{(pid=108543) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 13:01:01.815667 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-96f5e93a-befb-49b8-8b93-96d909d7e63c service neutron] Publish callbacks [] for port, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:01.817280 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-17475800-4303-4e6d-96e4-477105492dda admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-933154'] for subnet, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:01.841197 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.provisioning_blocks [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-96f5e93a-befb-49b8-8b93-96d909d7e63c service neutron] Transition to ACTIVE for port object 55861a7a-72d5-4966-9353-256005697a2c will not be triggered until provisioned by entity L2. {{(pid=108543) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 02 13:01:01.941683 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-96f5e93a-befb-49b8-8b93-96d909d7e63c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:01.969414 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-17475800-4303-4e6d-96e4-477105492dda admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-933141', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126478215', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126185624'] for subnet, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:02.010938 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-17475800-4303-4e6d-96e4-477105492dda admin admin] Pushing event deleted for resources: {'Subnet': ['ID=236de1ed-65f6-4f82-93a7-8c065c469c7f,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:01:02.016135 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96f5e93a-befb-49b8-8b93-96d909d7e63c service neutron] Pushing event updated for resources: {'Port': ['ID=55861a7a-72d5-4966-9353-256005697a2c,revision_number=2']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:01:02.027813 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b8aff3d4-9a47-4ec8-8be2-934d8e2406ef None None] Network 9db25871-3a99-486f-97da-692e55836f96 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 13:01:02.031014 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-17475800-4303-4e6d-96e4-477105492dda admin admin] Publish callbacks [] for subnet, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:02.040751 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-17475800-4303-4e6d-96e4-477105492dda admin admin] 10.222.0.98 "DELETE /v2.0/subnets/236de1ed-65f6-4f82-93a7-8c065c469c7f HTTP/1.1" status: 204 len: 168 time: 0.4693856 Nov 02 13:01:02.043697 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36090) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:01:02.066451 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ffec3ebe-9e44-45fb-820f-72c404a40e12 req-4433acae-322e-4ff9-a8db-f64ca9d8de8b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:01:02.068061 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ffec3ebe-9e44-45fb-820f-72c404a40e12 req-4433acae-322e-4ff9-a8db-f64ca9d8de8b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 931 time: 0.1559327 Nov 02 13:01:02.176788 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e5d7c882-f31a-41a2-9ac8-de53ed7a70c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-972735'] for network, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:02.187466 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ffec3ebe-9e44-45fb-820f-72c404a40e12 req-8ad023c7-5289-4918-9bad-21977117f436 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=325ce627-98ec-42f4-b6e6-18cfdf6d084e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1036198 Nov 02 13:01:02.188648 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-96f5e93a-befb-49b8-8b93-96d909d7e63c service neutron] Attempting to bind port 55861a7a-72d5-4966-9353-256005697a2c on host hv-cinder-81632 for vnic_type normal with profile {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 13:01:02.189572 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-96f5e93a-befb-49b8-8b93-96d909d7e63c service neutron] Attempting to bind port 55861a7a-72d5-4966-9353-256005697a2c by drivers openvswitch,hyperv on host hv-cinder-81632 at level 0 using segments [{'id': '0271db13-2254-4db8-b649-9b3f1a40557a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77'}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 13:01:02.189713 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-96f5e93a-befb-49b8-8b93-96d909d7e63c service neutron] Attempting to bind port 55861a7a-72d5-4966-9353-256005697a2c on network 4e122687-d2b4-4db2-bcc0-8820ad5e5b77 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 13:01:02.214428 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-96f5e93a-befb-49b8-8b93-96d909d7e63c service neutron] Port 55861a7a-72d5-4966-9353-256005697a2c on network 4e122687-d2b4-4db2-bcc0-8820ad5e5b77 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81632 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 02 13:01:02.215189 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-96f5e93a-befb-49b8-8b93-96d909d7e63c service neutron] Attempting to bind port 55861a7a-72d5-4966-9353-256005697a2c on network 4e122687-d2b4-4db2-bcc0-8820ad5e5b77 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 13:01:02.224021 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-96f5e93a-befb-49b8-8b93-96d909d7e63c service neutron] Checking agent: {'id': '0d57fa42-4660-4f08-b7dc-53a872c3c01c', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81632', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'started_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 13, 0, 33), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 13:01:02.224710 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-96f5e93a-befb-49b8-8b93-96d909d7e63c service neutron] Checking segment: {'id': '0271db13-2254-4db8-b649-9b3f1a40557a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108543) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 13:01:02.225314 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-96f5e93a-befb-49b8-8b93-96d909d7e63c service neutron] Bound using segment: {'id': '0271db13-2254-4db8-b649-9b3f1a40557a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77'} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 13:01:02.226047 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-96f5e93a-befb-49b8-8b93-96d909d7e63c service neutron] Bound port: 55861a7a-72d5-4966-9353-256005697a2c, host: hv-cinder-81632, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '0271db13-2254-4db8-b649-9b3f1a40557a', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 871, 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77'}}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 13:01:02.226708 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-96f5e93a-befb-49b8-8b93-96d909d7e63c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:02.261136 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-e5d7c882-f31a-41a2-9ac8-de53ed7a70c7 admin admin] Deleting port 00f385af-6f0c-44fb-969a-cdf46435a745 {{(pid=108542) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:01:02.261525 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e5d7c882-f31a-41a2-9ac8-de53ed7a70c7 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:02.329730 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-96f5e93a-befb-49b8-8b93-96d909d7e63c service neutron] For port 55861a7a-72d5-4966-9353-256005697a2c, host hv-cinder-81632, cleared binding levels {{(pid=108543) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 13:01:02.335096 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-96f5e93a-befb-49b8-8b93-96d909d7e63c service neutron] For port 55861a7a-72d5-4966-9353-256005697a2c, host hv-cinder-81632, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=55861a7a-72d5-4966-9353-256005697a2c,segment=NetworkSegment(0271db13-2254-4db8-b649-9b3f1a40557a),segment_id=0271db13-2254-4db8-b649-9b3f1a40557a)] {{(pid=108543) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 13:01:02.346717 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-592a75f5-5ae5-4491-8174-8aa52f0b99f9 None None] DHCP port deletion for 9db25871-3a99-486f-97da-692e55836f96 request from dv-cinder-816324-1-iscsi {{(pid=108544) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 02 13:01:02.357479 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [None req-e5d7c882-f31a-41a2-9ac8-de53ed7a70c7 admin admin] For port 00f385af-6f0c-44fb-969a-cdf46435a745, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=00f385af-6f0c-44fb-969a-cdf46435a745,segment=NetworkSegment(3e37c0fd-0450-430c-9dfb-997dc0399ff6),segment_id=3e37c0fd-0450-430c-9dfb-997dc0399ff6)] {{(pid=108542) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:01:02.361782 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e5d7c882-f31a-41a2-9ac8-de53ed7a70c7 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:02.376990 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-e5d7c882-f31a-41a2-9ac8-de53ed7a70c7 admin admin] Calling delete_port for 00f385af-6f0c-44fb-969a-cdf46435a745 owned by network:dhcp {{(pid=108542) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:01:02.403859 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-592a75f5-5ae5-4491-8174-8aa52f0b99f9 None None] Deleting port 00f385af-6f0c-44fb-969a-cdf46435a745 {{(pid=108544) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:01:02.404234 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-592a75f5-5ae5-4491-8174-8aa52f0b99f9 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:02.455366 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-96f5e93a-befb-49b8-8b93-96d909d7e63c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:02.510728 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-592a75f5-5ae5-4491-8174-8aa52f0b99f9 None None] For port 00f385af-6f0c-44fb-969a-cdf46435a745, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=00f385af-6f0c-44fb-969a-cdf46435a745,segment=NetworkSegment(3e37c0fd-0450-430c-9dfb-997dc0399ff6),segment_id=3e37c0fd-0450-430c-9dfb-997dc0399ff6)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:01:02.511771 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-592a75f5-5ae5-4491-8174-8aa52f0b99f9 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:02.511941 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-96f5e93a-befb-49b8-8b93-96d909d7e63c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:01:02.512785 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-96f5e93a-befb-49b8-8b93-96d909d7e63c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:02.515181 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-96f5e93a-befb-49b8-8b93-96d909d7e63c service neutron] 10.222.0.90 "PUT /v2.0/ports/55861a7a-72d5-4966-9353-256005697a2c HTTP/1.1" status: 200 len: 1093 time: 1.2839313 Nov 02 13:01:02.515884 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5e9b362d-0d25-4a07-b397-4336433e27ae', 'tag': '55861a7a-72d5-4966-9353-256005697a2c'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 13:01:02.519551 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-5b3a1688-4c3f-4d4c-97c9-0f8ec9aba3e6" -d '{"events": [{"name": "network-changed", "server_uuid": "5e9b362d-0d25-4a07-b397-4336433e27ae", "tag": "55861a7a-72d5-4966-9353-256005697a2c"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 13:01:02.533930 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-592a75f5-5ae5-4491-8174-8aa52f0b99f9 None None] Calling delete_port for 00f385af-6f0c-44fb-969a-cdf46435a745 owned by network:dhcp {{(pid=108544) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:01:02.554134 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e5d7c882-f31a-41a2-9ac8-de53ed7a70c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:02.587674 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-96f5e93a-befb-49b8-8b93-96d909d7e63c service neutron] Pushing event updated for resources: {'Port': ['ID=55861a7a-72d5-4966-9353-256005697a2c,revision_number=3']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:01:02.603185 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 13:01:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-27592a4d-e875-46e1-a99d-d2cfb4e6bfc6 x-openstack-request-id: req-27592a4d-e875-46e1-a99d-d2cfb4e6bfc6 {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 13:01:02.603804 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5e9b362d-0d25-4a07-b397-4336433e27ae", "tag": "55861a7a-72d5-4966-9353-256005697a2c", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 13:01:02.604220 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-27592a4d-e875-46e1-a99d-d2cfb4e6bfc6 {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 13:01:02.605077 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5e9b362d-0d25-4a07-b397-4336433e27ae', 'tag': '55861a7a-72d5-4966-9353-256005697a2c', 'status': 'completed', 'code': 200} Nov 02 13:01:02.615539 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5d7c882-f31a-41a2-9ac8-de53ed7a70c7 admin admin] Pushing event deleted for resources: {'Port': ['ID=00f385af-6f0c-44fb-969a-cdf46435a745,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:01:02.623288 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 3248239a-54d8-4ba4-81f9-a3fa983dd829 no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 13:01:02.627360 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [None req-e5d7c882-f31a-41a2-9ac8-de53ed7a70c7 admin admin] No DVR routers for this DVR port 00f385af-6f0c-44fb-969a-cdf46435a745 on host dv-cinder-816324-1-iscsi {{(pid=108542) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 13:01:02.660706 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: 3248239a-54d8-4ba4-81f9-a3fa983dd829 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 13:01:02.661145 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 3248239a-54d8-4ba4-81f9-a3fa983dd829 not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 13:01:02.661830 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device b65f9b1f-06b2-4ae0-8e61-2d41782bdb81 no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 13:01:02.704170 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: b65f9b1f-06b2-4ae0-8e61-2d41782bdb81 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 13:01:02.704915 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device b65f9b1f-06b2-4ae0-8e61-2d41782bdb81 not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 13:01:02.705556 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 00f385af-6f0c-44fb-969a-cdf46435a745 no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 13:01:02.720481 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b3a1688-4c3f-4d4c-97c9-0f8ec9aba3e6 req-d938036e-3792-4b4d-8b4a-afb0d5cc857e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:01:02.723244 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5b3a1688-4c3f-4d4c-97c9-0f8ec9aba3e6 req-d938036e-3792-4b4d-8b4a-afb0d5cc857e service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=6064269d26644d27aaf12fd0ae66c0a9&device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 1096 time: 0.0980492 Nov 02 13:01:02.758013 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e5d7c882-f31a-41a2-9ac8-de53ed7a70c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-930985', 'neutron.services.segments.db._delete_segments_for_network-8738449897966'] for network, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:02.773110 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: 00f385af-6f0c-44fb-969a-cdf46435a745 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 13:01:02.773110 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 00f385af-6f0c-44fb-969a-cdf46435a745 not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 13:01:02.778291 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-592a75f5-5ae5-4491-8174-8aa52f0b99f9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678'] for port, after_delete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:02.800608 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-e5d7c882-f31a-41a2-9ac8-de53ed7a70c7 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9db25871-3a99-486f-97da-692e55836f96']}} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:01:02.812436 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-592a75f5-5ae5-4491-8174-8aa52f0b99f9 None None] Pushing event deleted for resources: {'Port': ['ID=00f385af-6f0c-44fb-969a-cdf46435a745,revision_number=None']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:01:02.813252 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-e5d7c882-f31a-41a2-9ac8-de53ed7a70c7 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '3e37c0fd-0450-430c-9dfb-997dc0399ff6') {'for_net_delete': True} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:01:02.813558 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-e5d7c882-f31a-41a2-9ac8-de53ed7a70c7 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '3e37c0fd-0450-430c-9dfb-997dc0399ff6') {} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:01:02.818161 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-592a75f5-5ae5-4491-8174-8aa52f0b99f9 None None] No DVR routers for this DVR port 00f385af-6f0c-44fb-969a-cdf46435a745 on host dv-cinder-816324-1-iscsi {{(pid=108544) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 13:01:02.826096 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e5d7c882-f31a-41a2-9ac8-de53ed7a70c7 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738449902583', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3344697'] for segment, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:02.847885 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e5d7c882-f31a-41a2-9ac8-de53ed7a70c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:02.859918 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-e5d7c882-f31a-41a2-9ac8-de53ed7a70c7 admin admin] Releasing vlan 882 on physical network physnet1 to pool {{(pid=108542) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 02 13:01:02.862787 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e5d7c882-f31a-41a2-9ac8-de53ed7a70c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126476581'] for segment, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: Traceback (most recent call last): Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: timer() Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: cb(*args, **kw) Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: return func(*args, **kwargs) Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: self._notify() Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: self.callback(batched_events) Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: event.method(event) Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: aggregate_uuid = self.p_client.list_aggregates( Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: return f(self, *a, **k) Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: return self._get(url).json() Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: return self.request(url, 'GET', **kwargs) Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: base_url = self.get_endpoint(auth, allow=allow, Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 02 13:01:02.864592 dv-cinder-816324-1-iscsi neutron-server[108542]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 02 13:01:02.912451 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b3a1688-4c3f-4d4c-97c9-0f8ec9aba3e6 req-d58240c6-9910-492a-a81e-e7e83fcb713e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:01:02.914038 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5b3a1688-4c3f-4d4c-97c9-0f8ec9aba3e6 req-d58240c6-9910-492a-a81e-e7e83fcb713e service neutron] 10.222.0.90 "GET /v2.0/networks?tenant_id=6064269d26644d27aaf12fd0ae66c0a9&shared=False HTTP/1.1" status: 200 len: 912 time: 0.1749613 Nov 02 13:01:03.020673 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e5d7c882-f31a-41a2-9ac8-de53ed7a70c7 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-930976', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1594946'] for network, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:03.028898 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-e5d7c882-f31a-41a2-9ac8-de53ed7a70c7 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:03.034660 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-e5d7c882-f31a-41a2-9ac8-de53ed7a70c7 admin admin] 10.222.0.98 "DELETE /v2.0/networks/9db25871-3a99-486f-97da-692e55836f96 HTTP/1.1" status: 204 len: 168 time: 0.9875858 Nov 02 13:01:03.049476 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-e5d7c882-f31a-41a2-9ac8-de53ed7a70c7 admin admin] Pushing event deleted for resources: {'Network': ['ID=9db25871-3a99-486f-97da-692e55836f96,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:01:03.058128 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-5b3a1688-4c3f-4d4c-97c9-0f8ec9aba3e6 req-4ba444c2-d9c0-4037-8c43-f62393d78eb0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:01:03.058296 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-5b3a1688-4c3f-4d4c-97c9-0f8ec9aba3e6 req-4ba444c2-d9c0-4037-8c43-f62393d78eb0 service neutron] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1332328 Nov 02 13:01:03.158832 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-7e46d48c-12c7-4b61-8506-7c0167231c14 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:01:03.160409 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-7e46d48c-12c7-4b61-8506-7c0167231c14 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=6064269d26644d27aaf12fd0ae66c0a9&device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 1096 time: 0.0521495 Nov 02 13:01:03.210896 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-d27b9fed-3911-41c3-bf99-79d5c4adbd09 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=55861a7a-72d5-4966-9353-256005697a2c HTTP/1.1" status: 200 len: 217 time: 0.0371511 Nov 02 13:01:03.274146 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-0a26343c-7b60-440f-b0dd-78b499315738 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:01:03.275820 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-0a26343c-7b60-440f-b0dd-78b499315738 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=0c2af8c2-0033-47ba-9f80-d43799d51067 HTTP/1.1" status: 200 len: 850 time: 0.0552902 Nov 02 13:01:03.368926 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-22cc3efa-5d0f-4f80-8fd9-b509350b133b service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:01:03.368926 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-22cc3efa-5d0f-4f80-8fd9-b509350b133b service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=4e122687-d2b4-4db2-bcc0-8820ad5e5b77&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0803068 Nov 02 13:01:03.403224 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9f81b4fe-6a34-4264-9286-5290710102c7 req-3469a3f4-69ab-4147-8f4f-248c4ff9e8bb tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:01:03.414959 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9f81b4fe-6a34-4264-9286-5290710102c7 req-3469a3f4-69ab-4147-8f4f-248c4ff9e8bb tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 943 time: 0.0866423 Nov 02 13:01:03.499792 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:03.509424 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9f81b4fe-6a34-4264-9286-5290710102c7 req-af9f8a47-e4a7-453b-83c1-504938a11d02 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=325ce627-98ec-42f4-b6e6-18cfdf6d084e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0936730 Nov 02 13:01:03.528130 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-4ac95d35-f380-4070-91a3-f31ab054f227 service neutron] 10.222.0.90 "GET /v2.0/networks/4e122687-d2b4-4db2-bcc0-8820ad5e5b77?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1470635 Nov 02 13:01:03.537390 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36098) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:01:03.595902 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-7038f9f5-0e76-4f28-8c3d-3c9568e29d8f admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=697de566c0334435b902950f6f31da45&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0571604 Nov 02 13:01:03.599005 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36100) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:01:03.649822 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-238a2a1e-8283-4952-8ff8-49af0c4b6436 req-cc19b2c1-08f7-428f-93dc-4072cce07104 service neutron] 10.222.0.90 "GET /v2.0/networks/4e122687-d2b4-4db2-bcc0-8820ad5e5b77?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1100359 Nov 02 13:01:03.659845 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5971b9d4-266e-49f3-9cb4-40251c25e79c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:03.683530 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5971b9d4-266e-49f3-9cb4-40251c25e79c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:03.838500 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5971b9d4-266e-49f3-9cb4-40251c25e79c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:03.841284 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5971b9d4-266e-49f3-9cb4-40251c25e79c admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:03.842490 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-5971b9d4-266e-49f3-9cb4-40251c25e79c admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/9d5da3ed-bc60-4581-ab0f-f49b32a79555 HTTP/1.1" status: 204 len: 168 time: 0.2425122 Nov 02 13:01:03.851378 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5971b9d4-266e-49f3-9cb4-40251c25e79c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=9d5da3ed-bc60-4581-ab0f-f49b32a79555,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:01:04.639846 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f8faa4f4-34a7-4305-8a90-794b0332e60c req-e4210011-3256-4bc0-b411-aede27de9fa2 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:01:04.641477 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f8faa4f4-34a7-4305-8a90-794b0332e60c req-e4210011-3256-4bc0-b411-aede27de9fa2 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 943 time: 0.0553920 Nov 02 13:01:04.664212 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36108) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:01:04.710681 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f8faa4f4-34a7-4305-8a90-794b0332e60c req-14245e22-329a-4384-a84b-5dcae0779a66 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=325ce627-98ec-42f4-b6e6-18cfdf6d084e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0616517 Nov 02 13:01:04.712722 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-103688ec-137c-4d5c-9487-2c228cd31730 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=ba62faa6d50348199fe5a7f1ef451ddf&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0468853 Nov 02 13:01:04.716600 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36110) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:01:04.789582 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-0b1d4de8-c0e4-4302-88c2-bafd326baf46 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:04.816506 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-0b1d4de8-c0e4-4302-88c2-bafd326baf46 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:04.981939 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-0b1d4de8-c0e4-4302-88c2-bafd326baf46 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:04.985121 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-0b1d4de8-c0e4-4302-88c2-bafd326baf46 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:04.986404 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-0b1d4de8-c0e4-4302-88c2-bafd326baf46 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/abbbc590-a7b1-4b96-8f08-5dc2dcd24e07 HTTP/1.1" status: 204 len: 168 time: 0.2688119 Nov 02 13:01:04.998933 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0b1d4de8-c0e4-4302-88c2-bafd326baf46 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=abbbc590-a7b1-4b96-8f08-5dc2dcd24e07,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:01:05.469868 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 13:01:05.837457 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-008aba5a-0b0a-4e73-82de-64f70cb8efe6 req-4c37ed78-06a1-4643-9549-7ad182f1a65c tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:01:05.838987 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-008aba5a-0b0a-4e73-82de-64f70cb8efe6 req-4c37ed78-06a1-4643-9549-7ad182f1a65c tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 943 time: 0.0500071 Nov 02 13:01:05.887300 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-008aba5a-0b0a-4e73-82de-64f70cb8efe6 req-ed35ec2e-77ed-448e-baef-9e6f058af05d tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=325ce627-98ec-42f4-b6e6-18cfdf6d084e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416427 Nov 02 13:01:06.133486 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 55861a7a-72d5-4966-9353-256005697a2c details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 13:01:06.232187 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 55861a7a-72d5-4966-9353-256005697a2c, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=55861a7a-72d5-4966-9353-256005697a2c,segment=NetworkSegment(0271db13-2254-4db8-b649-9b3f1a40557a),segment_id=0271db13-2254-4db8-b649-9b3f1a40557a)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:01:06.244427 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': '55861a7a-72d5-4966-9353-256005697a2c', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'port_id': '55861a7a-72d5-4966-9353-256005697a2c', 'mac_address': 'fa:16:3e:60:0b:d9', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 871, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 13:01:06.282492 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:06.295090 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id 55861a7a-72d5-4966-9353-256005697a2c {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 13:01:06.314854 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 55861a7a-72d5-4966-9353-256005697a2c, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=55861a7a-72d5-4966-9353-256005697a2c,segment=NetworkSegment(0271db13-2254-4db8-b649-9b3f1a40557a),segment_id=0271db13-2254-4db8-b649-9b3f1a40557a)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:01:06.397434 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:06.449358 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=55861a7a-72d5-4966-9353-256005697a2c,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:01:06.718884 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['55861a7a-72d5-4966-9353-256005697a2c'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 13:01:07.012994 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7d0249ce-577d-4e5a-a6db-cb45ec399a2d req-c78cbc7d-fd12-433e-977a-43523f773474 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:01:07.018364 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7d0249ce-577d-4e5a-a6db-cb45ec399a2d req-c78cbc7d-fd12-433e-977a-43523f773474 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 944 time: 0.0582273 Nov 02 13:01:07.064600 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7d0249ce-577d-4e5a-a6db-cb45ec399a2d req-08a79739-128e-4c04-88fa-c69136372704 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=325ce627-98ec-42f4-b6e6-18cfdf6d084e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0429051 Nov 02 13:01:08.150902 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 55861a7a-72d5-4966-9353-256005697a2c up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 13:01:08.254412 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning for port 55861a7a-72d5-4966-9353-256005697a2c completed by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 02 13:01:08.259047 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port 55861a7a-72d5-4966-9353-256005697a2c triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:01:08.259417 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:08.349064 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:08.376177 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5e9b362d-0d25-4a07-b397-4336433e27ae', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '55861a7a-72d5-4966-9353-256005697a2c'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 13:01:08.378569 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-d5ddd020-914e-462a-96be-57c12abf551b" -d '{"events": [{"server_uuid": "5e9b362d-0d25-4a07-b397-4336433e27ae", "name": "network-vif-plugged", "status": "completed", "tag": "55861a7a-72d5-4966-9353-256005697a2c"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 13:01:08.396722 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port 55861a7a-72d5-4966-9353-256005697a2c, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=55861a7a-72d5-4966-9353-256005697a2c,segment=NetworkSegment(0271db13-2254-4db8-b649-9b3f1a40557a),segment_id=0271db13-2254-4db8-b649-9b3f1a40557a)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:01:08.477863 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:08.482082 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ef999226-7c85-4c98-9a14-59d6be989ad0 req-2a41cad8-4546-4ff9-8730-8526ce235afc tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:01:08.483726 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ef999226-7c85-4c98-9a14-59d6be989ad0 req-2a41cad8-4546-4ff9-8730-8526ce235afc tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 944 time: 0.3521109 Nov 02 13:01:08.543367 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ef999226-7c85-4c98-9a14-59d6be989ad0 req-b5662251-5225-472c-bff6-6e80d7b1844c tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=325ce627-98ec-42f4-b6e6-18cfdf6d084e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0480967 Nov 02 13:01:08.548864 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=55861a7a-72d5-4966-9353-256005697a2c,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:01:08.626972 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 13:01:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-5a540316-e37c-4713-ad7f-99d066b50d27 x-openstack-request-id: req-5a540316-e37c-4713-ad7f-99d066b50d27 {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 13:01:08.627268 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5e9b362d-0d25-4a07-b397-4336433e27ae", "name": "network-vif-plugged", "status": "completed", "tag": "55861a7a-72d5-4966-9353-256005697a2c", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 13:01:08.627512 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-5a540316-e37c-4713-ad7f-99d066b50d27 {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 13:01:08.627906 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5e9b362d-0d25-4a07-b397-4336433e27ae', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': '55861a7a-72d5-4966-9353-256005697a2c', 'code': 200} Nov 02 13:01:08.995843 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-705f5932-2a8c-49e9-b6ba-cdf55c797e53 req-920bd7a0-fa4a-483a-b185-966f7357bd41 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:01:08.997417 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-705f5932-2a8c-49e9-b6ba-cdf55c797e53 req-920bd7a0-fa4a-483a-b185-966f7357bd41 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 1098 time: 0.0447154 Nov 02 13:01:09.057040 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-705f5932-2a8c-49e9-b6ba-cdf55c797e53 req-971e9b85-291f-411f-beef-76941d8b5d1e service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=325ce627-98ec-42f4-b6e6-18cfdf6d084e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0480974 Nov 02 13:01:09.660312 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8d8b5acb-0078-490a-810c-a3b95396ec04 req-ce924237-ceb6-4ba9-ab99-95f543047ea3 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:01:09.661786 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8d8b5acb-0078-490a-810c-a3b95396ec04 req-ce924237-ceb6-4ba9-ab99-95f543047ea3 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 945 time: 0.0502939 Nov 02 13:01:09.712041 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8d8b5acb-0078-490a-810c-a3b95396ec04 req-2a99cc4c-2417-47d4-a3b8-b1e7cfacc875 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=325ce627-98ec-42f4-b6e6-18cfdf6d084e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0435588 Nov 02 13:01:10.830465 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2aecf1d2-e03f-435c-a059-6add80a44820 req-02d17f14-08cc-4c3b-b089-40d0548793d1 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:01:10.831956 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2aecf1d2-e03f-435c-a059-6add80a44820 req-02d17f14-08cc-4c3b-b089-40d0548793d1 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 945 time: 0.0488257 Nov 02 13:01:10.879597 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2aecf1d2-e03f-435c-a059-6add80a44820 req-22e7af63-3db9-4220-a81e-fee369f737ab tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=325ce627-98ec-42f4-b6e6-18cfdf6d084e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0416846 Nov 02 13:01:10.993069 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-979bf1d1-891a-428a-9dcf-0b1c387022e2 req-2eb052d9-9f17-414c-9143-312c34c48876 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:01:10.995376 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-979bf1d1-891a-428a-9dcf-0b1c387022e2 req-2eb052d9-9f17-414c-9143-312c34c48876 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 945 time: 0.0510068 Nov 02 13:01:11.003974 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36130) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:01:11.008580 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-96dcb963-1c12-4fd3-b66f-6c224b55df7e tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Request body: {'floatingip': {'port_id': '55861a7a-72d5-4966-9353-256005697a2c'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 13:01:11.051413 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-96dcb963-1c12-4fd3-b66f-6c224b55df7e tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for floatingip, before_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:11.508401 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-96dcb963-1c12-4fd3-b66f-6c224b55df7e tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:11.591676 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-96dcb963-1c12-4fd3-b66f-6c224b55df7e tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1594992'] for floatingip, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:11.698615 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.db.l3_db [None req-96dcb963-1c12-4fd3-b66f-6c224b55df7e tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Floating IP 6438d90d-a9c8-464e-a9c9-c1c6d004e1c1 associated. External IP: 172.27.0.185, port: 55861a7a-72d5-4966-9353-256005697a2c. Nov 02 13:01:11.912002 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-96dcb963-1c12-4fd3-b66f-6c224b55df7e tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Router cf121ee7-8e7c-41c2-ad44-460321366ae3 has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108542) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 13:01:12.028304 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-96dcb963-1c12-4fd3-b66f-6c224b55df7e tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108542) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 13:01:12.034246 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-96dcb963-1c12-4fd3-b66f-6c224b55df7e tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for floatingip, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:12.041206 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6dfec0fa-b1bb-4309-a93d-c755962bba5d None None] Sync routers for ids ['cf121ee7-8e7c-41c2-ad44-460321366ae3'] in dv-cinder-816324-1-iscsi {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 13:01:12.051390 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6dfec0fa-b1bb-4309-a93d-c755962bba5d None None] Routers {'cf121ee7-8e7c-41c2-ad44-460321366ae3'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:01:12.052017 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-6dfec0fa-b1bb-4309-a93d-c755962bba5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:00:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['cf121ee7-8e7c-41c2-ad44-460321366ae3'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:01:12.068083 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-96dcb963-1c12-4fd3-b66f-6c224b55df7e tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "PUT /v2.0/floatingips/6438d90d-a9c8-464e-a9c9-c1c6d004e1c1 HTTP/1.1" status: 200 len: 991 time: 1.0629699 Nov 02 13:01:12.068679 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '5e9b362d-0d25-4a07-b397-4336433e27ae', 'tag': '55861a7a-72d5-4966-9353-256005697a2c'}] {{(pid=108542) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 13:01:12.071014 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8fdc2194739644bb754d6b187539f80d2eba7dc5c5d5392f1a2d22d03c0a316c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-4950b213-4e28-4a25-9cb6-47dbd6262fd2" -d '{"events": [{"name": "network-changed", "server_uuid": "5e9b362d-0d25-4a07-b397-4336433e27ae", "tag": "55861a7a-72d5-4966-9353-256005697a2c"}]}' {{(pid=108542) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 13:01:12.171343 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-6dfec0fa-b1bb-4309-a93d-c755962bba5d None None] Set router cf121ee7-8e7c-41c2-ad44-460321366ae3 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:01:12.232426 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 13:01:12 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-04c9b50d-8ecc-4d62-9cf3-50b26ec5071d x-openstack-request-id: req-04c9b50d-8ecc-4d62-9cf3-50b26ec5071d {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 13:01:12.232722 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "5e9b362d-0d25-4a07-b397-4336433e27ae", "tag": "55861a7a-72d5-4966-9353-256005697a2c", "status": "completed", "code": 200}]} {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 13:01:12.232979 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-04c9b50d-8ecc-4d62-9cf3-50b26ec5071d {{(pid=108542) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 13:01:12.233386 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '5e9b362d-0d25-4a07-b397-4336433e27ae', 'tag': '55861a7a-72d5-4966-9353-256005697a2c', 'status': 'completed', 'code': 200} Nov 02 13:01:12.299213 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4950b213-4e28-4a25-9cb6-47dbd6262fd2 req-6a3768a1-9de1-46d0-87d3-63f4b910742e service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:01:12.300693 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4950b213-4e28-4a25-9cb6-47dbd6262fd2 req-6a3768a1-9de1-46d0-87d3-63f4b910742e service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=6064269d26644d27aaf12fd0ae66c0a9&device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 1098 time: 0.0439610 Nov 02 13:01:12.398352 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4950b213-4e28-4a25-9cb6-47dbd6262fd2 req-ef57fb49-0258-498c-ad43-552ba43d3d52 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:01:12.399887 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4950b213-4e28-4a25-9cb6-47dbd6262fd2 req-ef57fb49-0258-498c-ad43-552ba43d3d52 service neutron] 10.222.0.90 "GET /v2.0/networks?id=4e122687-d2b4-4db2-bcc0-8820ad5e5b77 HTTP/1.1" status: 200 len: 912 time: 0.0907829 Nov 02 13:01:12.423756 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-6dfec0fa-b1bb-4309-a93d-c755962bba5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'name': 'tempest-AttachVolumeTestJSON-1054401684-router', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:57:38Z', 'updated_at': '2021-11-02T12:57:42Z', 'revision_number': 4, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'gw_port': {'id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:0e:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:39Z', 'updated_at': '2021-11-02T12:57:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': '6438d90d-a9c8-464e-a9c9-c1c6d004e1c1', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'floating_ip_address': '172.27.0.185', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'port_id': '55861a7a-72d5-4966-9353-256005697a2c', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 615, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'mac_address': 'fa:16:3e:60:0b:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e9b362d-0d25-4a07-b397-4336433e27ae', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T13:00:51Z', 'updated_at': '2021-11-02T13:01:11Z', 'revision_number': 1, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '29f4ed03-3784-40c8-9c15-00c1bd9d54cc', 'name': '', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'mac_address': 'fa:16:3e:db:98:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 597, 'fixed_ips': [{'subnet_id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:41Z', 'updated_at': '2021-11-02T12:57:45Z', 'revision_number': 5, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'subnets': [{'id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:01:12.451635 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6dfec0fa-b1bb-4309-a93d-c755962bba5d None None] Checking router: cf121ee7-8e7c-41c2-ad44-460321366ae3 for host: dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 13:01:12.460761 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6dfec0fa-b1bb-4309-a93d-c755962bba5d None None] Routers {'cf121ee7-8e7c-41c2-ad44-460321366ae3'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:01:12.461374 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-6dfec0fa-b1bb-4309-a93d-c755962bba5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 4, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 4, "log_agent_heartbeats": false, "routers": 4},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:00:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['cf121ee7-8e7c-41c2-ad44-460321366ae3'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:01:12.480954 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4950b213-4e28-4a25-9cb6-47dbd6262fd2 req-cbf03f89-52c8-4032-acd3-75e8ff243bcc service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=55861a7a-72d5-4966-9353-256005697a2c HTTP/1.1" status: 200 len: 999 time: 0.0676179 Nov 02 13:01:12.538402 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4950b213-4e28-4a25-9cb6-47dbd6262fd2 req-c8206913-8ed3-4eb7-a60f-bacfd5f7ef3c service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:01:12.539913 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4950b213-4e28-4a25-9cb6-47dbd6262fd2 req-c8206913-8ed3-4eb7-a60f-bacfd5f7ef3c service neutron] 10.222.0.90 "GET /v2.0/subnets?id=0c2af8c2-0033-47ba-9f80-d43799d51067 HTTP/1.1" status: 200 len: 850 time: 0.0480571 Nov 02 13:01:12.576590 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-6dfec0fa-b1bb-4309-a93d-c755962bba5d None None] Set router cf121ee7-8e7c-41c2-ad44-460321366ae3 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:01:12.585465 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4950b213-4e28-4a25-9cb6-47dbd6262fd2 req-25ebcc3a-7f2f-4920-9410-f7bcc5287afe service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:01:12.587036 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4950b213-4e28-4a25-9cb6-47dbd6262fd2 req-25ebcc3a-7f2f-4920-9410-f7bcc5287afe service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=4e122687-d2b4-4db2-bcc0-8820ad5e5b77&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0402896 Nov 02 13:01:12.686065 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4950b213-4e28-4a25-9cb6-47dbd6262fd2 req-318c0cae-8b31-4c57-97ce-d3ea095785c6 service neutron] 10.222.0.90 "GET /v2.0/networks/4e122687-d2b4-4db2-bcc0-8820ad5e5b77?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0915887 Nov 02 13:01:12.780024 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4950b213-4e28-4a25-9cb6-47dbd6262fd2 req-15ea2e6f-cc58-4643-83e4-b679ba63b177 service neutron] 10.222.0.90 "GET /v2.0/networks/4e122687-d2b4-4db2-bcc0-8820ad5e5b77?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0858855 Nov 02 13:01:12.821611 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-6dfec0fa-b1bb-4309-a93d-c755962bba5d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'name': 'tempest-AttachVolumeTestJSON-1054401684-router', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:57:38Z', 'updated_at': '2021-11-02T12:57:42Z', 'revision_number': 4, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'gw_port': {'id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:0e:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:39Z', 'updated_at': '2021-11-02T12:57:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': '6438d90d-a9c8-464e-a9c9-c1c6d004e1c1', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'floating_ip_address': '172.27.0.185', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'port_id': '55861a7a-72d5-4966-9353-256005697a2c', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 615, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'mac_address': 'fa:16:3e:60:0b:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e9b362d-0d25-4a07-b397-4336433e27ae', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T13:00:51Z', 'updated_at': '2021-11-02T13:01:11Z', 'revision_number': 1, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '29f4ed03-3784-40c8-9c15-00c1bd9d54cc', 'name': '', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'mac_address': 'fa:16:3e:db:98:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 597, 'fixed_ips': [{'subnet_id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:41Z', 'updated_at': '2021-11-02T12:57:45Z', 'revision_number': 5, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'subnets': [{'id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:01:12.848856 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6dfec0fa-b1bb-4309-a93d-c755962bba5d None None] The sync data for ids ['cf121ee7-8e7c-41c2-ad44-460321366ae3'] in dv-cinder-816324-1-iscsi is: [{'id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'name': 'tempest-AttachVolumeTestJSON-1054401684-router', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:57:38Z', 'updated_at': '2021-11-02T12:57:42Z', 'revision_number': 4, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'gw_port': {'id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:0e:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:39Z', 'updated_at': '2021-11-02T12:57:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': '6438d90d-a9c8-464e-a9c9-c1c6d004e1c1', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'floating_ip_address': '172.27.0.185', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'port_id': '55861a7a-72d5-4966-9353-256005697a2c', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 615, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'mac_address': 'fa:16:3e:60:0b:d9', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '5e9b362d-0d25-4a07-b397-4336433e27ae', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T13:00:51Z', 'updated_at': '2021-11-02T13:01:11Z', 'revision_number': 1, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '29f4ed03-3784-40c8-9c15-00c1bd9d54cc', 'name': '', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'mac_address': 'fa:16:3e:db:98:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 597, 'fixed_ips': [{'subnet_id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:41Z', 'updated_at': '2021-11-02T12:57:45Z', 'revision_number': 5, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'subnets': [{'id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 13:01:13.046830 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-62cc894c-8b4b-4496-a315-589bf2759c12 None None] New status for floating IP 6438d90d-a9c8-464e-a9c9-c1c6d004e1c1: ACTIVE {{(pid=108544) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 02 13:01:23.558083 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-2fbb2036-8332-4634-a3eb-d0bca6770699 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:25.630597 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-d5cfc405-4305-4234-af3e-473581307c15 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:26.905556 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:28.402882 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:30.865299 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:33.469996 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:42.470066 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 13:01:53.510445 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-e88ef3f9-4e96-4d74-9c2b-4e339b9e0d97 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:55.688523 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-b577fea8-4dd9-4991-81e8-5ee9fc5a2b52 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:56.922655 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:01:58.377904 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:00.824876 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:03.447324 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:13.898345 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-872a6dff-7453-4799-91aa-fdaada74eec8 req-9ea6ac5a-5d04-4471-b371-5912274d1bb7 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=5e9b362d-0d25-4a07-b397-4336433e27ae&fields=binding%3Ahost_id&fields=binding%3Avif_type HTTP/1.1" status: 200 len: 275 time: 0.0626810 Nov 02 13:02:14.031510 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-872a6dff-7453-4799-91aa-fdaada74eec8 req-15510cc9-49f5-418c-b1b5-2e249dec526f service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:02:14.034010 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-872a6dff-7453-4799-91aa-fdaada74eec8 req-15510cc9-49f5-418c-b1b5-2e249dec526f service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=6064269d26644d27aaf12fd0ae66c0a9&device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 1098 time: 0.0707505 Nov 02 13:02:14.196484 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-872a6dff-7453-4799-91aa-fdaada74eec8 req-80444abf-2ac5-49a4-8bca-4b901f5a4680 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:02:14.199331 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-872a6dff-7453-4799-91aa-fdaada74eec8 req-80444abf-2ac5-49a4-8bca-4b901f5a4680 service neutron] 10.222.0.90 "GET /v2.0/networks?id=4e122687-d2b4-4db2-bcc0-8820ad5e5b77 HTTP/1.1" status: 200 len: 912 time: 0.1390424 Nov 02 13:02:14.296941 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-872a6dff-7453-4799-91aa-fdaada74eec8 req-e2337f83-0aae-4c31-aa9a-6eb4f9dac439 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=55861a7a-72d5-4966-9353-256005697a2c HTTP/1.1" status: 200 len: 1001 time: 0.0903788 Nov 02 13:02:14.372281 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-872a6dff-7453-4799-91aa-fdaada74eec8 req-1d45c9bf-b88d-41ab-a994-ac9d984fdf95 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:02:14.373931 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-872a6dff-7453-4799-91aa-fdaada74eec8 req-1d45c9bf-b88d-41ab-a994-ac9d984fdf95 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=0c2af8c2-0033-47ba-9f80-d43799d51067 HTTP/1.1" status: 200 len: 850 time: 0.0685773 Nov 02 13:02:14.444761 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-872a6dff-7453-4799-91aa-fdaada74eec8 req-0e0ae4e9-e8b8-4a18-bb59-f0dcb519ac31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:02:14.448004 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-872a6dff-7453-4799-91aa-fdaada74eec8 req-0e0ae4e9-e8b8-4a18-bb59-f0dcb519ac31 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=4e122687-d2b4-4db2-bcc0-8820ad5e5b77&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0601258 Nov 02 13:02:14.614941 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-872a6dff-7453-4799-91aa-fdaada74eec8 req-4d07fee2-f95a-4d96-b0ad-5502fd210555 service neutron] 10.222.0.90 "GET /v2.0/networks/4e122687-d2b4-4db2-bcc0-8820ad5e5b77?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1558900 Nov 02 13:02:14.735315 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-872a6dff-7453-4799-91aa-fdaada74eec8 req-e82da19a-3afa-4757-8f01-c06e19ce640b service neutron] 10.222.0.90 "GET /v2.0/networks/4e122687-d2b4-4db2-bcc0-8820ad5e5b77?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1075943 Nov 02 13:02:19.470920 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 13:02:20.729566 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-879018a8-70c2-4acf-b377-b1dd5323f37a req-23b18d5c-d4ea-446b-baf3-027c486eb68b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:02:20.731434 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-879018a8-70c2-4acf-b377-b1dd5323f37a req-23b18d5c-d4ea-446b-baf3-027c486eb68b tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 945 time: 0.0722835 Nov 02 13:02:20.805273 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-879018a8-70c2-4acf-b377-b1dd5323f37a req-30da3085-163b-46f4-9482-6cf7ef8ecbfb tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=325ce627-98ec-42f4-b6e6-18cfdf6d084e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0613801 Nov 02 13:02:21.981405 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-244a3a10-8d49-462c-bd7f-cbc20b9aaf0d req-62fcd92c-c7f5-423e-ae51-ac6537744cfa tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:02:21.984049 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-244a3a10-8d49-462c-bd7f-cbc20b9aaf0d req-62fcd92c-c7f5-423e-ae51-ac6537744cfa tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 945 time: 0.0732000 Nov 02 13:02:22.053306 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-244a3a10-8d49-462c-bd7f-cbc20b9aaf0d req-0551aef2-6d83-42f9-8da6-54c598516e4f tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=325ce627-98ec-42f4-b6e6-18cfdf6d084e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.0576940 Nov 02 13:02:22.630301 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1be66b83-9cbb-4d53-a8dc-f026333c3a0d req-1db5b911-5140-45fe-a9eb-23d991145d82 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:02:22.633658 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1be66b83-9cbb-4d53-a8dc-f026333c3a0d req-1db5b911-5140-45fe-a9eb-23d991145d82 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.90 "GET /v2.0/ports?device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 945 time: 0.0818849 Nov 02 13:02:22.769696 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-1be66b83-9cbb-4d53-a8dc-f026333c3a0d req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Deleting port 55861a7a-72d5-4966-9353-256005697a2c {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:02:22.770157 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-1be66b83-9cbb-4d53-a8dc-f026333c3a0d req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:22.879892 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-1be66b83-9cbb-4d53-a8dc-f026333c3a0d req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] For port 55861a7a-72d5-4966-9353-256005697a2c, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=55861a7a-72d5-4966-9353-256005697a2c,segment=NetworkSegment(0271db13-2254-4db8-b649-9b3f1a40557a),segment_id=0271db13-2254-4db8-b649-9b3f1a40557a)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:02:22.880248 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-1be66b83-9cbb-4d53-a8dc-f026333c3a0d req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:23.129670 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-1be66b83-9cbb-4d53-a8dc-f026333c3a0d req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for floatingip, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:23.130460 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-1be66b83-9cbb-4d53-a8dc-f026333c3a0d req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1594992'] for floatingip, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:23.130835 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.db.l3_db [req-1be66b83-9cbb-4d53-a8dc-f026333c3a0d req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Floating IP 6438d90d-a9c8-464e-a9c9-c1c6d004e1c1 disassociated. External IP: 172.27.0.185, port: 55861a7a-72d5-4966-9353-256005697a2c. Nov 02 13:02:23.131435 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-1be66b83-9cbb-4d53-a8dc-f026333c3a0d req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Calling delete_port for 55861a7a-72d5-4966-9353-256005697a2c owned by compute:nova {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:02:23.279952 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-aefd7a16-b4d8-4dfb-ad86-d473d52db6e9 req-fadda926-690c-4327-8c48-08203f09ae74 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:02:23.281766 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-aefd7a16-b4d8-4dfb-ad86-d473d52db6e9 req-fadda926-690c-4327-8c48-08203f09ae74 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 945 time: 0.0916543 Nov 02 13:02:23.447715 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-aefd7a16-b4d8-4dfb-ad86-d473d52db6e9 req-00cd7dc1-f64e-48c8-8824-5787229aaebb tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups?id=325ce627-98ec-42f4-b6e6-18cfdf6d084e&fields=id&fields=name HTTP/1.1" status: 200 len: 313 time: 0.1538806 Nov 02 13:02:23.527463 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-1be66b83-9cbb-4d53-a8dc-f026333c3a0d req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:23.540269 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-dd996e0b-1be3-43ea-91b2-bd49cd354871 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:23.566853 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Pushing event deleted for resources: {'Port': ['ID=55861a7a-72d5-4966-9353-256005697a2c,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:02:23.581902 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:23.582396 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:23.583057 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:23.583546 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:23.584001 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:23.584475 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:23.585001 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:23.585433 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:23.586453 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:23.586885 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:23.587307 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:23.587722 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:23.749596 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.l3_agent_scheduler [req-1be66b83-9cbb-4d53-a8dc-f026333c3a0d req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Router cf121ee7-8e7c-41c2-ad44-460321366ae3 has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108543) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 13:02:23.878640 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [req-1be66b83-9cbb-4d53-a8dc-f026333c3a0d req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108543) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 13:02:23.894549 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05646348-3cd3-4351-b81e-2d9b36c2f449 None None] Sync routers for ids ['cf121ee7-8e7c-41c2-ad44-460321366ae3'] in dv-cinder-816324-1-iscsi {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 13:02:23.913887 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05646348-3cd3-4351-b81e-2d9b36c2f449 None None] Routers {'cf121ee7-8e7c-41c2-ad44-460321366ae3'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:02:23.914901 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-05646348-3cd3-4351-b81e-2d9b36c2f449 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:01:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['cf121ee7-8e7c-41c2-ad44-460321366ae3'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:02:23.937820 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-1be66b83-9cbb-4d53-a8dc-f026333c3a0d req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] No DVR routers for this DVR port 55861a7a-72d5-4966-9353-256005697a2c on host hv-cinder-81632 {{(pid=108543) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 13:02:23.941950 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-1be66b83-9cbb-4d53-a8dc-f026333c3a0d req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:23.948782 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1be66b83-9cbb-4d53-a8dc-f026333c3a0d req-129ee097-3629-4d90-a42c-0753bc68fe59 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.90 "DELETE /v2.0/ports/55861a7a-72d5-4966-9353-256005697a2c HTTP/1.1" status: 204 len: 173 time: 1.3041403 Nov 02 13:02:23.949511 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '5e9b362d-0d25-4a07-b397-4336433e27ae', 'name': 'network-vif-deleted', 'tag': '55861a7a-72d5-4966-9353-256005697a2c'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 13:02:23.953662 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-3e1d534e-2f5a-4065-a80c-66275a9289f8" -d '{"events": [{"server_uuid": "5e9b362d-0d25-4a07-b397-4336433e27ae", "name": "network-vif-deleted", "tag": "55861a7a-72d5-4966-9353-256005697a2c"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 13:02:24.146014 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-05646348-3cd3-4351-b81e-2d9b36c2f449 None None] Set router cf121ee7-8e7c-41c2-ad44-460321366ae3 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:02:24.234768 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 13:02:23 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-012ff046-ceb1-4ce0-b600-ed9b29d5052d x-openstack-request-id: req-012ff046-ceb1-4ce0-b600-ed9b29d5052d {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 13:02:24.235639 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "5e9b362d-0d25-4a07-b397-4336433e27ae", "name": "network-vif-deleted", "tag": "55861a7a-72d5-4966-9353-256005697a2c", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 13:02:24.235639 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-012ff046-ceb1-4ce0-b600-ed9b29d5052d {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 13:02:24.236056 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '5e9b362d-0d25-4a07-b397-4336433e27ae', 'name': 'network-vif-deleted', 'tag': '55861a7a-72d5-4966-9353-256005697a2c', 'status': 'completed', 'code': 200} Nov 02 13:02:24.551985 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-05646348-3cd3-4351-b81e-2d9b36c2f449 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'name': 'tempest-AttachVolumeTestJSON-1054401684-router', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:57:38Z', 'updated_at': '2021-11-02T12:57:42Z', 'revision_number': 4, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'gw_port': {'id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:0e:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:39Z', 'updated_at': '2021-11-02T12:57:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '29f4ed03-3784-40c8-9c15-00c1bd9d54cc', 'name': '', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'mac_address': 'fa:16:3e:db:98:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 597, 'fixed_ips': [{'subnet_id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:41Z', 'updated_at': '2021-11-02T12:57:45Z', 'revision_number': 5, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'subnets': [{'id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:02:24.606747 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05646348-3cd3-4351-b81e-2d9b36c2f449 None None] Checking router: cf121ee7-8e7c-41c2-ad44-460321366ae3 for host: dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 13:02:24.621882 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-05646348-3cd3-4351-b81e-2d9b36c2f449 None None] Routers {'cf121ee7-8e7c-41c2-ad44-460321366ae3'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:02:24.622996 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-05646348-3cd3-4351-b81e-2d9b36c2f449 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:01:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['cf121ee7-8e7c-41c2-ad44-460321366ae3'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:02:24.665083 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9df780ee-03cc-4a2d-9896-fa96b52c22d4 req-61f4554d-1956-4ea7-b9c2-55a3692d9a78 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/ports?device_id=5e9b362d-0d25-4a07-b397-4336433e27ae HTTP/1.1" status: 200 len: 210 time: 0.0515125 Nov 02 13:02:24.966038 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-05646348-3cd3-4351-b81e-2d9b36c2f449 None None] Set router cf121ee7-8e7c-41c2-ad44-460321366ae3 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:02:25.366229 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-05646348-3cd3-4351-b81e-2d9b36c2f449 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'name': 'tempest-AttachVolumeTestJSON-1054401684-router', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:57:38Z', 'updated_at': '2021-11-02T12:57:42Z', 'revision_number': 4, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'gw_port': {'id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:0e:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:39Z', 'updated_at': '2021-11-02T12:57:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '29f4ed03-3784-40c8-9c15-00c1bd9d54cc', 'name': '', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'mac_address': 'fa:16:3e:db:98:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 597, 'fixed_ips': [{'subnet_id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:41Z', 'updated_at': '2021-11-02T12:57:45Z', 'revision_number': 5, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'subnets': [{'id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:02:25.424190 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-05646348-3cd3-4351-b81e-2d9b36c2f449 None None] The sync data for ids ['cf121ee7-8e7c-41c2-ad44-460321366ae3'] in dv-cinder-816324-1-iscsi is: [{'id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'name': 'tempest-AttachVolumeTestJSON-1054401684-router', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:57:38Z', 'updated_at': '2021-11-02T12:57:42Z', 'revision_number': 4, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'gw_port': {'id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:0e:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:39Z', 'updated_at': '2021-11-02T12:57:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '29f4ed03-3784-40c8-9c15-00c1bd9d54cc', 'name': '', 'network_id': '4e122687-d2b4-4db2-bcc0-8820ad5e5b77', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'mac_address': 'fa:16:3e:db:98:04', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_interface', 'standard_attr_id': 597, 'fixed_ips': [{'subnet_id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:41Z', 'updated_at': '2021-11-02T12:57:45Z', 'revision_number': 5, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'subnets': [{'id': '0c2af8c2-0033-47ba-9f80-d43799d51067', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 13:02:25.676110 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-658a7b46-6ee0-4227-ac5c-948fa8939638 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:25.791955 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-1a301adc-5b82-47ff-88cd-b4e0f0df6c4e None None] New status for floating IP 6438d90d-a9c8-464e-a9c9-c1c6d004e1c1: DOWN {{(pid=108544) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 02 13:02:25.854214 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36360) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:02:25.965449 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5727c2e1-0565-4ae4-8b6c-831757bab2e5 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:26.015226 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5727c2e1-0565-4ae4-8b6c-831757bab2e5 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:26.178816 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5727c2e1-0565-4ae4-8b6c-831757bab2e5 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:26.183935 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-5727c2e1-0565-4ae4-8b6c-831757bab2e5 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:26.188135 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-5727c2e1-0565-4ae4-8b6c-831757bab2e5 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "DELETE /v2.0/security-groups/325ce627-98ec-42f4-b6e6-18cfdf6d084e HTTP/1.1" status: 204 len: 168 time: 0.3290389 Nov 02 13:02:26.190744 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 36364) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:02:26.202556 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5727c2e1-0565-4ae4-8b6c-831757bab2e5 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=325ce627-98ec-42f4-b6e6-18cfdf6d084e,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:02:26.214708 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.api.v2.resource [None req-c6097176-2616-40fe-aeab-ab0ac38a40fe tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] show failed (client error): The resource could not be found. Nov 02 13:02:26.217151 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-c6097176-2616-40fe-aeab-ab0ac38a40fe tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "GET /v2.0/security-groups/325ce627-98ec-42f4-b6e6-18cfdf6d084e HTTP/1.1" status: 404 len: 347 time: 0.0238748 Nov 02 13:02:26.217329 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5727c2e1-0565-4ae4-8b6c-831757bab2e5 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:26.217329 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5727c2e1-0565-4ae4-8b6c-831757bab2e5 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:26.217613 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5727c2e1-0565-4ae4-8b6c-831757bab2e5 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:26.218128 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5727c2e1-0565-4ae4-8b6c-831757bab2e5 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:26.218731 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5727c2e1-0565-4ae4-8b6c-831757bab2e5 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:26.219299 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5727c2e1-0565-4ae4-8b6c-831757bab2e5 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:26.219854 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5727c2e1-0565-4ae4-8b6c-831757bab2e5 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:26.220433 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5727c2e1-0565-4ae4-8b6c-831757bab2e5 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:26.221007 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5727c2e1-0565-4ae4-8b6c-831757bab2e5 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:26.221189 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 36366) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:02:26.221567 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5727c2e1-0565-4ae4-8b6c-831757bab2e5 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:26.222129 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5727c2e1-0565-4ae4-8b6c-831757bab2e5 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:26.222756 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5727c2e1-0565-4ae4-8b6c-831757bab2e5 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:26.450827 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-605cb7f7-262f-46f4-a589-62f8a8be7071 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Deleting port fd363d5b-45d7-4741-8379-8650e2925edc {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:02:26.451321 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-605cb7f7-262f-46f4-a589-62f8a8be7071 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:26.584678 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-605cb7f7-262f-46f4-a589-62f8a8be7071 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:26.585240 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-605cb7f7-262f-46f4-a589-62f8a8be7071 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:26.594015 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 55861a7a-72d5-4966-9353-256005697a2c no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 13:02:26.610227 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-605cb7f7-262f-46f4-a589-62f8a8be7071 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Calling delete_port for fd363d5b-45d7-4741-8379-8650e2925edc owned by network:floatingip {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:02:26.639772 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] No Port match for: 55861a7a-72d5-4966-9353-256005697a2c {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 13:02:26.640345 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device 55861a7a-72d5-4966-9353-256005697a2c not bound to the agent host hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 13:02:26.887731 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:26.910727 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-605cb7f7-262f-46f4-a589-62f8a8be7071 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:26.961073 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-605cb7f7-262f-46f4-a589-62f8a8be7071 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Pushing event deleted for resources: {'Port': ['ID=fd363d5b-45d7-4741-8379-8650e2925edc,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:02:27.077994 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-605cb7f7-262f-46f4-a589-62f8a8be7071 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks [] for floatingip, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:27.082661 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-605cb7f7-262f-46f4-a589-62f8a8be7071 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for floatingip, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:27.084661 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-605cb7f7-262f-46f4-a589-62f8a8be7071 tempest-AttachVolumeTestJSON-1642287979 tempest-AttachVolumeTestJSON-1642287979-project] 10.222.0.98 "DELETE /v2.0/floatingips/6438d90d-a9c8-464e-a9c9-c1c6d004e1c1 HTTP/1.1" status: 204 len: 168 time: 0.8620291 Nov 02 13:02:28.473535 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:30.836558 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:31.487089 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 36394) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:02:32.080696 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-936c02ff-1078-471b-9240-33c32085d7db admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1590128'] for router_interface, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:32.481693 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-936c02ff-1078-471b-9240-33c32085d7db admin admin] Deleting port 29f4ed03-3784-40c8-9c15-00c1bd9d54cc {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:02:32.482249 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-936c02ff-1078-471b-9240-33c32085d7db admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:32.627193 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [None req-936c02ff-1078-471b-9240-33c32085d7db admin admin] For port 29f4ed03-3784-40c8-9c15-00c1bd9d54cc, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=29f4ed03-3784-40c8-9c15-00c1bd9d54cc,segment=NetworkSegment(0271db13-2254-4db8-b649-9b3f1a40557a),segment_id=0271db13-2254-4db8-b649-9b3f1a40557a)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:02:32.628109 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-936c02ff-1078-471b-9240-33c32085d7db admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:32.645573 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-936c02ff-1078-471b-9240-33c32085d7db admin admin] Calling delete_port for 29f4ed03-3784-40c8-9c15-00c1bd9d54cc owned by network:router_interface {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:02:33.006972 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-936c02ff-1078-471b-9240-33c32085d7db admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:33.037877 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-936c02ff-1078-471b-9240-33c32085d7db admin admin] Pushing event deleted for resources: {'Port': ['ID=29f4ed03-3784-40c8-9c15-00c1bd9d54cc,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:02:33.317581 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-936c02ff-1078-471b-9240-33c32085d7db admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1649147', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1591488'] for router_interface, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:33.475509 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:33.589417 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-936c02ff-1078-471b-9240-33c32085d7db admin admin] Router cf121ee7-8e7c-41c2-ad44-460321366ae3 has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108543) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 13:02:33.763728 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-936c02ff-1078-471b-9240-33c32085d7db admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108543) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 13:02:33.770715 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-936c02ff-1078-471b-9240-33c32085d7db admin admin] 10.222.0.98 "PUT /v2.0/routers/cf121ee7-8e7c-41c2-ad44-460321366ae3/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 2.2819450 Nov 02 13:02:33.774122 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 36396) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:02:33.778086 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a303a4c-6b80-48cd-bbbb-fd73e55e7f9d None None] Sync routers for ids ['cf121ee7-8e7c-41c2-ad44-460321366ae3'] in dv-cinder-816324-1-iscsi {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 13:02:33.790846 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a303a4c-6b80-48cd-bbbb-fd73e55e7f9d None None] Routers {'cf121ee7-8e7c-41c2-ad44-460321366ae3'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:02:33.791622 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-6a303a4c-6b80-48cd-bbbb-fd73e55e7f9d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:02:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['cf121ee7-8e7c-41c2-ad44-460321366ae3'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:02:33.929722 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-6a303a4c-6b80-48cd-bbbb-fd73e55e7f9d None None] Set router cf121ee7-8e7c-41c2-ad44-460321366ae3 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:02:33.949359 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0cd08b8b-d665-40c9-a6c0-d2eab04f71f6 admin admin] Publish callbacks [] for router, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:34.222352 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-6a303a4c-6b80-48cd-bbbb-fd73e55e7f9d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'name': 'tempest-AttachVolumeTestJSON-1054401684-router', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:57:38Z', 'updated_at': '2021-11-02T13:02:32Z', 'revision_number': 5, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'gw_port': {'id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:0e:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:39Z', 'updated_at': '2021-11-02T12:57:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:02:34.268813 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a303a4c-6b80-48cd-bbbb-fd73e55e7f9d None None] Checking router: cf121ee7-8e7c-41c2-ad44-460321366ae3 for host: dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 13:02:34.281227 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6a303a4c-6b80-48cd-bbbb-fd73e55e7f9d None None] Routers {'cf121ee7-8e7c-41c2-ad44-460321366ae3'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:02:34.282277 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-6a303a4c-6b80-48cd-bbbb-fd73e55e7f9d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:02:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['cf121ee7-8e7c-41c2-ad44-460321366ae3'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:02:34.448468 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-6a303a4c-6b80-48cd-bbbb-fd73e55e7f9d None None] Set router cf121ee7-8e7c-41c2-ad44-460321366ae3 gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:02:34.501278 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0cd08b8b-d665-40c9-a6c0-d2eab04f71f6 admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:34.676814 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-0cd08b8b-d665-40c9-a6c0-d2eab04f71f6 admin admin] Deleting port 8a56dbe9-75f7-4598-a2ef-687071c1fb71 {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:02:34.677252 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0cd08b8b-d665-40c9-a6c0-d2eab04f71f6 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:34.696925 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-6a303a4c-6b80-48cd-bbbb-fd73e55e7f9d None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'name': 'tempest-AttachVolumeTestJSON-1054401684-router', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:57:38Z', 'updated_at': '2021-11-02T13:02:32Z', 'revision_number': 5, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'gw_port': {'id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:0e:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:39Z', 'updated_at': '2021-11-02T12:57:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:02:34.732104 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-6a303a4c-6b80-48cd-bbbb-fd73e55e7f9d None None] The sync data for ids ['cf121ee7-8e7c-41c2-ad44-460321366ae3'] in dv-cinder-816324-1-iscsi is: [{'id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'name': 'tempest-AttachVolumeTestJSON-1054401684-router', 'tenant_id': '6064269d26644d27aaf12fd0ae66c0a9', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220'}], 'enable_snat': True}, 'gw_port_id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T12:57:38Z', 'updated_at': '2021-11-02T13:02:32Z', 'revision_number': 5, 'project_id': '6064269d26644d27aaf12fd0ae66c0a9', 'gw_port': {'id': '8a56dbe9-75f7-4598-a2ef-687071c1fb71', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:2e:0e:ad', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': 'cf121ee7-8e7c-41c2-ad44-460321366ae3', 'device_owner': 'network:router_gateway', 'standard_attr_id': 596, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.220', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T12:57:39Z', 'updated_at': '2021-11-02T12:57:44Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}] {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 13:02:34.789590 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [None req-0cd08b8b-d665-40c9-a6c0-d2eab04f71f6 admin admin] For port 8a56dbe9-75f7-4598-a2ef-687071c1fb71, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=8a56dbe9-75f7-4598-a2ef-687071c1fb71,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:02:34.790308 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0cd08b8b-d665-40c9-a6c0-d2eab04f71f6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:34.811253 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-0cd08b8b-d665-40c9-a6c0-d2eab04f71f6 admin admin] Calling delete_port for 8a56dbe9-75f7-4598-a2ef-687071c1fb71 owned by network:router_gateway {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:02:35.109641 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0cd08b8b-d665-40c9-a6c0-d2eab04f71f6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:35.142344 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-0cd08b8b-d665-40c9-a6c0-d2eab04f71f6 admin admin] Pushing event deleted for resources: {'Port': ['ID=8a56dbe9-75f7-4598-a2ef-687071c1fb71,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:02:35.215853 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0cd08b8b-d665-40c9-a6c0-d2eab04f71f6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1595046'] for router_gateway, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:35.320183 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0cd08b8b-d665-40c9-a6c0-d2eab04f71f6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1593116', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-25699'] for router, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:35.322739 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0cd08b8b-d665-40c9-a6c0-d2eab04f71f6 admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:35.481123 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0cd08b8b-d665-40c9-a6c0-d2eab04f71f6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1593093'] for router, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:35.481666 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-0cd08b8b-d665-40c9-a6c0-d2eab04f71f6 admin admin] Fanout notify agent at l3_agent the message router_deleted on router cf121ee7-8e7c-41c2-ad44-460321366ae3 {{(pid=108543) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 02 13:02:35.486484 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-0cd08b8b-d665-40c9-a6c0-d2eab04f71f6 admin admin] Publish callbacks [] for router, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:35.487714 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-0cd08b8b-d665-40c9-a6c0-d2eab04f71f6 admin admin] 10.222.0.98 "DELETE /v2.0/routers/cf121ee7-8e7c-41c2-ad44-460321366ae3 HTTP/1.1" status: 204 len: 168 time: 1.7119141 Nov 02 13:02:35.490362 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 36398) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:02:35.540990 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_v2 [None req-39605576-bb0e-47a3-a87b-a7872acf0fba admin admin] Deleting subnet 0c2af8c2-0033-47ba-9f80-d43799d51067 {{(pid=108543) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 02 13:02:35.544656 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-39605576-bb0e-47a3-a87b-a7872acf0fba admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:35.600312 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-39605576-bb0e-47a3-a87b-a7872acf0fba admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3308629'] for subnet, precommit_delete_associations {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:35.760614 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-39605576-bb0e-47a3-a87b-a7872acf0fba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-933154'] for subnet, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:35.916167 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-39605576-bb0e-47a3-a87b-a7872acf0fba admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-933141', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126393134', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126244844'] for subnet, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:35.948634 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-39605576-bb0e-47a3-a87b-a7872acf0fba admin admin] Pushing event deleted for resources: {'Subnet': ['ID=0c2af8c2-0033-47ba-9f80-d43799d51067,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:02:35.954022 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-39605576-bb0e-47a3-a87b-a7872acf0fba admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for subnet, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:35.954022 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-39605576-bb0e-47a3-a87b-a7872acf0fba admin admin] 10.222.0.98 "DELETE /v2.0/subnets/0c2af8c2-0033-47ba-9f80-d43799d51067 HTTP/1.1" status: 204 len: 168 time: 0.4626167 Nov 02 13:02:35.957073 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-16d2441c-cf9d-419a-a3aa-68f744295c85 None None] Network 4e122687-d2b4-4db2-bcc0-8820ad5e5b77 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 13:02:35.957669 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36400) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:02:36.052091 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2e31541e-e2dc-499c-b60d-d4a0849df0e5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-972735'] for network, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:36.111467 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-2e31541e-e2dc-499c-b60d-d4a0849df0e5 admin admin] Deleting port 1c3a007d-9333-4aca-b0b1-468dc71b6768 {{(pid=108542) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:02:36.111814 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2e31541e-e2dc-499c-b60d-d4a0849df0e5 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:36.160690 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-6365b856-df88-405f-8cf2-87adfaf32378 None None] DHCP port deletion for 4e122687-d2b4-4db2-bcc0-8820ad5e5b77 request from dv-cinder-816324-1-iscsi {{(pid=108544) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 02 13:02:36.178058 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [None req-2e31541e-e2dc-499c-b60d-d4a0849df0e5 admin admin] For port 1c3a007d-9333-4aca-b0b1-468dc71b6768, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=1c3a007d-9333-4aca-b0b1-468dc71b6768,segment=NetworkSegment(0271db13-2254-4db8-b649-9b3f1a40557a),segment_id=0271db13-2254-4db8-b649-9b3f1a40557a)] {{(pid=108542) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:02:36.178345 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2e31541e-e2dc-499c-b60d-d4a0849df0e5 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:36.196788 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-2e31541e-e2dc-499c-b60d-d4a0849df0e5 admin admin] Calling delete_port for 1c3a007d-9333-4aca-b0b1-468dc71b6768 owned by network:dhcp {{(pid=108542) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:02:36.216804 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-6365b856-df88-405f-8cf2-87adfaf32378 None None] Deleting port 1c3a007d-9333-4aca-b0b1-468dc71b6768 {{(pid=108544) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:02:36.217520 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-6365b856-df88-405f-8cf2-87adfaf32378 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:36.292466 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-6365b856-df88-405f-8cf2-87adfaf32378 None None] For port 1c3a007d-9333-4aca-b0b1-468dc71b6768, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=1c3a007d-9333-4aca-b0b1-468dc71b6768,segment=NetworkSegment(0271db13-2254-4db8-b649-9b3f1a40557a),segment_id=0271db13-2254-4db8-b649-9b3f1a40557a)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:02:36.292784 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-6365b856-df88-405f-8cf2-87adfaf32378 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:36.310017 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-6365b856-df88-405f-8cf2-87adfaf32378 None None] Calling delete_port for 1c3a007d-9333-4aca-b0b1-468dc71b6768 owned by network:dhcp {{(pid=108544) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:02:36.372549 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2e31541e-e2dc-499c-b60d-d4a0849df0e5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:36.399753 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e31541e-e2dc-499c-b60d-d4a0849df0e5 admin admin] Pushing event deleted for resources: {'Port': ['ID=1c3a007d-9333-4aca-b0b1-468dc71b6768,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:02:36.405503 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2e31541e-e2dc-499c-b60d-d4a0849df0e5 admin admin] No DVR routers for this DVR port 1c3a007d-9333-4aca-b0b1-468dc71b6768 on host dv-cinder-816324-1-iscsi {{(pid=108542) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 13:02:36.410116 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-6365b856-df88-405f-8cf2-87adfaf32378 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678'] for port, after_delete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:36.441081 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6365b856-df88-405f-8cf2-87adfaf32378 None None] Pushing event deleted for resources: {'Port': ['ID=1c3a007d-9333-4aca-b0b1-468dc71b6768,revision_number=None']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:02:36.445773 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-6365b856-df88-405f-8cf2-87adfaf32378 None None] No DVR routers for this DVR port 1c3a007d-9333-4aca-b0b1-468dc71b6768 on host dv-cinder-816324-1-iscsi {{(pid=108544) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 13:02:36.452675 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6365b856-df88-405f-8cf2-87adfaf32378 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:36.453026 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6365b856-df88-405f-8cf2-87adfaf32378 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:36.453494 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6365b856-df88-405f-8cf2-87adfaf32378 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:36.453806 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6365b856-df88-405f-8cf2-87adfaf32378 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:36.454076 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6365b856-df88-405f-8cf2-87adfaf32378 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:36.454337 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6365b856-df88-405f-8cf2-87adfaf32378 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:36.454698 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6365b856-df88-405f-8cf2-87adfaf32378 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:36.455022 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6365b856-df88-405f-8cf2-87adfaf32378 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:36.455354 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6365b856-df88-405f-8cf2-87adfaf32378 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:36.455669 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6365b856-df88-405f-8cf2-87adfaf32378 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:36.455994 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6365b856-df88-405f-8cf2-87adfaf32378 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:36.456319 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-6365b856-df88-405f-8cf2-87adfaf32378 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:02:36.509008 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2e31541e-e2dc-499c-b60d-d4a0849df0e5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-930985', 'neutron.services.segments.db._delete_segments_for_network-8738449897966'] for network, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:36.534921 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-2e31541e-e2dc-499c-b60d-d4a0849df0e5 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['4e122687-d2b4-4db2-bcc0-8820ad5e5b77']}} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:02:36.550664 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-2e31541e-e2dc-499c-b60d-d4a0849df0e5 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '0271db13-2254-4db8-b649-9b3f1a40557a') {'for_net_delete': True} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:02:36.550963 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-2e31541e-e2dc-499c-b60d-d4a0849df0e5 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '0271db13-2254-4db8-b649-9b3f1a40557a') {} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:02:36.567047 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2e31541e-e2dc-499c-b60d-d4a0849df0e5 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738449902583', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3344697'] for segment, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:36.587325 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2e31541e-e2dc-499c-b60d-d4a0849df0e5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:36.597328 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-2e31541e-e2dc-499c-b60d-d4a0849df0e5 admin admin] Releasing vlan 871 on physical network physnet1 to pool {{(pid=108542) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 02 13:02:36.597947 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2e31541e-e2dc-499c-b60d-d4a0849df0e5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126476581'] for segment, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:36.598252 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 8a56dbe9-75f7-4598-a2ef-687071c1fb71 no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: Traceback (most recent call last): Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: timer() Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: cb(*args, **kw) Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: return func(*args, **kwargs) Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: self._notify() Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: self.callback(batched_events) Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: event.method(event) Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: aggregate_uuid = self.p_client.list_aggregates( Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: return f(self, *a, **k) Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: return self._get(url).json() Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: return self.request(url, 'GET', **kwargs) Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: base_url = self.get_endpoint(auth, allow=allow, Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 02 13:02:36.600909 dv-cinder-816324-1-iscsi neutron-server[108542]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 02 13:02:36.628556 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: 8a56dbe9-75f7-4598-a2ef-687071c1fb71 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 13:02:36.633721 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 8a56dbe9-75f7-4598-a2ef-687071c1fb71 not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 13:02:36.633721 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 1c3a007d-9333-4aca-b0b1-468dc71b6768 no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 13:02:36.652056 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: 1c3a007d-9333-4aca-b0b1-468dc71b6768 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 13:02:36.652440 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 1c3a007d-9333-4aca-b0b1-468dc71b6768 not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 13:02:36.652854 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 29f4ed03-3784-40c8-9c15-00c1bd9d54cc no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 13:02:36.673897 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: 29f4ed03-3784-40c8-9c15-00c1bd9d54cc {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 13:02:36.674230 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 29f4ed03-3784-40c8-9c15-00c1bd9d54cc not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 13:02:36.767255 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2e31541e-e2dc-499c-b60d-d4a0849df0e5 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-930976', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1594946'] for network, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:36.782953 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2e31541e-e2dc-499c-b60d-d4a0849df0e5 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:36.786781 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-2e31541e-e2dc-499c-b60d-d4a0849df0e5 admin admin] 10.222.0.98 "DELETE /v2.0/networks/4e122687-d2b4-4db2-bcc0-8820ad5e5b77 HTTP/1.1" status: 204 len: 168 time: 0.8277450 Nov 02 13:02:36.800801 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2e31541e-e2dc-499c-b60d-d4a0849df0e5 admin admin] Pushing event deleted for resources: {'Network': ['ID=4e122687-d2b4-4db2-bcc0-8820ad5e5b77,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:02:37.320680 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36404) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:02:37.617292 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-ecb19d5a-8270-46ef-acd2-11a0b61ac3c9 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=6064269d26644d27aaf12fd0ae66c0a9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2953391 Nov 02 13:02:37.621783 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 36408) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:02:37.689035 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-3f66c981-1bfa-48bb-a55f-0ab22f0ea33c admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:37.721792 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-3f66c981-1bfa-48bb-a55f-0ab22f0ea33c admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:37.852576 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-3f66c981-1bfa-48bb-a55f-0ab22f0ea33c admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:37.855232 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-3f66c981-1bfa-48bb-a55f-0ab22f0ea33c admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:37.856423 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-3f66c981-1bfa-48bb-a55f-0ab22f0ea33c admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/93817758-0ad3-4b93-9e7c-7f72bf40de98 HTTP/1.1" status: 204 len: 168 time: 0.2332029 Nov 02 13:02:37.865311 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-3f66c981-1bfa-48bb-a55f-0ab22f0ea33c admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=93817758-0ad3-4b93-9e7c-7f72bf40de98,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:02:46.029074 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 36502) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:02:46.168020 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-680d5170-cca3-40d4-a4f3-d301aa39b006 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:46.255363 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-680d5170-cca3-40d4-a4f3-d301aa39b006 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:46.349727 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-680d5170-cca3-40d4-a4f3-d301aa39b006 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:46.424300 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-680d5170-cca3-40d4-a4f3-d301aa39b006 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=9880d846630b40d2b24f2e94e7761d03&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3937223 Nov 02 13:02:46.425720 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-680d5170-cca3-40d4-a4f3-d301aa39b006 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2ab5edfa-5568-4be2-9582-8aae82321e4e,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:02:46.426699 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36506) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:02:46.492933 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-222edfd2-d5ff-469e-b1b2-ea1a737902ae admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:46.524911 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-222edfd2-d5ff-469e-b1b2-ea1a737902ae admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:46.686706 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-222edfd2-d5ff-469e-b1b2-ea1a737902ae admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:46.689517 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-222edfd2-d5ff-469e-b1b2-ea1a737902ae admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:46.690857 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-222edfd2-d5ff-469e-b1b2-ea1a737902ae admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/2ab5edfa-5568-4be2-9582-8aae82321e4e HTTP/1.1" status: 204 len: 168 time: 0.2631140 Nov 02 13:02:46.702347 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-222edfd2-d5ff-469e-b1b2-ea1a737902ae admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2ab5edfa-5568-4be2-9582-8aae82321e4e,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:02:47.504452 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36512) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:02:47.520720 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-8d55f91f-ab50-4331-85ab-641365a75707 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:47.603758 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-8d55f91f-ab50-4331-85ab-641365a75707 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:47.657883 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-8d55f91f-ab50-4331-85ab-641365a75707 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:47.702486 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-8d55f91f-ab50-4331-85ab-641365a75707 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=02bedf48efc14ecfb5b69e3b39dab953&name=default HTTP/1.1" status: 200 len: 2996 time: 0.1966591 Nov 02 13:02:47.703411 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8d55f91f-ab50-4331-85ab-641365a75707 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=200386b5-f178-4b1a-a18c-d4ab916d6e7a,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:02:47.705921 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36514) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:02:47.764993 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-fecd4ca1-12a5-4cae-94a4-2c36facaab6f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:47.788816 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-fecd4ca1-12a5-4cae-94a4-2c36facaab6f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:47.909499 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-fecd4ca1-12a5-4cae-94a4-2c36facaab6f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:47.912528 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-fecd4ca1-12a5-4cae-94a4-2c36facaab6f admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:47.913795 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-fecd4ca1-12a5-4cae-94a4-2c36facaab6f admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/200386b5-f178-4b1a-a18c-d4ab916d6e7a HTTP/1.1" status: 204 len: 168 time: 0.2044299 Nov 02 13:02:47.922718 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fecd4ca1-12a5-4cae-94a4-2c36facaab6f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=200386b5-f178-4b1a-a18c-d4ab916d6e7a,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:02:53.583437 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-db91d3d4-50d9-47c7-919f-648db9b632ab None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:53.787114 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36584) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:02:53.935287 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-439557c8-9a09-4038-a66c-c9ddbe289069 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:54.023432 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-439557c8-9a09-4038-a66c-c9ddbe289069 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:54.103524 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-439557c8-9a09-4038-a66c-c9ddbe289069 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:54.143946 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-439557c8-9a09-4038-a66c-c9ddbe289069 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=82bdde3d630f4777af8a04693332a35c&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3555806 Nov 02 13:02:54.146244 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-439557c8-9a09-4038-a66c-c9ddbe289069 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2a2118f3-6b31-4d17-9a48-31e61e48082c,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:02:54.147375 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 36588) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:02:54.213174 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-14398ea0-408c-46b3-8489-18f3bc4fdd1b admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:54.237827 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-14398ea0-408c-46b3-8489-18f3bc4fdd1b admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:54.378017 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-14398ea0-408c-46b3-8489-18f3bc4fdd1b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:54.381982 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-14398ea0-408c-46b3-8489-18f3bc4fdd1b admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:54.386168 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-14398ea0-408c-46b3-8489-18f3bc4fdd1b admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/2a2118f3-6b31-4d17-9a48-31e61e48082c HTTP/1.1" status: 204 len: 168 time: 0.2347472 Nov 02 13:02:54.392941 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-14398ea0-408c-46b3-8489-18f3bc4fdd1b admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2a2118f3-6b31-4d17-9a48-31e61e48082c,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:02:55.050891 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 36594) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:02:55.078876 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-47cf890f-5754-4cc4-b149-b693baef85cb admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:55.209236 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-47cf890f-5754-4cc4-b149-b693baef85cb admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:55.263489 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-47cf890f-5754-4cc4-b149-b693baef85cb admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:55.311432 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-47cf890f-5754-4cc4-b149-b693baef85cb admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=4c40c848398e4c1da89956130ccd7d5d&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2591875 Nov 02 13:02:55.312402 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-47cf890f-5754-4cc4-b149-b693baef85cb admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=5cd76cfd-11f5-4d0d-a6fc-a8a05e09d39b,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:02:55.316583 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36596) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:02:55.382813 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1fd04237-0c23-4d17-bc25-186ec58357c8 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:55.412026 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1fd04237-0c23-4d17-bc25-186ec58357c8 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:55.515050 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1fd04237-0c23-4d17-bc25-186ec58357c8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:55.518699 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-1fd04237-0c23-4d17-bc25-186ec58357c8 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:55.520217 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-1fd04237-0c23-4d17-bc25-186ec58357c8 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/5cd76cfd-11f5-4d0d-a6fc-a8a05e09d39b HTTP/1.1" status: 204 len: 168 time: 0.2024610 Nov 02 13:02:55.534482 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fd04237-0c23-4d17-bc25-186ec58357c8 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=5cd76cfd-11f5-4d0d-a6fc-a8a05e09d39b,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:02:55.635097 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-ae462c44-99e1-49ab-8b59-98dd0a342dff None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:56.472365 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 13:02:56.897205 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:02:58.394326 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:00.828963 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:03.508888 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:09.507988 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 36728) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:03:09.628545 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-18361bfd-2cf3-4740-b2c8-826dde5614d8 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:09.710942 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-18361bfd-2cf3-4740-b2c8-826dde5614d8 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:09.788662 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-18361bfd-2cf3-4740-b2c8-826dde5614d8 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:09.828645 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-18361bfd-2cf3-4740-b2c8-826dde5614d8 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=76abd827-2537-4788-826c-def927cb941d,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:09.838789 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-18361bfd-2cf3-4740-b2c8-826dde5614d8 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=d7a2e5c0419a4b0abbc42618a0a69461&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3264132 Nov 02 13:03:09.840252 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36732) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:03:09.902102 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c7103ba3-6c46-4ba1-bd6f-a3c23bba101e admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:09.931492 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c7103ba3-6c46-4ba1-bd6f-a3c23bba101e admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:10.068788 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c7103ba3-6c46-4ba1-bd6f-a3c23bba101e admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:10.071549 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c7103ba3-6c46-4ba1-bd6f-a3c23bba101e admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:10.072829 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-c7103ba3-6c46-4ba1-bd6f-a3c23bba101e admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/76abd827-2537-4788-826c-def927cb941d HTTP/1.1" status: 204 len: 168 time: 0.2311444 Nov 02 13:03:10.083343 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c7103ba3-6c46-4ba1-bd6f-a3c23bba101e admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=76abd827-2537-4788-826c-def927cb941d,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:10.845271 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 36738) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:03:10.859173 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-8cf68a6c-02d9-462a-8ca5-12d57c52207d admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:10.941848 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-8cf68a6c-02d9-462a-8ca5-12d57c52207d admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:11.022842 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-8cf68a6c-02d9-462a-8ca5-12d57c52207d admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:11.065889 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8cf68a6c-02d9-462a-8ca5-12d57c52207d admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=cd5fa20a-b589-4cb6-88f5-88e8997bdc13,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:11.074440 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-8cf68a6c-02d9-462a-8ca5-12d57c52207d admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=9904c4aee6cc47229f79a297c7cfcb18&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2250319 Nov 02 13:03:11.076092 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 36740) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:03:11.140611 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-b2d5d681-6a57-46fe-8c74-e2c88b107332 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:11.170227 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-b2d5d681-6a57-46fe-8c74-e2c88b107332 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:11.285765 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-b2d5d681-6a57-46fe-8c74-e2c88b107332 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:11.289042 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-b2d5d681-6a57-46fe-8c74-e2c88b107332 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:11.290268 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-b2d5d681-6a57-46fe-8c74-e2c88b107332 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/cd5fa20a-b589-4cb6-88f5-88e8997bdc13 HTTP/1.1" status: 204 len: 168 time: 0.2141695 Nov 02 13:03:11.299092 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b2d5d681-6a57-46fe-8c74-e2c88b107332 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=cd5fa20a-b589-4cb6-88f5-88e8997bdc13,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:12.018271 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36746) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:03:12.033391 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-406c5687-aeb6-435d-a600-7cd98a3541d5 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:12.121188 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-406c5687-aeb6-435d-a600-7cd98a3541d5 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:12.177207 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-406c5687-aeb6-435d-a600-7cd98a3541d5 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:12.236974 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-406c5687-aeb6-435d-a600-7cd98a3541d5 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=48a41df771cd4bd197c9d3025d61a771&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2173607 Nov 02 13:03:12.240172 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-406c5687-aeb6-435d-a600-7cd98a3541d5 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=1c66358f-cb00-4937-bc54-35a46403b109,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:12.241128 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 36748) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:03:12.313113 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-68718c8c-2497-4267-b5b0-0a4880792ee7 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:12.340769 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-68718c8c-2497-4267-b5b0-0a4880792ee7 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:12.491824 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-68718c8c-2497-4267-b5b0-0a4880792ee7 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:12.494460 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-68718c8c-2497-4267-b5b0-0a4880792ee7 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:12.495867 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-68718c8c-2497-4267-b5b0-0a4880792ee7 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/1c66358f-cb00-4937-bc54-35a46403b109 HTTP/1.1" status: 204 len: 168 time: 0.2534075 Nov 02 13:03:12.508639 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-68718c8c-2497-4267-b5b0-0a4880792ee7 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=1c66358f-cb00-4937-bc54-35a46403b109,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:16.052039 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 36818) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:03:16.165037 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-00b211f7-7db4-4d08-90bc-5b41e274e322 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:16.265074 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-00b211f7-7db4-4d08-90bc-5b41e274e322 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:16.336977 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-00b211f7-7db4-4d08-90bc-5b41e274e322 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:16.386877 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-00b211f7-7db4-4d08-90bc-5b41e274e322 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=8b214372502f4a6d80d5918ce6a7f6e9&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3334811 Nov 02 13:03:16.388474 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-00b211f7-7db4-4d08-90bc-5b41e274e322 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=ecee42d7-a549-4ea6-8a38-2530b41db177,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:16.390334 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36822) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:03:16.478356 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4cdabbf1-ddc5-4956-91e7-bf497d5b92dd admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:16.510061 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4cdabbf1-ddc5-4956-91e7-bf497d5b92dd admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:16.623321 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4cdabbf1-ddc5-4956-91e7-bf497d5b92dd admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:16.629912 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4cdabbf1-ddc5-4956-91e7-bf497d5b92dd admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:16.629912 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-4cdabbf1-ddc5-4956-91e7-bf497d5b92dd admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/ecee42d7-a549-4ea6-8a38-2530b41db177 HTTP/1.1" status: 204 len: 168 time: 0.2358832 Nov 02 13:03:16.638472 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4cdabbf1-ddc5-4956-91e7-bf497d5b92dd admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=ecee42d7-a549-4ea6-8a38-2530b41db177,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:17.269886 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 36828) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:03:17.284941 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d3bc1521-3e84-4cee-a869-2c71a8d13122 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:17.376245 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d3bc1521-3e84-4cee-a869-2c71a8d13122 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:17.479612 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d3bc1521-3e84-4cee-a869-2c71a8d13122 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:17.522705 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d3bc1521-3e84-4cee-a869-2c71a8d13122 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=dcf76bf0-2d61-40f9-a835-8b5cfb173f54,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:17.527428 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-d3bc1521-3e84-4cee-a869-2c71a8d13122 admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=45e9273865cc4ddfa096e1368824d5fa&name=default HTTP/1.1" status: 200 len: 2996 time: 0.2564118 Nov 02 13:03:17.530285 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 36830) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:03:17.590515 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bbfff2f0-06d7-4a05-ad3d-0a4eace3f054 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:17.624730 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bbfff2f0-06d7-4a05-ad3d-0a4eace3f054 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:17.794176 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bbfff2f0-06d7-4a05-ad3d-0a4eace3f054 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:17.796784 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bbfff2f0-06d7-4a05-ad3d-0a4eace3f054 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:17.797985 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-bbfff2f0-06d7-4a05-ad3d-0a4eace3f054 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/dcf76bf0-2d61-40f9-a835-8b5cfb173f54 HTTP/1.1" status: 204 len: 168 time: 0.2667305 Nov 02 13:03:17.807741 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bbfff2f0-06d7-4a05-ad3d-0a4eace3f054 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=dcf76bf0-2d61-40f9-a835-8b5cfb173f54,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:23.502475 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-cd871662-0038-42b6-9094-7ee293666de7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:25.638151 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-aa5ff8d1-5fc3-4126-ab6c-5734e3382270 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:26.895486 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:28.468678 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:30.817250 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:33.471889 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 13:03:33.496482 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:40.794030 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 36964) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:03:40.929423 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-703a628a-4113-4f5a-968b-71cf1fd2c4ec admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:41.016929 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-703a628a-4113-4f5a-968b-71cf1fd2c4ec admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:41.079453 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-703a628a-4113-4f5a-968b-71cf1fd2c4ec admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:41.121638 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-703a628a-4113-4f5a-968b-71cf1fd2c4ec admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=c33b9af8-5054-414e-b118-64000b6c1153,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:41.127301 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-703a628a-4113-4f5a-968b-71cf1fd2c4ec admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=659040464d024e05a8d78cb05f007c87&name=default HTTP/1.1" status: 200 len: 2996 time: 0.3321438 Nov 02 13:03:41.131173 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36968) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:03:41.133253 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-703a628a-4113-4f5a-968b-71cf1fd2c4ec admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:41.133661 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-703a628a-4113-4f5a-968b-71cf1fd2c4ec admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:41.133928 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-703a628a-4113-4f5a-968b-71cf1fd2c4ec admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:41.134259 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-703a628a-4113-4f5a-968b-71cf1fd2c4ec admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:41.134618 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-703a628a-4113-4f5a-968b-71cf1fd2c4ec admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:41.134944 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-703a628a-4113-4f5a-968b-71cf1fd2c4ec admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:41.135271 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-703a628a-4113-4f5a-968b-71cf1fd2c4ec admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:41.135594 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-703a628a-4113-4f5a-968b-71cf1fd2c4ec admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:41.135918 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-703a628a-4113-4f5a-968b-71cf1fd2c4ec admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:41.136237 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-703a628a-4113-4f5a-968b-71cf1fd2c4ec admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:41.136555 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-703a628a-4113-4f5a-968b-71cf1fd2c4ec admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:41.136873 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-703a628a-4113-4f5a-968b-71cf1fd2c4ec admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:41.220452 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a491f734-223f-445e-b7bd-b702ea6855a3 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:41.247891 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a491f734-223f-445e-b7bd-b702ea6855a3 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:41.440238 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a491f734-223f-445e-b7bd-b702ea6855a3 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:41.445858 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-a491f734-223f-445e-b7bd-b702ea6855a3 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:41.448024 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-a491f734-223f-445e-b7bd-b702ea6855a3 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/c33b9af8-5054-414e-b118-64000b6c1153 HTTP/1.1" status: 204 len: 168 time: 0.3150299 Nov 02 13:03:41.462045 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-a491f734-223f-445e-b7bd-b702ea6855a3 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=c33b9af8-5054-414e-b118-64000b6c1153,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:41.475480 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a491f734-223f-445e-b7bd-b702ea6855a3 admin admin] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:41.476038 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a491f734-223f-445e-b7bd-b702ea6855a3 admin admin] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:41.476615 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a491f734-223f-445e-b7bd-b702ea6855a3 admin admin] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:41.477202 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a491f734-223f-445e-b7bd-b702ea6855a3 admin admin] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:41.477755 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a491f734-223f-445e-b7bd-b702ea6855a3 admin admin] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:41.478328 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a491f734-223f-445e-b7bd-b702ea6855a3 admin admin] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:41.478998 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a491f734-223f-445e-b7bd-b702ea6855a3 admin admin] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:41.479499 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a491f734-223f-445e-b7bd-b702ea6855a3 admin admin] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:41.480075 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a491f734-223f-445e-b7bd-b702ea6855a3 admin admin] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:41.480630 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a491f734-223f-445e-b7bd-b702ea6855a3 admin admin] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:41.481190 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a491f734-223f-445e-b7bd-b702ea6855a3 admin admin] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:41.481773 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-a491f734-223f-445e-b7bd-b702ea6855a3 admin admin] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:42.748257 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36990) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:03:42.916228 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-8bf1eed6-b067-4b82-a046-8b3e2177e622 admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-539319503-network', 'tenant_id': '36f51757702242e8b1343954aa4f93fe'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 13:03:43.004602 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-8bf1eed6-b067-4b82-a046-8b3e2177e622 admin admin] Made reservation on behalf of 36f51757702242e8b1343954aa4f93fe for: {'network': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 13:03:43.007607 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-8bf1eed6-b067-4b82-a046-8b3e2177e622 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for network, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:43.017494 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-8bf1eed6-b067-4b82-a046-8b3e2177e622 admin admin] Publish callbacks [] for security_group, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:43.101916 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-8bf1eed6-b067-4b82-a046-8b3e2177e622 admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:43.170323 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-8bf1eed6-b067-4b82-a046-8b3e2177e622 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:43.200602 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-8bf1eed6-b067-4b82-a046-8b3e2177e622 admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 889} {{(pid=108542) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 02 13:03:43.217138 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bf1eed6-b067-4b82-a046-8b3e2177e622 admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=6433fe5c-a062-47c1-827b-d94e9e3b8866,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:43.223092 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-8bf1eed6-b067-4b82-a046-8b3e2177e622 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:43.223511 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.db.segments_db [None req-8bf1eed6-b067-4b82-a046-8b3e2177e622 admin admin] Added segment 990fa8e2-8f5c-4714-aa6e-d15bfa97b992 of type vlan for network 547d6dbb-2ff3-449a-acfb-935d7f0325c4 Nov 02 13:03:43.272249 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-8bf1eed6-b067-4b82-a046-8b3e2177e622 admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738449409639'] for network, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:43.359113 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-8bf1eed6-b067-4b82-a046-8b3e2177e622 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for network, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:43.360147 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-8bf1eed6-b067-4b82-a046-8b3e2177e622 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:03:43.360757 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-8bf1eed6-b067-4b82-a046-8b3e2177e622 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:43.429510 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-8bf1eed6-b067-4b82-a046-8b3e2177e622 admin admin] Pushing event updated for resources: {'Network': ['ID=547d6dbb-2ff3-449a-acfb-935d7f0325c4,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:43.441182 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Network 547d6dbb-2ff3-449a-acfb-935d7f0325c4 details requested by agent ovs-agent-dv-cinder-816324-1-iscsi with host dv-cinder-816324-1-iscsi {{(pid=108544) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 02 13:03:43.482034 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-8bf1eed6-b067-4b82-a046-8b3e2177e622 admin admin] 10.222.0.98 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.7325895 Nov 02 13:03:43.485506 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36994) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:03:43.494416 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-2ff17140-7d06-4fcf-a505-b16786be9ae4 admin admin] Request body: {'subnet': {'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-539319503-subnet', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'ip_version': 4}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 13:03:43.617099 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-2ff17140-7d06-4fcf-a505-b16786be9ae4 admin admin] Made reservation on behalf of 36f51757702242e8b1343954aa4f93fe for: {'subnet': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 13:03:43.620982 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2ff17140-7d06-4fcf-a505-b16786be9ae4 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126185635'] for subnet, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:43.930708 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2ff17140-7d06-4fcf-a505-b16786be9ae4 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126478280', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126185617'] for subnet, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:43.987475 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2ff17140-7d06-4fcf-a505-b16786be9ae4 admin admin] Pushing event updated for resources: {'Subnet': ['ID=424f2c99-da28-4193-b1e7-1cafea9ef4ee,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:43.999380 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-2ff17140-7d06-4fcf-a505-b16786be9ae4 admin admin] Checking segment: {'id': '990fa8e2-8f5c-4714-aa6e-d15bfa97b992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 889, 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108542) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 13:03:43.999717 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ff17140-7d06-4fcf-a505-b16786be9ae4 admin admin] Network hostable DHCP agents. Network: 547d6dbb-2ff3-449a-acfb-935d7f0325c4, hostable agents: ['1b947f40-f8bf-4088-a5dc-35ee29d90d78'], hosted agents: [] {{(pid=108542) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 02 13:03:44.073133 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-2ff17140-7d06-4fcf-a505-b16786be9ae4 admin admin] Network 547d6dbb-2ff3-449a-acfb-935d7f0325c4 is scheduled to be hosted by DHCP agent 1b947f40-f8bf-4088-a5dc-35ee29d90d78 with binding_index 1 {{(pid=108542) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 02 13:03:44.175889 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-2ff17140-7d06-4fcf-a505-b16786be9ae4 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816324-1-iscsi, 547d6dbb-2ff3-449a-acfb-935d7f0325c4) {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 13:03:44.182392 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-2ff17140-7d06-4fcf-a505-b16786be9ae4 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:03:44.183847 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-2ff17140-7d06-4fcf-a505-b16786be9ae4 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:44.187638 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-44fad5d0-ba2a-4bd9-ad8b-0865bf80e523 None None] Network 547d6dbb-2ff3-449a-acfb-935d7f0325c4 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 13:03:44.248440 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-2ff17140-7d06-4fcf-a505-b16786be9ae4 admin admin] 10.222.0.98 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.7611992 Nov 02 13:03:44.252150 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 36996) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:03:44.257545 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-7cdbcf22-4dd7-4b4f-9b9b-34008e107932 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-539319503-router', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 13:03:44.324668 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7cdbcf22-4dd7-4b4f-9b9b-34008e107932 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1593342', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-25677'] for router, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:44.325938 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7cdbcf22-4dd7-4b4f-9b9b-34008e107932 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1593154', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1595081', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1973616', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-25716'] for router, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:44.341855 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp94ac73f7-a43e-5b43-a0b7-503cbb5c76bd-547d6dbb-2ff3-449a-acfb-935d7f0325c4', 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'fixed_ips': [{'subnet_id': '424f2c99-da28-4193-b1e7-1cafea9ef4ee'}]}} from dv-cinder-816324-1-iscsi. {{(pid=108544) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 02 13:03:44.342864 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:44.393920 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7cdbcf22-4dd7-4b4f-9b9b-34008e107932 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:44.501820 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.db_base_plugin_common [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Allocated IP 172.20.0.2 (547d6dbb-2ff3-449a-acfb-935d7f0325c4/424f2c99-da28-4193-b1e7-1cafea9ef4ee/c524c07f-371a-4ead-ad5f-25aa69583cc9) {{(pid=108544) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 13:03:44.624952 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7cdbcf22-4dd7-4b4f-9b9b-34008e107932 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:44.704706 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Publish callbacks [] for port, precommit_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:44.759886 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669'] for port, after_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:44.807998 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Network 547d6dbb-2ff3-449a-acfb-935d7f0325c4 is already hosted by enough agents. {{(pid=108544) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 13:03:44.811663 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.scheduler.base_scheduler [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Resources bound (agent type, host, resource id): {{(pid=108544) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 13:03:44.818907 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Received port after_create {{(pid=108544) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 13:03:44.832191 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Pushing event updated for resources: {'Port': ['ID=c524c07f-371a-4ead-ad5f-25aa69583cc9,revision_number=1']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:44.860288 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:44.861707 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:44.861707 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:44.861707 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:44.861707 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:44.862109 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:44.862245 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:44.862641 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:44.862963 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:44.863281 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:44.863602 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:44.863920 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:44.900129 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Attempting to bind port c524c07f-371a-4ead-ad5f-25aa69583cc9 on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 13:03:44.900636 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Attempting to bind port c524c07f-371a-4ead-ad5f-25aa69583cc9 by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': '990fa8e2-8f5c-4714-aa6e-d15bfa97b992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 889, 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4'}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 13:03:44.901106 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Attempting to bind port c524c07f-371a-4ead-ad5f-25aa69583cc9 on network 547d6dbb-2ff3-449a-acfb-935d7f0325c4 {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 13:03:44.903095 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7cdbcf22-4dd7-4b4f-9b9b-34008e107932 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:44.907408 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 13, 3, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 13:03:44.907891 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Checking segment: {'id': '990fa8e2-8f5c-4714-aa6e-d15bfa97b992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 889, 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108544) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 13:03:44.908461 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:44.908935 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Bound using segment: {'id': '990fa8e2-8f5c-4714-aa6e-d15bfa97b992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 889, 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4'} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 13:03:44.909552 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Bound port: c524c07f-371a-4ead-ad5f-25aa69583cc9, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '990fa8e2-8f5c-4714-aa6e-d15bfa97b992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 889, 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4'}}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 13:03:44.910021 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:44.924285 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7cdbcf22-4dd7-4b4f-9b9b-34008e107932 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:45.005922 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] For port c524c07f-371a-4ead-ad5f-25aa69583cc9, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108544) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 13:03:45.012535 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] For port c524c07f-371a-4ead-ad5f-25aa69583cc9, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=c524c07f-371a-4ead-ad5f-25aa69583cc9,segment=NetworkSegment(990fa8e2-8f5c-4714-aa6e-d15bfa97b992),segment_id=990fa8e2-8f5c-4714-aa6e-d15bfa97b992)] {{(pid=108544) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 13:03:45.091046 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [None req-7cdbcf22-4dd7-4b4f-9b9b-34008e107932 admin admin] Allocated IP 172.27.0.29 (43464fa8-eb00-46fb-9ca0-be7342f9ddbf/44a807bc-f2b6-41f0-b765-e5d3393fe305/da758e7f-f09a-49c1-8f4b-d623ff24fff3) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 13:03:45.096821 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:45.179114 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-43f4eb1b-160c-4bab-a7aa-8a4929bbb43a None None] Pushing event updated for resources: {'Port': ['ID=c524c07f-371a-4ead-ad5f-25aa69583cc9,revision_number=2']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:45.275488 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7cdbcf22-4dd7-4b4f-9b9b-34008e107932 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:45.387943 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7cdbcf22-4dd7-4b4f-9b9b-34008e107932 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:45.432840 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-7cdbcf22-4dd7-4b4f-9b9b-34008e107932 admin admin] Network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 13:03:45.438701 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [None req-7cdbcf22-4dd7-4b4f-9b9b-34008e107932 admin admin] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 13:03:45.443420 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [None req-7cdbcf22-4dd7-4b4f-9b9b-34008e107932 admin admin] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 13:03:45.453010 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7cdbcf22-4dd7-4b4f-9b9b-34008e107932 admin admin] Pushing event updated for resources: {'Port': ['ID=da758e7f-f09a-49c1-8f4b-d623ff24fff3,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:45.950785 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7cdbcf22-4dd7-4b4f-9b9b-34008e107932 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:46.210992 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-7e9d5323-4fe6-4a8f-a9a5-3813a0f9f912 None None] Network 547d6dbb-2ff3-449a-acfb-935d7f0325c4 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 13:03:46.212030 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7cdbcf22-4dd7-4b4f-9b9b-34008e107932 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1593163', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1595034'] for router, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:46.297034 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-6f717af7-a0cb-4162-b56a-8c669c523f64 None None] Provisioning complete for port c524c07f-371a-4ead-ad5f-25aa69583cc9 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:03:46.297559 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-6f717af7-a0cb-4162-b56a-8c669c523f64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:46.493497 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-6f717af7-a0cb-4162-b56a-8c669c523f64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:46.538675 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-7cdbcf22-4dd7-4b4f-9b9b-34008e107932 admin admin] Router 8f644798-f842-47ae-90c4-f5e349fed2fb is scheduled to L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc with binding_index 1 {{(pid=108543) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 02 13:03:46.547364 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-6f717af7-a0cb-4162-b56a-8c669c523f64 None None] For port c524c07f-371a-4ead-ad5f-25aa69583cc9, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=c524c07f-371a-4ead-ad5f-25aa69583cc9,segment=NetworkSegment(990fa8e2-8f5c-4714-aa6e-d15bfa97b992),segment_id=990fa8e2-8f5c-4714-aa6e-d15bfa97b992)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:03:46.633803 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-6f717af7-a0cb-4162-b56a-8c669c523f64 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:46.731775 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-7cdbcf22-4dd7-4b4f-9b9b-34008e107932 admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108543) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 13:03:46.751610 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] Sync routers for ids ['8f644798-f842-47ae-90c4-f5e349fed2fb'] in dv-cinder-816324-1-iscsi {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 13:03:46.763832 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device c524c07f-371a-4ead-ad5f-25aa69583cc9 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 13:03:46.813263 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-6f717af7-a0cb-4162-b56a-8c669c523f64 None None] Pushing event updated for resources: {'Port': ['ID=c524c07f-371a-4ead-ad5f-25aa69583cc9,revision_number=3']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:46.832083 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] Routers {'8f644798-f842-47ae-90c4-f5e349fed2fb'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:03:46.832891 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:03:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['8f644798-f842-47ae-90c4-f5e349fed2fb'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:03:46.848320 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-7cdbcf22-4dd7-4b4f-9b9b-34008e107932 admin admin] Publish callbacks [] for router, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:46.851057 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-7cdbcf22-4dd7-4b4f-9b9b-34008e107932 admin admin] 10.222.0.98 "POST /v2.0/routers HTTP/1.1" status: 201 len: 925 time: 2.5974083 Nov 02 13:03:46.855340 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 36998) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:03:47.097583 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-3d98bc2e-8deb-431c-aac2-97b0931803d6 None None] Provisioning complete for port c524c07f-371a-4ead-ad5f-25aa69583cc9 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:03:47.098007 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-3d98bc2e-8deb-431c-aac2-97b0931803d6 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:47.125153 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port c524c07f-371a-4ead-ad5f-25aa69583cc9 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:03:47.125692 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:47.209215 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] Set router 8f644798-f842-47ae-90c4-f5e349fed2fb gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:03:47.535889 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'name': 'tempest-TestMinimumBasicScenario-539319503-router', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:03:45Z', 'revision_number': 3, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'gw_port': {'id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:95:30', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:03:45Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:03:47.576365 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] Checking router: 8f644798-f842-47ae-90c4-f5e349fed2fb for host: dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 13:03:47.576892 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] Updating router 8f644798-f842-47ae-90c4-f5e349fed2fb port da758e7f-f09a-49c1-8f4b-d623ff24fff3 binding host dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 02 13:03:47.609617 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:47.783058 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f590a2a2-4eca-4c88-a16f-536f288f2619 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:48.008762 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] Publish callbacks [] for port, precommit_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:48.024247 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_common [None req-f590a2a2-4eca-4c88-a16f-536f288f2619 admin admin] Allocated IP 172.20.0.1 (547d6dbb-2ff3-449a-acfb-935d7f0325c4/424f2c99-da28-4193-b1e7-1cafea9ef4ee/9fd131ff-7577-434d-808c-a8686762bec8) {{(pid=108542) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 13:03:48.159281 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:48.162648 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f590a2a2-4eca-4c88-a16f-536f288f2619 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:48.266859 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] Attempting to bind port da758e7f-f09a-49c1-8f4b-d623ff24fff3 on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 13:03:48.267412 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] Attempting to bind port da758e7f-f09a-49c1-8f4b-d623ff24fff3 by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 13:03:48.267926 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] Attempting to bind port da758e7f-f09a-49c1-8f4b-d623ff24fff3 on network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 13:03:48.274057 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fa44fcd-bc35-4e13-b8f8-cb1c27374c17 None None] Pushing event updated for resources: {'Port': ['ID=da758e7f-f09a-49c1-8f4b-d623ff24fff3,revision_number=2']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:48.282136 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 13, 3, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 13:03:48.282792 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] Checking segment: {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108544) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 13:03:48.289022 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:48.289022 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] Bound using segment: {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 13:03:48.289022 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] Bound port: da758e7f-f09a-49c1-8f4b-d623ff24fff3, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 13:03:48.289022 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:48.290852 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f590a2a2-4eca-4c88-a16f-536f288f2619 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:48.354341 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f590a2a2-4eca-4c88-a16f-536f288f2619 admin admin] Network 547d6dbb-2ff3-449a-acfb-935d7f0325c4 is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 13:03:48.360732 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-f590a2a2-4eca-4c88-a16f-536f288f2619 admin admin] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 13:03:48.365978 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [None req-f590a2a2-4eca-4c88-a16f-536f288f2619 admin admin] Received port after_create {{(pid=108542) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 13:03:48.383832 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] For port da758e7f-f09a-49c1-8f4b-d623ff24fff3, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108544) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 13:03:48.387554 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] For port da758e7f-f09a-49c1-8f4b-d623ff24fff3, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=da758e7f-f09a-49c1-8f4b-d623ff24fff3,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108544) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 13:03:48.401141 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f590a2a2-4eca-4c88-a16f-536f288f2619 admin admin] Pushing event updated for resources: {'Port': ['ID=9fd131ff-7577-434d-808c-a8686762bec8,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:48.430735 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f590a2a2-4eca-4c88-a16f-536f288f2619 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1590217'] for router_interface, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:48.468990 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:48.569988 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] Routers {'8f644798-f842-47ae-90c4-f5e349fed2fb'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:03:48.571162 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:03:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['8f644798-f842-47ae-90c4-f5e349fed2fb'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:03:48.663455 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-7fa44fcd-bc35-4e13-b8f8-cb1c27374c17 None None] Pushing event updated for resources: {'Port': ['ID=da758e7f-f09a-49c1-8f4b-d623ff24fff3,revision_number=3']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:48.706662 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f590a2a2-4eca-4c88-a16f-536f288f2619 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:48.712300 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device c524c07f-371a-4ead-ad5f-25aa69583cc9 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 13:03:48.737383 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-854b9933-0a45-4234-add6-89fca2af6b5b None None] Provisioning complete for port 9fd131ff-7577-434d-808c-a8686762bec8 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:03:48.737894 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-854b9933-0a45-4234-add6-89fca2af6b5b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:48.844465 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-854b9933-0a45-4234-add6-89fca2af6b5b None None] Port 9fd131ff-7577-434d-808c-a8686762bec8 cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 13:03:48.869784 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] Set router 8f644798-f842-47ae-90c4-f5e349fed2fb gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:03:48.966268 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port c524c07f-371a-4ead-ad5f-25aa69583cc9 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:03:48.966646 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:49.004920 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f590a2a2-4eca-4c88-a16f-536f288f2619 admin admin] Publish callbacks [] for port, precommit_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:49.068283 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f590a2a2-4eca-4c88-a16f-536f288f2619 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126476609'] for port, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:49.194806 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'name': 'tempest-TestMinimumBasicScenario-539319503-router', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:03:45Z', 'revision_number': 3, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'gw_port': {'id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:95:30', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:03:48Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:03:49.202341 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f590a2a2-4eca-4c88-a16f-536f288f2619 admin admin] Pushing event updated for resources: {'Port': ['ID=9fd131ff-7577-434d-808c-a8686762bec8,revision_number=2']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:49.209181 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-f590a2a2-4eca-4c88-a16f-536f288f2619 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1649136', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1590109'] for router_interface, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:49.231603 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-804c6c67-81ac-4b90-91fc-5eda8af9d7fb None None] The sync data for ids ['8f644798-f842-47ae-90c4-f5e349fed2fb'] in dv-cinder-816324-1-iscsi is: [{'id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'name': 'tempest-TestMinimumBasicScenario-539319503-router', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:03:45Z', 'revision_number': 3, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'gw_port': {'id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:95:30', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:03:48Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}] {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 13:03:49.355162 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-f590a2a2-4eca-4c88-a16f-536f288f2619 admin admin] Network 547d6dbb-2ff3-449a-acfb-935d7f0325c4 is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 13:03:49.357879 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-f590a2a2-4eca-4c88-a16f-536f288f2619 admin admin] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 13:03:49.602902 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f590a2a2-4eca-4c88-a16f-536f288f2619 admin admin] Router 8f644798-f842-47ae-90c4-f5e349fed2fb has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108542) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 13:03:49.787847 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-47d5048a-8483-451d-87b9-5ce3d2898375 None None] Provisioning complete for port 9fd131ff-7577-434d-808c-a8686762bec8 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:03:49.788680 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-47d5048a-8483-451d-87b9-5ce3d2898375 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:49.789259 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f590a2a2-4eca-4c88-a16f-536f288f2619 admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108542) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 13:03:49.798657 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-f590a2a2-4eca-4c88-a16f-536f288f2619 admin admin] 10.222.0.98 "PUT /v2.0/routers/8f644798-f842-47ae-90c4-f5e349fed2fb/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.9404988 Nov 02 13:03:49.838239 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-47d5048a-8483-451d-87b9-5ce3d2898375 None None] Port 9fd131ff-7577-434d-808c-a8686762bec8 cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 13:03:50.694497 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device da758e7f-f09a-49c1-8f4b-d623ff24fff3 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 13:03:50.795130 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port da758e7f-f09a-49c1-8f4b-d623ff24fff3 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:03:50.796515 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:50.882636 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 37014) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:03:50.891153 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-5615d3f4-d457-486d-b7f6-bc72db97a63b admin admin] Request body: {'network': {'name': 'tempest-TestMinimumBasicScenario-200701357-network', 'tenant_id': '6fe63572d2d044a3bd46527067b9a0e2'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 13:03:50.929472 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:50.957443 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] For port da758e7f-f09a-49c1-8f4b-d623ff24fff3, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=da758e7f-f09a-49c1-8f4b-d623ff24fff3,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:03:50.980719 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-5615d3f4-d457-486d-b7f6-bc72db97a63b admin admin] Made reservation on behalf of 6fe63572d2d044a3bd46527067b9a0e2 for: {'network': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 13:03:50.984259 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-5615d3f4-d457-486d-b7f6-bc72db97a63b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for network, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:50.994855 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-5615d3f4-d457-486d-b7f6-bc72db97a63b admin admin] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:51.062507 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:51.138178 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-5615d3f4-d457-486d-b7f6-bc72db97a63b admin admin] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:51.150881 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Pushing event updated for resources: {'Port': ['ID=da758e7f-f09a-49c1-8f4b-d623ff24fff3,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:51.214072 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] Sync routers for ids ['8f644798-f842-47ae-90c4-f5e349fed2fb'] in dv-cinder-816324-1-iscsi {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 13:03:51.216538 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-5615d3f4-d457-486d-b7f6-bc72db97a63b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:51.230409 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] Routers {'8f644798-f842-47ae-90c4-f5e349fed2fb'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:03:51.231370 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:03:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['8f644798-f842-47ae-90c4-f5e349fed2fb'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:03:51.266670 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.helpers [None req-5615d3f4-d457-486d-b7f6-bc72db97a63b admin admin] vlan segment allocate from pool success with {'physical_network': 'physnet1', 'vlan_id': 876} {{(pid=108543) allocate_partially_specified_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/helpers.py:153}} Nov 02 13:03:51.289104 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5615d3f4-d457-486d-b7f6-bc72db97a63b admin admin] Pushing event updated for resources: {'SecurityGroup': ['ID=2be15f32-525c-4285-883a-0b30795d0a07,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:51.296398 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-5615d3f4-d457-486d-b7f6-bc72db97a63b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:51.297056 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.db.segments_db [None req-5615d3f4-d457-486d-b7f6-bc72db97a63b admin admin] Added segment 4061b408-6fc7-4fc7-928c-ef9dfc54c821 of type vlan for network 91dd6799-b00d-4e11-9a1f-9e1f44d1d95d Nov 02 13:03:51.376601 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-5615d3f4-d457-486d-b7f6-bc72db97a63b admin admin] Publish callbacks ['neutron.services.auto_allocate.db._ensure_external_network_default_value_callback-8738449409639'] for network, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:51.404291 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] Set router 8f644798-f842-47ae-90c4-f5e349fed2fb gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:03:51.496508 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-5615d3f4-d457-486d-b7f6-bc72db97a63b admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026'] for network, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:51.497612 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-5615d3f4-d457-486d-b7f6-bc72db97a63b admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:03:51.498213 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-5615d3f4-d457-486d-b7f6-bc72db97a63b admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:51.573100 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5615d3f4-d457-486d-b7f6-bc72db97a63b admin admin] Pushing event updated for resources: {'Network': ['ID=91dd6799-b00d-4e11-9a1f-9e1f44d1d95d,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:51.587626 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Network 91dd6799-b00d-4e11-9a1f-9e1f44d1d95d details requested by agent ovs-agent-dv-cinder-816324-1-iscsi with host dv-cinder-816324-1-iscsi {{(pid=108544) get_network_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:248}} Nov 02 13:03:51.624208 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-5615d3f4-d457-486d-b7f6-bc72db97a63b admin admin] 10.222.0.98 "POST /v2.0/networks HTTP/1.1" status: 201 len: 887 time: 0.7367208 Nov 02 13:03:51.625953 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 37016) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:03:51.634647 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-231070ad-eba4-4186-ba3d-9de409d46749 admin admin] Request body: {'subnet': {'network_id': '91dd6799-b00d-4e11-9a1f-9e1f44d1d95d', 'cidr': '172.20.0.0/28', 'name': 'tempest-TestMinimumBasicScenario-200701357-subnet', 'tenant_id': '6fe63572d2d044a3bd46527067b9a0e2', 'ip_version': 4}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 13:03:51.719029 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [None req-231070ad-eba4-4186-ba3d-9de409d46749 admin admin] Made reservation on behalf of 6fe63572d2d044a3bd46527067b9a0e2 for: {'subnet': 1} {{(pid=108542) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 13:03:51.722900 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-231070ad-eba4-4186-ba3d-9de409d46749 admin admin] Publish callbacks ['neutron.services.segments.plugin.SegmentHostRoutes.host_routes_before_create-126185635'] for subnet, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:51.887508 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'name': 'tempest-TestMinimumBasicScenario-539319503-router', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:03:48Z', 'revision_number': 4, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'gw_port': {'id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:95:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:03:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '9fd131ff-7577-434d-808c-a8686762bec8', 'name': '', 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'mac_address': 'fa:16:3e:5e:18:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '424f2c99-da28-4193-b1e7-1cafea9ef4ee', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:47Z', 'updated_at': '2021-11-02T13:03:48Z', 'revision_number': 2, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'subnets': [{'id': '424f2c99-da28-4193-b1e7-1cafea9ef4ee', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:03:51.940160 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] Checking router: 8f644798-f842-47ae-90c4-f5e349fed2fb for host: dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 13:03:51.940736 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] Updating router 8f644798-f842-47ae-90c4-f5e349fed2fb port 9fd131ff-7577-434d-808c-a8686762bec8 binding host dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 02 13:03:51.987485 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:52.057857 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-231070ad-eba4-4186-ba3d-9de409d46749 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_created-126478280', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_create-126185617'] for subnet, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:52.146286 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-231070ad-eba4-4186-ba3d-9de409d46749 admin admin] Pushing event updated for resources: {'Subnet': ['ID=ef953611-234b-4101-b890-254859ae3613,revision_number=0']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:52.175010 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-231070ad-eba4-4186-ba3d-9de409d46749 admin admin] Checking segment: {'id': '4061b408-6fc7-4fc7-928c-ef9dfc54c821', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '91dd6799-b00d-4e11-9a1f-9e1f44d1d95d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108542) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 13:03:52.175631 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-231070ad-eba4-4186-ba3d-9de409d46749 admin admin] Network hostable DHCP agents. Network: 91dd6799-b00d-4e11-9a1f-9e1f44d1d95d, hostable agents: ['1b947f40-f8bf-4088-a5dc-35ee29d90d78'], hosted agents: [] {{(pid=108542) _get_network_hostable_dhcp_agents /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:329}} Nov 02 13:03:52.250755 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-231070ad-eba4-4186-ba3d-9de409d46749 admin admin] Network 91dd6799-b00d-4e11-9a1f-9e1f44d1d95d is scheduled to be hosted by DHCP agent 1b947f40-f8bf-4088-a5dc-35ee29d90d78 with binding_index 1 {{(pid=108542) bind /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:227}} Nov 02 13:03:52.325072 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-231070ad-eba4-4186-ba3d-9de409d46749 admin admin] Resources bound (agent type, host, resource id): (DHCP agent, dv-cinder-816324-1-iscsi, 91dd6799-b00d-4e11-9a1f-9e1f44d1d95d) {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 13:03:52.336422 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-231070ad-eba4-4186-ba3d-9de409d46749 admin admin] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id', 'network'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:03:52.337577 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-231070ad-eba4-4186-ba3d-9de409d46749 admin admin] Publish callbacks [] for subnet, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:52.338876 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-c74aa000-0952-4ddc-9494-70c5815304a4 None None] Network 91dd6799-b00d-4e11-9a1f-9e1f44d1d95d requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 13:03:52.427819 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-231070ad-eba4-4186-ba3d-9de409d46749 admin admin] 10.222.0.98 "POST /v2.0/subnets HTTP/1.1" status: 201 len: 850 time: 0.7995725 Nov 02 13:03:52.431407 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 37018) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:03:52.437689 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-c0e10131-f35f-4884-b6a3-1b1a44ff38c6 admin admin] Request body: {'router': {'name': 'tempest-TestMinimumBasicScenario-200701357-router', 'tenant_id': '6fe63572d2d044a3bd46527067b9a0e2', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 13:03:52.452566 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] Publish callbacks [] for port, precommit_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:52.594038 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:52.628062 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c0e10131-f35f-4884-b6a3-1b1a44ff38c6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._before_router_create_handler-1593342', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._check_router_request-25677'] for router, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:52.630875 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c0e10131-f35f-4884-b6a3-1b1a44ff38c6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._precommit_router_create-1593154', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._set_distributed_flag-1595081', 'neutron.services.l3_router.l3_router_plugin.RouterAvailabilityZoneMixin._process_az_request-1973616', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._set_router_provider-25716'] for router, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:52.726963 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device da758e7f-f09a-49c1-8f4b-d623ff24fff3 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 13:03:52.737934 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91bf8624-4dc4-418e-9e3a-f6be5947f5d3 None None] Pushing event updated for resources: {'Port': ['ID=9fd131ff-7577-434d-808c-a8686762bec8,revision_number=3']} {{(pid=108545) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:52.766680 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c0e10131-f35f-4884-b6a3-1b1a44ff38c6 admin admin] Publish callbacks [] for router_controller, precommit_add_association {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:52.778302 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91bf8624-4dc4-418e-9e3a-f6be5947f5d3 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:52.782299 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91bf8624-4dc4-418e-9e3a-f6be5947f5d3 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:52.782299 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91bf8624-4dc4-418e-9e3a-f6be5947f5d3 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:52.782299 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91bf8624-4dc4-418e-9e3a-f6be5947f5d3 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:52.782299 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91bf8624-4dc4-418e-9e3a-f6be5947f5d3 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:52.782299 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91bf8624-4dc4-418e-9e3a-f6be5947f5d3 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:52.782299 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91bf8624-4dc4-418e-9e3a-f6be5947f5d3 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:52.782299 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91bf8624-4dc4-418e-9e3a-f6be5947f5d3 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:52.782299 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91bf8624-4dc4-418e-9e3a-f6be5947f5d3 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:52.782299 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91bf8624-4dc4-418e-9e3a-f6be5947f5d3 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:52.783486 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91bf8624-4dc4-418e-9e3a-f6be5947f5d3 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:52.783819 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-91bf8624-4dc4-418e-9e3a-f6be5947f5d3 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108545) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:03:52.807327 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] Attempting to bind port 9fd131ff-7577-434d-808c-a8686762bec8 on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 13:03:52.811995 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] Attempting to bind port 9fd131ff-7577-434d-808c-a8686762bec8 by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': '990fa8e2-8f5c-4714-aa6e-d15bfa97b992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 889, 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4'}] {{(pid=108545) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 13:03:52.811995 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] Attempting to bind port 9fd131ff-7577-434d-808c-a8686762bec8 on network 547d6dbb-2ff3-449a-acfb-935d7f0325c4 {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 13:03:52.818780 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 13, 3, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 13:03:52.819369 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] Checking segment: {'id': '990fa8e2-8f5c-4714-aa6e-d15bfa97b992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 889, 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108545) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 13:03:52.820003 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:52.820628 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] Bound using segment: {'id': '990fa8e2-8f5c-4714-aa6e-d15bfa97b992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 889, 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4'} {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 13:03:52.821404 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] Bound port: 9fd131ff-7577-434d-808c-a8686762bec8, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '990fa8e2-8f5c-4714-aa6e-d15bfa97b992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 889, 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4'}}] {{(pid=108545) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 13:03:52.822181 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:52.868696 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-4b24e686-4c3c-4790-98e2-1eefd3d5a016 None None] Create dhcp port {'port': {'name': '', 'admin_state_up': True, 'device_id': 'dhcp94ac73f7-a43e-5b43-a0b7-503cbb5c76bd-91dd6799-b00d-4e11-9a1f-9e1f44d1d95d', 'network_id': '91dd6799-b00d-4e11-9a1f-9e1f44d1d95d', 'tenant_id': '6fe63572d2d044a3bd46527067b9a0e2', 'fixed_ips': [{'subnet_id': 'ef953611-234b-4101-b890-254859ae3613'}]}} from dv-cinder-816324-1-iscsi. {{(pid=108544) create_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:285}} Nov 02 13:03:52.870707 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-4b24e686-4c3c-4790-98e2-1eefd3d5a016 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:52.967552 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.db [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] For port 9fd131ff-7577-434d-808c-a8686762bec8, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108545) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 13:03:52.973134 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.db [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] For port 9fd131ff-7577-434d-808c-a8686762bec8, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=9fd131ff-7577-434d-808c-a8686762bec8,segment=NetworkSegment(990fa8e2-8f5c-4714-aa6e-d15bfa97b992),segment_id=990fa8e2-8f5c-4714-aa6e-d15bfa97b992)] {{(pid=108545) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 13:03:53.025214 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port da758e7f-f09a-49c1-8f4b-d623ff24fff3 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:03:53.025741 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:53.047189 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c0e10131-f35f-4884-b6a3-1b1a44ff38c6 admin admin] Publish callbacks [] for router_gateway, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:53.080013 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:53.151207 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-ab68f595-3eb2-43b2-b7d4-55ceddf4cf14 None None] Provisioning complete for port 9fd131ff-7577-434d-808c-a8686762bec8 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:03:53.151834 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-ab68f595-3eb2-43b2-b7d4-55ceddf4cf14 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:53.220880 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-91bf8624-4dc4-418e-9e3a-f6be5947f5d3 None None] Pushing event updated for resources: {'Port': ['ID=9fd131ff-7577-434d-808c-a8686762bec8,revision_number=4']} {{(pid=108545) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:53.226531 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] Routers {'8f644798-f842-47ae-90c4-f5e349fed2fb'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:03:53.227575 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 1, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 1, "log_agent_heartbeats": false, "routers": 1},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:03:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['8f644798-f842-47ae-90c4-f5e349fed2fb'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:03:53.394906 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.db_base_plugin_common [None req-4b24e686-4c3c-4790-98e2-1eefd3d5a016 None None] Allocated IP 172.20.0.2 (91dd6799-b00d-4e11-9a1f-9e1f44d1d95d/ef953611-234b-4101-b890-254859ae3613/aff253af-d893-42ac-bd26-211a5721f3aa) {{(pid=108544) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 13:03:53.436994 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] Set router 8f644798-f842-47ae-90c4-f5e349fed2fb gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:03:53.481176 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c0e10131-f35f-4884-b6a3-1b1a44ff38c6 admin admin] Publish callbacks [] for router_gateway, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:53.509944 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c0e10131-f35f-4884-b6a3-1b1a44ff38c6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:53.561950 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-ab68f595-3eb2-43b2-b7d4-55ceddf4cf14 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:53.638127 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-3e0a15c1-5113-4428-946a-d1df5f837f03 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:53.656765 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [None req-c0e10131-f35f-4884-b6a3-1b1a44ff38c6 admin admin] Allocated IP 172.27.0.185 (43464fa8-eb00-46fb-9ca0-be7342f9ddbf/44a807bc-f2b6-41f0-b765-e5d3393fe305/c27080dd-3f5d-4572-a1ce-98f5b3c9fe74) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 13:03:53.711975 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-ab68f595-3eb2-43b2-b7d4-55ceddf4cf14 None None] For port 9fd131ff-7577-434d-808c-a8686762bec8, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=9fd131ff-7577-434d-808c-a8686762bec8,segment=NetworkSegment(990fa8e2-8f5c-4714-aa6e-d15bfa97b992),segment_id=990fa8e2-8f5c-4714-aa6e-d15bfa97b992)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:03:53.732183 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'name': 'tempest-TestMinimumBasicScenario-539319503-router', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:03:48Z', 'revision_number': 4, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'gw_port': {'id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:95:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:03:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '9fd131ff-7577-434d-808c-a8686762bec8', 'name': '', 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'mac_address': 'fa:16:3e:5e:18:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '424f2c99-da28-4193-b1e7-1cafea9ef4ee', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:47Z', 'updated_at': '2021-11-02T13:03:52Z', 'revision_number': 4, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'subnets': [{'id': '424f2c99-da28-4193-b1e7-1cafea9ef4ee', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:03:53.778077 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-ab68f595-3eb2-43b2-b7d4-55ceddf4cf14 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:53.782125 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-0f2cbe02-e2b7-465c-9315-6bfd46c4958c None None] The sync data for ids ['8f644798-f842-47ae-90c4-f5e349fed2fb'] in dv-cinder-816324-1-iscsi is: [{'id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'name': 'tempest-TestMinimumBasicScenario-539319503-router', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:03:48Z', 'revision_number': 4, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'gw_port': {'id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:95:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:03:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '9fd131ff-7577-434d-808c-a8686762bec8', 'name': '', 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'mac_address': 'fa:16:3e:5e:18:23', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '424f2c99-da28-4193-b1e7-1cafea9ef4ee', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:47Z', 'updated_at': '2021-11-02T13:03:52Z', 'revision_number': 4, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'subnets': [{'id': '424f2c99-da28-4193-b1e7-1cafea9ef4ee', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 13:03:53.815379 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c0e10131-f35f-4884-b6a3-1b1a44ff38c6 admin admin] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:53.827487 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-4b24e686-4c3c-4790-98e2-1eefd3d5a016 None None] Publish callbacks [] for port, precommit_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:53.875661 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-ab68f595-3eb2-43b2-b7d4-55ceddf4cf14 None None] Pushing event updated for resources: {'Port': ['ID=9fd131ff-7577-434d-808c-a8686762bec8,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:53.885186 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-4b24e686-4c3c-4790-98e2-1eefd3d5a016 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669'] for port, after_create {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:53.943321 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4b24e686-4c3c-4790-98e2-1eefd3d5a016 None None] Network 91dd6799-b00d-4e11-9a1f-9e1f44d1d95d is already hosted by enough agents. {{(pid=108544) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 13:03:53.943614 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c0e10131-f35f-4884-b6a3-1b1a44ff38c6 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:53.958772 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.scheduler.base_scheduler [None req-4b24e686-4c3c-4790-98e2-1eefd3d5a016 None None] Resources bound (agent type, host, resource id): {{(pid=108544) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 13:03:53.961601 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-4d72918f-46a8-4ec4-81ca-1d30c52e0a32 None None] Provisioning complete for port 9fd131ff-7577-434d-808c-a8686762bec8 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:03:53.961964 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-4d72918f-46a8-4ec4-81ca-1d30c52e0a32 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:53.989705 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c0e10131-f35f-4884-b6a3-1b1a44ff38c6 admin admin] Network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 13:03:53.992367 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4b24e686-4c3c-4790-98e2-1eefd3d5a016 None None] Received port after_create {{(pid=108544) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 13:03:53.993350 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [None req-c0e10131-f35f-4884-b6a3-1b1a44ff38c6 admin admin] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 13:03:53.994798 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b24e686-4c3c-4790-98e2-1eefd3d5a016 None None] Pushing event updated for resources: {'Port': ['ID=aff253af-d893-42ac-bd26-211a5721f3aa,revision_number=1']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:53.996392 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c0e10131-f35f-4884-b6a3-1b1a44ff38c6 admin admin] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 13:03:54.047020 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c0e10131-f35f-4884-b6a3-1b1a44ff38c6 admin admin] Pushing event updated for resources: {'Port': ['ID=c27080dd-3f5d-4572-a1ce-98f5b3c9fe74,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:54.083804 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-4b24e686-4c3c-4790-98e2-1eefd3d5a016 None None] Attempting to bind port aff253af-d893-42ac-bd26-211a5721f3aa on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 13:03:54.084211 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-4b24e686-4c3c-4790-98e2-1eefd3d5a016 None None] Attempting to bind port aff253af-d893-42ac-bd26-211a5721f3aa by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': '4061b408-6fc7-4fc7-928c-ef9dfc54c821', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '91dd6799-b00d-4e11-9a1f-9e1f44d1d95d'}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 13:03:54.084632 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b24e686-4c3c-4790-98e2-1eefd3d5a016 None None] Attempting to bind port aff253af-d893-42ac-bd26-211a5721f3aa on network 91dd6799-b00d-4e11-9a1f-9e1f44d1d95d {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 13:03:54.117917 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b24e686-4c3c-4790-98e2-1eefd3d5a016 None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 13, 3, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 13:03:54.118516 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b24e686-4c3c-4790-98e2-1eefd3d5a016 None None] Checking segment: {'id': '4061b408-6fc7-4fc7-928c-ef9dfc54c821', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '91dd6799-b00d-4e11-9a1f-9e1f44d1d95d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108544) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 13:03:54.119014 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-4b24e686-4c3c-4790-98e2-1eefd3d5a016 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:54.119410 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-4b24e686-4c3c-4790-98e2-1eefd3d5a016 None None] Bound using segment: {'id': '4061b408-6fc7-4fc7-928c-ef9dfc54c821', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '91dd6799-b00d-4e11-9a1f-9e1f44d1d95d'} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 13:03:54.119910 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-4b24e686-4c3c-4790-98e2-1eefd3d5a016 None None] Bound port: aff253af-d893-42ac-bd26-211a5721f3aa, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4061b408-6fc7-4fc7-928c-ef9dfc54c821', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '91dd6799-b00d-4e11-9a1f-9e1f44d1d95d'}}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 13:03:54.120300 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-4b24e686-4c3c-4790-98e2-1eefd3d5a016 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:54.236317 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-4b24e686-4c3c-4790-98e2-1eefd3d5a016 None None] For port aff253af-d893-42ac-bd26-211a5721f3aa, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108544) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 13:03:54.241066 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-4b24e686-4c3c-4790-98e2-1eefd3d5a016 None None] For port aff253af-d893-42ac-bd26-211a5721f3aa, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=aff253af-d893-42ac-bd26-211a5721f3aa,segment=NetworkSegment(4061b408-6fc7-4fc7-928c-ef9dfc54c821),segment_id=4061b408-6fc7-4fc7-928c-ef9dfc54c821)] {{(pid=108544) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 13:03:54.341837 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-4b24e686-4c3c-4790-98e2-1eefd3d5a016 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:54.426486 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4b24e686-4c3c-4790-98e2-1eefd3d5a016 None None] Pushing event updated for resources: {'Port': ['ID=aff253af-d893-42ac-bd26-211a5721f3aa,revision_number=2']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:54.469604 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c0e10131-f35f-4884-b6a3-1b1a44ff38c6 admin admin] Publish callbacks [] for router_gateway, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:54.821052 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 9fd131ff-7577-434d-808c-a8686762bec8 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 13:03:54.885930 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port 9fd131ff-7577-434d-808c-a8686762bec8 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:03:54.886403 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:55.157007 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c0e10131-f35f-4884-b6a3-1b1a44ff38c6 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._after_router_create-1593163', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_snat_interfaces_after_change-1595034'] for router, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:55.474424 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c0e10131-f35f-4884-b6a3-1b1a44ff38c6 admin admin] Router 625b8bfa-e779-4e0e-b6b7-0b10dadd40ba is scheduled to L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc with binding_index 1 {{(pid=108543) bind_router /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:209}} Nov 02 13:03:55.641539 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c0e10131-f35f-4884-b6a3-1b1a44ff38c6 admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108543) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 13:03:55.656911 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] Sync routers for ids ['625b8bfa-e779-4e0e-b6b7-0b10dadd40ba'] in dv-cinder-816324-1-iscsi {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 13:03:55.665615 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-4e8df190-b0cb-4559-badb-3feecef785a2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:55.674017 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-af7b4591-ef4b-4d33-8ecf-e43ad3b44796 None None] Network 91dd6799-b00d-4e11-9a1f-9e1f44d1d95d requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 13:03:55.704700 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] Routers {'625b8bfa-e779-4e0e-b6b7-0b10dadd40ba'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:03:55.705403 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:03:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['625b8bfa-e779-4e0e-b6b7-0b10dadd40ba'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:03:55.732124 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-c0e10131-f35f-4884-b6a3-1b1a44ff38c6 admin admin] Publish callbacks [] for router, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:55.733622 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-c0e10131-f35f-4884-b6a3-1b1a44ff38c6 admin admin] 10.222.0.98 "POST /v2.0/routers HTTP/1.1" status: 201 len: 926 time: 3.3007665 Nov 02 13:03:55.743519 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 37020) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:03:55.847866 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1411ae57-19e6-4a2d-840b-823143c5d0dc None None] Provisioning complete for port aff253af-d893-42ac-bd26-211a5721f3aa triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:03:55.848282 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1411ae57-19e6-4a2d-840b-823143c5d0dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:56.005847 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] Set router 625b8bfa-e779-4e0e-b6b7-0b10dadd40ba gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:03:56.233285 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1411ae57-19e6-4a2d-840b-823143c5d0dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:56.305328 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c5eaa360-89b5-4188-ba45-167fd734becf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:56.341025 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1411ae57-19e6-4a2d-840b-823143c5d0dc None None] For port aff253af-d893-42ac-bd26-211a5721f3aa, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=aff253af-d893-42ac-bd26-211a5721f3aa,segment=NetworkSegment(4061b408-6fc7-4fc7-928c-ef9dfc54c821),segment_id=4061b408-6fc7-4fc7-928c-ef9dfc54c821)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:03:56.385083 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '625b8bfa-e779-4e0e-b6b7-0b10dadd40ba', 'name': 'tempest-TestMinimumBasicScenario-200701357-router', 'tenant_id': '6fe63572d2d044a3bd46527067b9a0e2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.185'}], 'enable_snat': True}, 'gw_port_id': 'c27080dd-3f5d-4572-a1ce-98f5b3c9fe74', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T13:03:52Z', 'updated_at': '2021-11-02T13:03:54Z', 'revision_number': 3, 'project_id': '6fe63572d2d044a3bd46527067b9a0e2', 'gw_port': {'id': 'c27080dd-3f5d-4572-a1ce-98f5b3c9fe74', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ef:2c:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '625b8bfa-e779-4e0e-b6b7-0b10dadd40ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:53Z', 'updated_at': '2021-11-02T13:03:53Z', 'revision_number': 1, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:03:56.422749 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] Checking router: 625b8bfa-e779-4e0e-b6b7-0b10dadd40ba for host: dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 13:03:56.423132 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] Updating router 625b8bfa-e779-4e0e-b6b7-0b10dadd40ba port c27080dd-3f5d-4572-a1ce-98f5b3c9fe74 binding host dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 02 13:03:56.453771 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:56.482083 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1411ae57-19e6-4a2d-840b-823143c5d0dc None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:56.571715 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_common [None req-c5eaa360-89b5-4188-ba45-167fd734becf admin admin] Allocated IP 172.20.0.1 (91dd6799-b00d-4e11-9a1f-9e1f44d1d95d/ef953611-234b-4101-b890-254859ae3613/c24dc862-8075-4797-aa33-29a73025f1b7) {{(pid=108542) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 13:03:56.784066 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c5eaa360-89b5-4188-ba45-167fd734becf admin admin] Publish callbacks [] for port, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:56.798832 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device aff253af-d893-42ac-bd26-211a5721f3aa up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 13:03:56.843187 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1411ae57-19e6-4a2d-840b-823143c5d0dc None None] Pushing event updated for resources: {'Port': ['ID=aff253af-d893-42ac-bd26-211a5721f3aa,revision_number=3']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:56.879516 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c5eaa360-89b5-4188-ba45-167fd734becf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:56.885012 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-84512a8e-4f87-4f4c-ad3d-876ff86a7f8d None None] Provisioning complete for port aff253af-d893-42ac-bd26-211a5721f3aa triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:03:56.885299 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-84512a8e-4f87-4f4c-ad3d-876ff86a7f8d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:56.917976 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c5eaa360-89b5-4188-ba45-167fd734becf admin admin] Network 91dd6799-b00d-4e11-9a1f-9e1f44d1d95d is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 13:03:56.921132 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-c5eaa360-89b5-4188-ba45-167fd734becf admin admin] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 13:03:56.927634 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c5eaa360-89b5-4188-ba45-167fd734becf admin admin] Received port after_create {{(pid=108542) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 13:03:56.943378 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:56.960023 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5eaa360-89b5-4188-ba45-167fd734becf admin admin] Pushing event updated for resources: {'Port': ['ID=c24dc862-8075-4797-aa33-29a73025f1b7,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:56.984455 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c5eaa360-89b5-4188-ba45-167fd734becf admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._add_csnat_on_interface_create-1590217'] for router_interface, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:57.005858 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port aff253af-d893-42ac-bd26-211a5721f3aa triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:03:57.006308 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:57.162087 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] Publish callbacks [] for port, precommit_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:57.240613 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:57.245851 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c5eaa360-89b5-4188-ba45-167fd734becf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:57.317282 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] Attempting to bind port c27080dd-3f5d-4572-a1ce-98f5b3c9fe74 on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 13:03:57.317282 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] Attempting to bind port c27080dd-3f5d-4572-a1ce-98f5b3c9fe74 by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 13:03:57.317282 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] Attempting to bind port c27080dd-3f5d-4572-a1ce-98f5b3c9fe74 on network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 13:03:57.318581 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb077ab9-ba34-4a50-928d-17f39677ac7b None None] Pushing event updated for resources: {'Port': ['ID=c27080dd-3f5d-4572-a1ce-98f5b3c9fe74,revision_number=2']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:57.322346 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-8990caf6-0bed-4de4-b25f-6ddac36bb74d None None] Provisioning complete for port c24dc862-8075-4797-aa33-29a73025f1b7 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:03:57.322756 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-8990caf6-0bed-4de4-b25f-6ddac36bb74d None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:57.328259 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 13, 3, 31), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 13:03:57.328830 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] Checking segment: {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108544) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 13:03:57.329227 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:57.329726 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] Bound using segment: {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'} {{(pid=108544) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 13:03:57.330120 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.managers [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] Bound port: c27080dd-3f5d-4572-a1ce-98f5b3c9fe74, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '64efaa63-f19c-4383-a10b-56b16f82f716', 'network_type': 'flat', 'physical_network': 'physnet1', 'segmentation_id': None, 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf'}}] {{(pid=108544) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 13:03:57.330688 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:57.401365 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-8990caf6-0bed-4de4-b25f-6ddac36bb74d None None] Port c24dc862-8075-4797-aa33-29a73025f1b7 cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 13:03:57.421371 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] For port c27080dd-3f5d-4572-a1ce-98f5b3c9fe74, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108544) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 13:03:57.424811 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] For port c27080dd-3f5d-4572-a1ce-98f5b3c9fe74, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=c27080dd-3f5d-4572-a1ce-98f5b3c9fe74,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108544) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 13:03:57.481963 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c5eaa360-89b5-4188-ba45-167fd734becf admin admin] Publish callbacks [] for port, precommit_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:57.530858 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:57.576369 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c5eaa360-89b5-4188-ba45-167fd734becf admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126476609'] for port, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:57.599622 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] Routers {'625b8bfa-e779-4e0e-b6b7-0b10dadd40ba'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:03:57.600347 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:03:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['625b8bfa-e779-4e0e-b6b7-0b10dadd40ba'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:03:57.639348 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-eb077ab9-ba34-4a50-928d-17f39677ac7b None None] Pushing event updated for resources: {'Port': ['ID=c27080dd-3f5d-4572-a1ce-98f5b3c9fe74,revision_number=3']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:57.703147 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-c5eaa360-89b5-4188-ba45-167fd734becf admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_created-1649136', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._update_snat_v6_addrs_after_intf_update-1590109'] for router_interface, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:57.707884 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-c5eaa360-89b5-4188-ba45-167fd734becf admin admin] Pushing event updated for resources: {'Port': ['ID=c24dc862-8075-4797-aa33-29a73025f1b7,revision_number=2']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:03:57.738474 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] Set router 625b8bfa-e779-4e0e-b6b7-0b10dadd40ba gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:03:57.855368 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-c5eaa360-89b5-4188-ba45-167fd734becf admin admin] Network 91dd6799-b00d-4e11-9a1f-9e1f44d1d95d is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 13:03:57.858497 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-c5eaa360-89b5-4188-ba45-167fd734becf admin admin] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 13:03:58.062329 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '625b8bfa-e779-4e0e-b6b7-0b10dadd40ba', 'name': 'tempest-TestMinimumBasicScenario-200701357-router', 'tenant_id': '6fe63572d2d044a3bd46527067b9a0e2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.185'}], 'enable_snat': True}, 'gw_port_id': 'c27080dd-3f5d-4572-a1ce-98f5b3c9fe74', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T13:03:52Z', 'updated_at': '2021-11-02T13:03:57Z', 'revision_number': 4, 'project_id': '6fe63572d2d044a3bd46527067b9a0e2', 'gw_port': {'id': 'c27080dd-3f5d-4572-a1ce-98f5b3c9fe74', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ef:2c:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '625b8bfa-e779-4e0e-b6b7-0b10dadd40ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:53Z', 'updated_at': '2021-11-02T13:03:57Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': 'c24dc862-8075-4797-aa33-29a73025f1b7', 'name': '', 'network_id': '91dd6799-b00d-4e11-9a1f-9e1f44d1d95d', 'tenant_id': '6fe63572d2d044a3bd46527067b9a0e2', 'mac_address': 'fa:16:3e:2e:9c:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '625b8bfa-e779-4e0e-b6b7-0b10dadd40ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': 'ef953611-234b-4101-b890-254859ae3613', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:56Z', 'updated_at': '2021-11-02T13:03:57Z', 'revision_number': 2, 'project_id': '6fe63572d2d044a3bd46527067b9a0e2', 'subnets': [{'id': 'ef953611-234b-4101-b890-254859ae3613', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:03:58.075957 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-c5eaa360-89b5-4188-ba45-167fd734becf admin admin] Router 625b8bfa-e779-4e0e-b6b7-0b10dadd40ba has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108542) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 13:03:58.131577 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-c1117cbc-fc96-48b8-a0f9-55bb61650ac0 None None] The sync data for ids ['625b8bfa-e779-4e0e-b6b7-0b10dadd40ba'] in dv-cinder-816324-1-iscsi is: [{'id': '625b8bfa-e779-4e0e-b6b7-0b10dadd40ba', 'name': 'tempest-TestMinimumBasicScenario-200701357-router', 'tenant_id': '6fe63572d2d044a3bd46527067b9a0e2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.185'}], 'enable_snat': True}, 'gw_port_id': 'c27080dd-3f5d-4572-a1ce-98f5b3c9fe74', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T13:03:52Z', 'updated_at': '2021-11-02T13:03:57Z', 'revision_number': 4, 'project_id': '6fe63572d2d044a3bd46527067b9a0e2', 'gw_port': {'id': 'c27080dd-3f5d-4572-a1ce-98f5b3c9fe74', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ef:2c:32', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '625b8bfa-e779-4e0e-b6b7-0b10dadd40ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:53Z', 'updated_at': '2021-11-02T13:03:57Z', 'revision_number': 3, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': 'c24dc862-8075-4797-aa33-29a73025f1b7', 'name': '', 'network_id': '91dd6799-b00d-4e11-9a1f-9e1f44d1d95d', 'tenant_id': '6fe63572d2d044a3bd46527067b9a0e2', 'mac_address': 'fa:16:3e:2e:9c:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '625b8bfa-e779-4e0e-b6b7-0b10dadd40ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': 'ef953611-234b-4101-b890-254859ae3613', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:56Z', 'updated_at': '2021-11-02T13:03:57Z', 'revision_number': 2, 'project_id': '6fe63572d2d044a3bd46527067b9a0e2', 'subnets': [{'id': 'ef953611-234b-4101-b890-254859ae3613', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 13:03:58.153461 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-3eb6bdaa-0fd5-4f2b-b0de-e01d91944045 None None] Provisioning complete for port c24dc862-8075-4797-aa33-29a73025f1b7 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:03:58.153777 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-3eb6bdaa-0fd5-4f2b-b0de-e01d91944045 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:58.220691 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-3eb6bdaa-0fd5-4f2b-b0de-e01d91944045 None None] Port c24dc862-8075-4797-aa33-29a73025f1b7 cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 13:03:58.302426 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-c5eaa360-89b5-4188-ba45-167fd734becf admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108542) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 13:03:58.312927 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-c5eaa360-89b5-4188-ba45-167fd734becf admin admin] 10.222.0.98 "PUT /v2.0/routers/625b8bfa-e779-4e0e-b6b7-0b10dadd40ba/add_router_interface HTTP/1.1" status: 200 len: 503 time: 2.5664670 Nov 02 13:03:58.423568 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:03:58.689099 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device aff253af-d893-42ac-bd26-211a5721f3aa up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 13:03:58.788816 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port aff253af-d893-42ac-bd26-211a5721f3aa triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:03:58.789425 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:00.753316 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device c27080dd-3f5d-4572-a1ce-98f5b3c9fe74 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 13:04:00.857479 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port c27080dd-3f5d-4572-a1ce-98f5b3c9fe74 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:04:00.858303 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:00.890278 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:00.971231 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:01.007562 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] For port c27080dd-3f5d-4572-a1ce-98f5b3c9fe74, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=c27080dd-3f5d-4572-a1ce-98f5b3c9fe74,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:04:01.072660 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:01.135943 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Pushing event updated for resources: {'Port': ['ID=c27080dd-3f5d-4572-a1ce-98f5b3c9fe74,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:04:01.963873 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] Sync routers for ids ['625b8bfa-e779-4e0e-b6b7-0b10dadd40ba'] in dv-cinder-816324-1-iscsi {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 13:04:01.980190 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] Routers {'625b8bfa-e779-4e0e-b6b7-0b10dadd40ba'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:04:01.980755 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:03:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['625b8bfa-e779-4e0e-b6b7-0b10dadd40ba'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:04:02.121114 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] Set router 625b8bfa-e779-4e0e-b6b7-0b10dadd40ba gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:04:02.440479 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '625b8bfa-e779-4e0e-b6b7-0b10dadd40ba', 'name': 'tempest-TestMinimumBasicScenario-200701357-router', 'tenant_id': '6fe63572d2d044a3bd46527067b9a0e2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.185'}], 'enable_snat': True}, 'gw_port_id': 'c27080dd-3f5d-4572-a1ce-98f5b3c9fe74', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T13:03:52Z', 'updated_at': '2021-11-02T13:03:57Z', 'revision_number': 4, 'project_id': '6fe63572d2d044a3bd46527067b9a0e2', 'gw_port': {'id': 'c27080dd-3f5d-4572-a1ce-98f5b3c9fe74', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ef:2c:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '625b8bfa-e779-4e0e-b6b7-0b10dadd40ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:53Z', 'updated_at': '2021-11-02T13:04:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': 'c24dc862-8075-4797-aa33-29a73025f1b7', 'name': '', 'network_id': '91dd6799-b00d-4e11-9a1f-9e1f44d1d95d', 'tenant_id': '6fe63572d2d044a3bd46527067b9a0e2', 'mac_address': 'fa:16:3e:2e:9c:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '625b8bfa-e779-4e0e-b6b7-0b10dadd40ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': 'ef953611-234b-4101-b890-254859ae3613', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': '', 'binding:vif_type': 'unbound', 'binding:vif_details': {}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:56Z', 'updated_at': '2021-11-02T13:03:57Z', 'revision_number': 2, 'project_id': '6fe63572d2d044a3bd46527067b9a0e2', 'subnets': [{'id': 'ef953611-234b-4101-b890-254859ae3613', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:04:02.477410 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] Checking router: 625b8bfa-e779-4e0e-b6b7-0b10dadd40ba for host: dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 13:04:02.477902 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] Updating router 625b8bfa-e779-4e0e-b6b7-0b10dadd40ba port c24dc862-8075-4797-aa33-29a73025f1b7 binding host dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_port /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:205}} Nov 02 13:04:02.513310 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:02.746557 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device c27080dd-3f5d-4572-a1ce-98f5b3c9fe74 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 13:04:02.853077 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port c27080dd-3f5d-4572-a1ce-98f5b3c9fe74 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:04:02.853839 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:03.162447 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] Publish callbacks [] for port, precommit_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:03.358656 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:03.450236 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42ece236-4f78-4c54-92e7-5ff5281dac74 None None] Pushing event updated for resources: {'Port': ['ID=c24dc862-8075-4797-aa33-29a73025f1b7,revision_number=3']} {{(pid=108545) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:04:03.490742 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] Attempting to bind port c24dc862-8075-4797-aa33-29a73025f1b7 on host dv-cinder-816324-1-iscsi for vnic_type normal with profile {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 13:04:03.491046 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] Attempting to bind port c24dc862-8075-4797-aa33-29a73025f1b7 by drivers openvswitch,hyperv on host dv-cinder-816324-1-iscsi at level 0 using segments [{'id': '4061b408-6fc7-4fc7-928c-ef9dfc54c821', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '91dd6799-b00d-4e11-9a1f-9e1f44d1d95d'}] {{(pid=108545) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 13:04:03.491453 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] Attempting to bind port c24dc862-8075-4797-aa33-29a73025f1b7 on network 91dd6799-b00d-4e11-9a1f-9e1f44d1d95d {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 13:04:03.493004 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:03.500034 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] Checking agent: {'id': 'f3dad56d-0a04-4da6-8547-d27dfbb376c8', 'agent_type': 'Open vSwitch agent', 'binary': 'neutron-openvswitch-agent', 'topic': 'N/A', 'host': 'dv-cinder-816324-1-iscsi', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 40, 31), 'started_at': datetime.datetime(2021, 11, 2, 12, 41, 1), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 13, 4, 1), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'arp_responder_enabled': False, 'baremetal_smartnic': False, 'bridge_mappings': {'physnet1': 'br-data'}, 'datapath_type': 'system', 'devices': 0, 'enable_distributed_routing': False, 'extensions': [], 'in_distributed_mode': False, 'integration_bridge': 'br-int', 'l2_population': False, 'log_agent_heartbeats': False, 'ovs_capabilities': {'datapath_types': ['netdev', 'system'], 'iface_types': ['erspan', 'geneve', 'gre', 'internal', 'ip6erspan', 'ip6gre', 'lisp', 'patch', 'stt', 'system', 'tap', 'vxlan']}, 'ovs_hybrid_plug': False, 'resource_provider_bandwidths': {}, 'resource_provider_hypervisors': {'br-data': 'dv-cinder-816324-1-iscsi'}, 'resource_provider_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_inventory_defaults': {'allocation_ratio': 1.0, 'min_unit': 1, 'step_size': 1, 'reserved': 0}, 'resource_provider_packet_processing_with_direction': {}, 'resource_provider_packet_processing_without_direction': {}, 'tunnel_types': [], 'tunneling_ip': None, 'vhostuser_socket_dir': '/var/run/openvswitch'}, 'resource_versions': {'AddressGroup': '1.2', 'ConntrackHelper': '1.0', 'Log': '1.0', 'Network': '1.1', 'Port': '1.7', 'PortForwarding': '1.2', 'QosPolicy': '1.10', 'SecurityGroup': '1.5', 'SecurityGroupRule': '1.2', 'SubPort': '1.0', 'Subnet': '1.1', 'Trunk': '1.1'}} {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 13:04:03.500475 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] Checking segment: {'id': '4061b408-6fc7-4fc7-928c-ef9dfc54c821', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '91dd6799-b00d-4e11-9a1f-9e1f44d1d95d'} for mappings: {'physnet1': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108545) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 13:04:03.500873 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] Publish callbacks [] for ovs_bridge_name, before_read {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:03.501286 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.drivers.mech_agent [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] Bound using segment: {'id': '4061b408-6fc7-4fc7-928c-ef9dfc54c821', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '91dd6799-b00d-4e11-9a1f-9e1f44d1d95d'} {{(pid=108545) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 13:04:03.501740 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.managers [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] Bound port: c24dc862-8075-4797-aa33-29a73025f1b7, host: dv-cinder-816324-1-iscsi, vif_type: ovs, vif_details: {"connectivity": "l2", "port_filter": true, "ovs_hybrid_plug": false, "datapath_type": "system", "bridge_name": "br-int"}, binding_levels: [{'bound_driver': 'openvswitch', 'bound_segment': {'id': '4061b408-6fc7-4fc7-928c-ef9dfc54c821', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 876, 'network_id': '91dd6799-b00d-4e11-9a1f-9e1f44d1d95d'}}] {{(pid=108545) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 13:04:03.502153 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:03.627981 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.db [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] For port c24dc862-8075-4797-aa33-29a73025f1b7, host dv-cinder-816324-1-iscsi, cleared binding levels {{(pid=108545) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 13:04:03.634483 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.plugins.ml2.db [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] For port c24dc862-8075-4797-aa33-29a73025f1b7, host dv-cinder-816324-1-iscsi, set binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=c24dc862-8075-4797-aa33-29a73025f1b7,segment=NetworkSegment(4061b408-6fc7-4fc7-928c-ef9dfc54c821),segment_id=4061b408-6fc7-4fc7-928c-ef9dfc54c821)] {{(pid=108545) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 13:04:03.693218 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron_lib.callbacks.manager [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108545) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:03.799089 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] Routers {'625b8bfa-e779-4e0e-b6b7-0b10dadd40ba'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:04:03.799089 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 2, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 2, "log_agent_heartbeats": false, "routers": 2},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:03:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['625b8bfa-e779-4e0e-b6b7-0b10dadd40ba'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:04:03.821125 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-2d10481d-06c2-4223-b078-c07cb3e9f995 None None] Provisioning complete for port c24dc862-8075-4797-aa33-29a73025f1b7 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:04:03.821994 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-2d10481d-06c2-4223-b078-c07cb3e9f995 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:03.971145 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-42ece236-4f78-4c54-92e7-5ff5281dac74 None None] Pushing event updated for resources: {'Port': ['ID=c24dc862-8075-4797-aa33-29a73025f1b7,revision_number=4']} {{(pid=108545) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:04:03.995025 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-2d10481d-06c2-4223-b078-c07cb3e9f995 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:04.031737 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] Set router 625b8bfa-e779-4e0e-b6b7-0b10dadd40ba gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:04:04.038159 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-2d10481d-06c2-4223-b078-c07cb3e9f995 None None] For port c24dc862-8075-4797-aa33-29a73025f1b7, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=c24dc862-8075-4797-aa33-29a73025f1b7,segment=NetworkSegment(4061b408-6fc7-4fc7-928c-ef9dfc54c821),segment_id=4061b408-6fc7-4fc7-928c-ef9dfc54c821)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:04:04.133039 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-2d10481d-06c2-4223-b078-c07cb3e9f995 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:04.214213 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d10481d-06c2-4223-b078-c07cb3e9f995 None None] Pushing event updated for resources: {'Port': ['ID=c24dc862-8075-4797-aa33-29a73025f1b7,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:04:04.249855 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-6e46373b-2b7d-4691-8b45-5b053d03b8a9 None None] Provisioning complete for port c24dc862-8075-4797-aa33-29a73025f1b7 triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:04:04.249855 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-6e46373b-2b7d-4691-8b45-5b053d03b8a9 None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:04.380790 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '625b8bfa-e779-4e0e-b6b7-0b10dadd40ba', 'name': 'tempest-TestMinimumBasicScenario-200701357-router', 'tenant_id': '6fe63572d2d044a3bd46527067b9a0e2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.185'}], 'enable_snat': True}, 'gw_port_id': 'c27080dd-3f5d-4572-a1ce-98f5b3c9fe74', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T13:03:52Z', 'updated_at': '2021-11-02T13:03:57Z', 'revision_number': 4, 'project_id': '6fe63572d2d044a3bd46527067b9a0e2', 'gw_port': {'id': 'c27080dd-3f5d-4572-a1ce-98f5b3c9fe74', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ef:2c:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '625b8bfa-e779-4e0e-b6b7-0b10dadd40ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:53Z', 'updated_at': '2021-11-02T13:04:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': 'c24dc862-8075-4797-aa33-29a73025f1b7', 'name': '', 'network_id': '91dd6799-b00d-4e11-9a1f-9e1f44d1d95d', 'tenant_id': '6fe63572d2d044a3bd46527067b9a0e2', 'mac_address': 'fa:16:3e:2e:9c:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '625b8bfa-e779-4e0e-b6b7-0b10dadd40ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': 'ef953611-234b-4101-b890-254859ae3613', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:56Z', 'updated_at': '2021-11-02T13:04:03Z', 'revision_number': 4, 'project_id': '6fe63572d2d044a3bd46527067b9a0e2', 'subnets': [{'id': 'ef953611-234b-4101-b890-254859ae3613', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:04:04.412940 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-55fd285e-ee94-40ef-b84f-9580b576898a None None] The sync data for ids ['625b8bfa-e779-4e0e-b6b7-0b10dadd40ba'] in dv-cinder-816324-1-iscsi is: [{'id': '625b8bfa-e779-4e0e-b6b7-0b10dadd40ba', 'name': 'tempest-TestMinimumBasicScenario-200701357-router', 'tenant_id': '6fe63572d2d044a3bd46527067b9a0e2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.185'}], 'enable_snat': True}, 'gw_port_id': 'c27080dd-3f5d-4572-a1ce-98f5b3c9fe74', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T13:03:52Z', 'updated_at': '2021-11-02T13:03:57Z', 'revision_number': 4, 'project_id': '6fe63572d2d044a3bd46527067b9a0e2', 'gw_port': {'id': 'c27080dd-3f5d-4572-a1ce-98f5b3c9fe74', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ef:2c:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '625b8bfa-e779-4e0e-b6b7-0b10dadd40ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:53Z', 'updated_at': '2021-11-02T13:04:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': 'c24dc862-8075-4797-aa33-29a73025f1b7', 'name': '', 'network_id': '91dd6799-b00d-4e11-9a1f-9e1f44d1d95d', 'tenant_id': '6fe63572d2d044a3bd46527067b9a0e2', 'mac_address': 'fa:16:3e:2e:9c:63', 'admin_state_up': True, 'status': 'DOWN', 'device_id': '625b8bfa-e779-4e0e-b6b7-0b10dadd40ba', 'device_owner': 'network:router_interface', 'standard_attr_id': 690, 'fixed_ips': [{'subnet_id': 'ef953611-234b-4101-b890-254859ae3613', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:56Z', 'updated_at': '2021-11-02T13:04:03Z', 'revision_number': 4, 'project_id': '6fe63572d2d044a3bd46527067b9a0e2', 'subnets': [{'id': 'ef953611-234b-4101-b890-254859ae3613', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 13:04:04.734497 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device c24dc862-8075-4797-aa33-29a73025f1b7 up at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 13:04:04.806041 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Provisioning complete for port c24dc862-8075-4797-aa33-29a73025f1b7 triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:04:04.806576 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:10.470684 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 13:04:12.149621 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-85ed59ab-d715-4151-aabe-071145076a92 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:12.151386 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-85ed59ab-d715-4151-aabe-071145076a92 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/networks?id=547d6dbb-2ff3-449a-acfb-935d7f0325c4 HTTP/1.1" status: 200 len: 814 time: 0.1203048 Nov 02 13:04:12.168154 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-1e8e4fa2-5be2-48fc-9dc7-46ddd9f9894a tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/quotas/36f51757702242e8b1343954aa4f93fe HTTP/1.1" status: 200 len: 375 time: 0.0106511 Nov 02 13:04:12.230814 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-5a63e1d5-79ad-4249-8714-c4bc27bda58e tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?tenant_id=36f51757702242e8b1343954aa4f93fe&fields=id HTTP/1.1" status: 200 len: 302 time: 0.0550456 Nov 02 13:04:12.449280 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-747cd54b-9546-46a7-8fdd-cbad375ff975 service neutron] 10.222.0.98 "GET /v2.0/networks/547d6dbb-2ff3-449a-acfb-935d7f0325c4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.2045717 Nov 02 13:04:12.553011 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-1318396a-c7d3-4102-974e-ccd5297f460d service neutron] 10.222.0.98 "GET /v2.0/networks/547d6dbb-2ff3-449a-acfb-935d7f0325c4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0970047 Nov 02 13:04:12.964732 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d8cfc16a-7f2f-41a3-8309-123e15fad41c req-e617c66e-78f7-489f-a134-d627b3c85d71 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 210 time: 0.1462362 Nov 02 13:04:14.061521 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1be05b76-1995-492c-87b1-f61d02dfc0f5 req-7c96c94e-9305-4846-9f6a-9ffed626373f tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 210 time: 0.0316708 Nov 02 13:04:15.149159 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d3db5f75-88b6-4328-8e78-0e2c3f3ad1bc req-c216a8f9-b940-452a-84df-efc4136210f7 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 210 time: 0.0278425 Nov 02 13:04:16.234755 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-3e44bfeb-4bd5-4ab5-9eae-6da75fb66237 req-8d35afa5-1c73-4a2d-9cd1-d564c4a463b4 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 210 time: 0.0273998 Nov 02 13:04:17.350990 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7b7ef9d2-02f0-429b-9bb5-1f0f02419f0b req-5bc42dec-4bf8-4d57-a087-78856af62b6e tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 210 time: 0.0297422 Nov 02 13:04:18.466268 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0e2ebb2c-197f-40f8-b778-59fea811b7a6 req-78e31248-cc06-4153-9ec6-fe958e45c7a4 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 210 time: 0.0338457 Nov 02 13:04:19.428108 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-dd559b88-133e-41a1-ada0-e7b14da5c5a6 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent', 'provider:network_type', 'provider:physical_network', 'provider:segmentation_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:19.429240 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-dd559b88-133e-41a1-ada0-e7b14da5c5a6 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.90 "GET /v2.0/networks?id=547d6dbb-2ff3-449a-acfb-935d7f0325c4 HTTP/1.1" status: 200 len: 814 time: 0.1194074 Nov 02 13:04:19.448116 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-58b5106b-0abb-424e-ada9-278631b3e4af tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Request body: {'port': {'device_id': '45226cec-a8e5-4f79-b716-f30663a5d352', 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4', 'admin_state_up': True, 'tenant_id': '36f51757702242e8b1343954aa4f93fe'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 13:04:19.614413 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-03536fbc-ca02-44c9-b4de-047d6c1ec816 req-3a200b42-8676-421d-b7a5-038c293f10dd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 210 time: 0.0355239 Nov 02 13:04:19.683204 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.quota_enforcement [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-58b5106b-0abb-424e-ada9-278631b3e4af tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Made reservation on behalf of 36f51757702242e8b1343954aa4f93fe for: {'port': 1} {{(pid=108543) before /opt/stack/neutron/neutron/pecan_wsgi/hooks/quota_enforcement.py:53}} Nov 02 13:04:19.687508 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-58b5106b-0abb-424e-ada9-278631b3e4af tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:19.854302 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_common [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-58b5106b-0abb-424e-ada9-278631b3e4af tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Allocated IP 172.20.0.9 (547d6dbb-2ff3-449a-acfb-935d7f0325c4/424f2c99-da28-4193-b1e7-1cafea9ef4ee/ef4f480a-cf21-4d37-9a5f-75aa209da3ce) {{(pid=108543) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 13:04:20.034457 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-58b5106b-0abb-424e-ada9-278631b3e4af tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for port, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:20.118925 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-58b5106b-0abb-424e-ada9-278631b3e4af tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:20.163714 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.dhcp_agent_scheduler [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-58b5106b-0abb-424e-ada9-278631b3e4af tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Network 547d6dbb-2ff3-449a-acfb-935d7f0325c4 is already hosted by enough agents. {{(pid=108543) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 13:04:20.167347 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.base_scheduler [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-58b5106b-0abb-424e-ada9-278631b3e4af tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Resources bound (agent type, host, resource id): {{(pid=108543) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 13:04:20.171941 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-58b5106b-0abb-424e-ada9-278631b3e4af tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Received port after_create {{(pid=108543) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 13:04:20.219012 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-58b5106b-0abb-424e-ada9-278631b3e4af tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Pushing event updated for resources: {'Port': ['ID=ef4f480a-cf21-4d37-9a5f-75aa209da3ce,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:04:20.252069 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-58b5106b-0abb-424e-ada9-278631b3e4af tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details', 'network'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:20.252975 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-58b5106b-0abb-424e-ada9-278631b3e4af tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:20.362240 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-58b5106b-0abb-424e-ada9-278631b3e4af tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.90 "POST /v2.0/ports HTTP/1.1" status: 201 len: 933 time: 0.9149175 Nov 02 13:04:20.386702 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-99221509-1006-48c4-8082-2ee55fb6641c service neutron] Request body: {'port': {'device_id': '45226cec-a8e5-4f79-b716-f30663a5d352', 'device_owner': 'compute:nova', 'binding:host_id': 'hv-cinder-81632'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 13:04:20.507560 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-99221509-1006-48c4-8082-2ee55fb6641c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:20.522484 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-e67046a1-d3d9-4343-8bf8-0718c60b097b None None] Provisioning complete for port ef4f480a-cf21-4d37-9a5f-75aa209da3ce triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:04:20.531749 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-e67046a1-d3d9-4343-8bf8-0718c60b097b None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:20.577573 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-e67046a1-d3d9-4343-8bf8-0718c60b097b None None] Port ef4f480a-cf21-4d37-9a5f-75aa209da3ce cannot update to ACTIVE because it is not bound. {{(pid=108544) _port_provisioned /opt/stack/neutron/neutron/plugins/ml2/plugin.py:340}} Nov 02 13:04:20.973352 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-f671f308-10e6-4989-8a6e-faa4b81b4287 req-3177052a-e1a7-4219-82df-938a180e5732 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:20.974961 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f671f308-10e6-4989-8a6e-faa4b81b4287 req-3177052a-e1a7-4219-82df-938a180e5732 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 931 time: 0.2108159 Nov 02 13:04:21.119563 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-f671f308-10e6-4989-8a6e-faa4b81b4287 req-5ed1ea1e-d831-4b74-a2ae-13634e2d21dd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.1344113 Nov 02 13:04:21.143747 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-99221509-1006-48c4-8082-2ee55fb6641c service neutron] Ignoring state change previous_port_status: DOWN current_port_status: DOWN port_id ef4f480a-cf21-4d37-9a5f-75aa209da3ce {{(pid=108543) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 13:04:21.156376 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-99221509-1006-48c4-8082-2ee55fb6641c service neutron] Publish callbacks [] for port, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:21.174831 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.provisioning_blocks [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-99221509-1006-48c4-8082-2ee55fb6641c service neutron] Transition to ACTIVE for port object ef4f480a-cf21-4d37-9a5f-75aa209da3ce will not be triggered until provisioned by entity L2. {{(pid=108543) add_provisioning_component /opt/stack/neutron/neutron/db/provisioning_blocks.py:73}} Nov 02 13:04:21.238014 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-99221509-1006-48c4-8082-2ee55fb6641c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:21.309841 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99221509-1006-48c4-8082-2ee55fb6641c service neutron] Pushing event updated for resources: {'Port': ['ID=ef4f480a-cf21-4d37-9a5f-75aa209da3ce,revision_number=2']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:04:21.422799 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-99221509-1006-48c4-8082-2ee55fb6641c service neutron] Attempting to bind port ef4f480a-cf21-4d37-9a5f-75aa209da3ce on host hv-cinder-81632 for vnic_type normal with profile {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/managers.py:795}} Nov 02 13:04:21.423138 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-99221509-1006-48c4-8082-2ee55fb6641c service neutron] Attempting to bind port ef4f480a-cf21-4d37-9a5f-75aa209da3ce by drivers openvswitch,hyperv on host hv-cinder-81632 at level 0 using segments [{'id': '990fa8e2-8f5c-4714-aa6e-d15bfa97b992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 889, 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4'}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:820}} Nov 02 13:04:21.423607 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-99221509-1006-48c4-8082-2ee55fb6641c service neutron] Attempting to bind port ef4f480a-cf21-4d37-9a5f-75aa209da3ce on network 547d6dbb-2ff3-449a-acfb-935d7f0325c4 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 13:04:21.433183 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-99221509-1006-48c4-8082-2ee55fb6641c service neutron] Port ef4f480a-cf21-4d37-9a5f-75aa209da3ce on network 547d6dbb-2ff3-449a-acfb-935d7f0325c4 not bound, no agent of type Open vSwitch agent registered on host hv-cinder-81632 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:103}} Nov 02 13:04:21.433765 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-99221509-1006-48c4-8082-2ee55fb6641c service neutron] Attempting to bind port ef4f480a-cf21-4d37-9a5f-75aa209da3ce on network 547d6dbb-2ff3-449a-acfb-935d7f0325c4 {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:91}} Nov 02 13:04:21.441235 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-99221509-1006-48c4-8082-2ee55fb6641c service neutron] Checking agent: {'id': '0d57fa42-4660-4f08-b7dc-53a872c3c01c', 'agent_type': 'HyperV agent', 'binary': 'neutron-hyperv-agent', 'topic': 'N/A', 'host': 'hv-cinder-81632', 'admin_state_up': True, 'created_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'started_at': datetime.datetime(2021, 11, 2, 12, 47, 3), 'heartbeat_timestamp': datetime.datetime(2021, 11, 2, 13, 4, 3), 'description': None, 'resources_synced': None, 'availability_zone': None, 'alive': True, 'configurations': {'vswitch_mappings': {'physnet1$': 'br-data'}}, 'resource_versions': {}} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:110}} Nov 02 13:04:21.441640 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-99221509-1006-48c4-8082-2ee55fb6641c service neutron] Checking segment: {'id': '990fa8e2-8f5c-4714-aa6e-d15bfa97b992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 889, 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4'} for mappings: {'physnet1$': 'br-data'} with network types: ['local', 'flat', 'vlan'] {{(pid=108543) check_segment_for_agent /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:371}} Nov 02 13:04:21.442155 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.mech_agent [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-99221509-1006-48c4-8082-2ee55fb6641c service neutron] Bound using segment: {'id': '990fa8e2-8f5c-4714-aa6e-d15bfa97b992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 889, 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4'} {{(pid=108543) bind_port /opt/stack/neutron/neutron/plugins/ml2/drivers/mech_agent.py:120}} Nov 02 13:04:21.442710 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.managers [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-99221509-1006-48c4-8082-2ee55fb6641c service neutron] Bound port: ef4f480a-cf21-4d37-9a5f-75aa209da3ce, host: hv-cinder-81632, vif_type: hyperv, vif_details: {"connectivity": "legacy", "port_filter": false}, binding_levels: [{'bound_driver': 'hyperv', 'bound_segment': {'id': '990fa8e2-8f5c-4714-aa6e-d15bfa97b992', 'network_type': 'vlan', 'physical_network': 'physnet1', 'segmentation_id': 889, 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4'}}] {{(pid=108543) _bind_port_level /opt/stack/neutron/neutron/plugins/ml2/managers.py:932}} Nov 02 13:04:21.443120 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-99221509-1006-48c4-8082-2ee55fb6641c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:21.567107 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-99221509-1006-48c4-8082-2ee55fb6641c service neutron] For port ef4f480a-cf21-4d37-9a5f-75aa209da3ce, host hv-cinder-81632, cleared binding levels {{(pid=108543) clear_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:87}} Nov 02 13:04:21.572197 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-99221509-1006-48c4-8082-2ee55fb6641c service neutron] For port ef4f480a-cf21-4d37-9a5f-75aa209da3ce, host hv-cinder-81632, set binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=ef4f480a-cf21-4d37-9a5f-75aa209da3ce,segment=NetworkSegment(990fa8e2-8f5c-4714-aa6e-d15bfa97b992),segment_id=990fa8e2-8f5c-4714-aa6e-d15bfa97b992)] {{(pid=108543) set_binding_levels /opt/stack/neutron/neutron/plugins/ml2/db.py:59}} Nov 02 13:04:21.632360 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-99221509-1006-48c4-8082-2ee55fb6641c service neutron] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:21.694508 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-99221509-1006-48c4-8082-2ee55fb6641c service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:21.695589 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-99221509-1006-48c4-8082-2ee55fb6641c service neutron] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:21.697483 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-99221509-1006-48c4-8082-2ee55fb6641c service neutron] 10.222.0.90 "PUT /v2.0/ports/ef4f480a-cf21-4d37-9a5f-75aa209da3ce HTTP/1.1" status: 200 len: 1093 time: 1.3253071 Nov 02 13:04:21.697969 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '45226cec-a8e5-4f79-b716-f30663a5d352', 'tag': 'ef4f480a-cf21-4d37-9a5f-75aa209da3ce'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 13:04:21.715912 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-2ba1404f-8ff3-4668-9fff-62c67f8d4cd7" -d '{"events": [{"name": "network-changed", "server_uuid": "45226cec-a8e5-4f79-b716-f30663a5d352", "tag": "ef4f480a-cf21-4d37-9a5f-75aa209da3ce"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 13:04:21.767951 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-99221509-1006-48c4-8082-2ee55fb6641c service neutron] Pushing event updated for resources: {'Port': ['ID=ef4f480a-cf21-4d37-9a5f-75aa209da3ce,revision_number=3']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:04:21.787479 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 13:04:21 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-3ebe4c4d-3d83-41e6-bb8f-d87d5f54249a x-openstack-request-id: req-3ebe4c4d-3d83-41e6-bb8f-d87d5f54249a {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 13:04:21.787479 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "45226cec-a8e5-4f79-b716-f30663a5d352", "tag": "ef4f480a-cf21-4d37-9a5f-75aa209da3ce", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 13:04:21.789503 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-3ebe4c4d-3d83-41e6-bb8f-d87d5f54249a {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 13:04:21.789503 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '45226cec-a8e5-4f79-b716-f30663a5d352', 'tag': 'ef4f480a-cf21-4d37-9a5f-75aa209da3ce', 'status': 'completed', 'code': 200} Nov 02 13:04:22.339388 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-293a7583-1647-4c50-afd3-653712564087 req-a6fe212d-d962-44fe-8d31-8d57be3ab85f tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:22.341314 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-293a7583-1647-4c50-afd3-653712564087 req-a6fe212d-d962-44fe-8d31-8d57be3ab85f tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 943 time: 0.1165972 Nov 02 13:04:22.428475 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-293a7583-1647-4c50-afd3-653712564087 req-7b147aa4-112f-4515-a54f-b204ab281a10 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0755591 Nov 02 13:04:23.598323 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0a49a1a1-b3f1-4da8-b3fc-a5cb6a93fc89 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:23.619636 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1777ad36-a773-4e2f-a081-3fae2633d726 req-be96d71c-405e-40fa-8374-694ac27f37d4 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:23.622433 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1777ad36-a773-4e2f-a081-3fae2633d726 req-be96d71c-405e-40fa-8374-694ac27f37d4 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 943 time: 0.0787904 Nov 02 13:04:23.689612 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1777ad36-a773-4e2f-a081-3fae2633d726 req-6d187c12-a84a-49fa-b131-08ab782bc72b tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0567756 Nov 02 13:04:24.872764 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac98a6b8-46a7-4192-bd59-b8795e6ca5bc req-6d11b30d-0c49-4172-a123-294bdeeec89d tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:24.875527 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ac98a6b8-46a7-4192-bd59-b8795e6ca5bc req-6d11b30d-0c49-4172-a123-294bdeeec89d tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 943 time: 0.0680707 Nov 02 13:04:24.956662 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ac98a6b8-46a7-4192-bd59-b8795e6ca5bc req-703f52e2-2214-4a0a-ad38-c5b9c411a905 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0720811 Nov 02 13:04:25.661371 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-a0543107-2b9e-482b-90d4-41e9366920dc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:26.131602 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8b19edcf-04fc-4e9c-8911-7d1c831fb9d7 req-9cf610d2-499d-4f35-ad65-c53c981cb57c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:26.134170 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8b19edcf-04fc-4e9c-8911-7d1c831fb9d7 req-9cf610d2-499d-4f35-ad65-c53c981cb57c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 943 time: 0.0722313 Nov 02 13:04:26.190658 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8b19edcf-04fc-4e9c-8911-7d1c831fb9d7 req-e7e4361e-9c91-4f3d-8377-fe93331516a0 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0504165 Nov 02 13:04:26.900654 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:27.353032 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-9ecda337-26ff-468c-9de9-19888e0bca5d req-9d9cdf04-384f-4240-bff5-364831e51fe9 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:27.354770 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9ecda337-26ff-468c-9de9-19888e0bca5d req-9d9cdf04-384f-4240-bff5-364831e51fe9 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 943 time: 0.0612652 Nov 02 13:04:27.410609 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-9ecda337-26ff-468c-9de9-19888e0bca5d req-7d70a593-9f99-4646-9c2d-322541181091 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0493202 Nov 02 13:04:28.462799 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:28.658219 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-87cedbde-3528-4bb1-887d-c2f931e4b87a req-80986abe-0d6f-447d-8cab-d5662fd5be0c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:28.662068 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-87cedbde-3528-4bb1-887d-c2f931e4b87a req-80986abe-0d6f-447d-8cab-d5662fd5be0c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 943 time: 0.1116734 Nov 02 13:04:28.742495 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-87cedbde-3528-4bb1-887d-c2f931e4b87a req-3517134b-fcf1-404e-9cf5-e17bb2056312 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0709956 Nov 02 13:04:29.939837 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ac648155-3188-47b2-8047-98688642564c req-ddb5d849-52f8-4d48-8fbd-afaa31bf20bb tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:29.944398 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ac648155-3188-47b2-8047-98688642564c req-ddb5d849-52f8-4d48-8fbd-afaa31bf20bb tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 943 time: 0.0848508 Nov 02 13:04:30.020847 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ac648155-3188-47b2-8047-98688642564c req-bd2acdee-771f-4415-ac3e-52250ab8c40f tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0645096 Nov 02 13:04:30.759593 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ba1404f-8ff3-4668-9fff-62c67f8d4cd7 req-d5044a55-1b18-4864-b67c-0902cbcc68d7 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:30.761467 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2ba1404f-8ff3-4668-9fff-62c67f8d4cd7 req-d5044a55-1b18-4864-b67c-0902cbcc68d7 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=36f51757702242e8b1343954aa4f93fe&device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 1096 time: 0.0514131 Nov 02 13:04:30.877791 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:30.889021 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ba1404f-8ff3-4668-9fff-62c67f8d4cd7 req-2ae2fe3f-5fe1-4108-9fda-c1403300ea79 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:30.890514 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2ba1404f-8ff3-4668-9fff-62c67f8d4cd7 req-2ae2fe3f-5fe1-4108-9fda-c1403300ea79 service neutron] 10.222.0.90 "GET /v2.0/networks?tenant_id=36f51757702242e8b1343954aa4f93fe&shared=False HTTP/1.1" status: 200 len: 915 time: 0.1166866 Nov 02 13:04:31.006073 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-2ba1404f-8ff3-4668-9fff-62c67f8d4cd7 req-36956de5-2152-4d31-b789-1365a4455c19 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:31.007693 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-2ba1404f-8ff3-4668-9fff-62c67f8d4cd7 req-36956de5-2152-4d31-b789-1365a4455c19 service neutron] 10.222.0.90 "GET /v2.0/networks?shared=True HTTP/1.1" status: 200 len: 870 time: 0.1095691 Nov 02 13:04:31.117711 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-2e7bfba3-653d-457a-abdb-2dc2dc650dbd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:31.120337 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-2e7bfba3-653d-457a-abdb-2dc2dc650dbd service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=36f51757702242e8b1343954aa4f93fe&device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 1096 time: 0.0616493 Nov 02 13:04:31.192149 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-40e2ff3b-c937-41ab-b263-a28dab7207c3 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ef4f480a-cf21-4d37-9a5f-75aa209da3ce HTTP/1.1" status: 200 len: 217 time: 0.0568335 Nov 02 13:04:31.221707 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-89902c7f-f1a9-4c54-a9fc-53a4ae1c254a req-d53eaea7-7831-4677-9d27-7fb739de22a7 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:31.223954 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-89902c7f-f1a9-4c54-a9fc-53a4ae1c254a req-d53eaea7-7831-4677-9d27-7fb739de22a7 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 943 time: 0.1114421 Nov 02 13:04:31.293520 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-f24830bd-b327-4cb1-ab80-37d21d1ff587 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:31.295072 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-f24830bd-b327-4cb1-ab80-37d21d1ff587 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=424f2c99-da28-4193-b1e7-1cafea9ef4ee HTTP/1.1" status: 200 len: 853 time: 0.0909054 Nov 02 13:04:31.324336 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-89902c7f-f1a9-4c54-a9fc-53a4ae1c254a req-b8d095ef-51fe-4dfb-b999-f2a91d278b73 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0749822 Nov 02 13:04:31.353525 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-5099eceb-9176-4a73-8226-2b536ce811e8 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:31.355050 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-5099eceb-9176-4a73-8226-2b536ce811e8 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=547d6dbb-2ff3-449a-acfb-935d7f0325c4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0477166 Nov 02 13:04:31.458199 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-93f11bab-1f3d-4833-8682-7a6191850db4 service neutron] 10.222.0.90 "GET /v2.0/networks/547d6dbb-2ff3-449a-acfb-935d7f0325c4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0897284 Nov 02 13:04:31.560610 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4cf95a34-6a52-4d70-9917-70e4fa0e5160 req-20df1101-6c21-41b9-9faf-0f72168e4adf service neutron] 10.222.0.90 "GET /v2.0/networks/547d6dbb-2ff3-449a-acfb-935d7f0325c4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0905285 Nov 02 13:04:32.444875 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-449a5315-e43d-446f-b624-448248415398 req-524e875f-3f85-447a-a20c-0746ab8a4faa tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:32.446386 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-449a5315-e43d-446f-b624-448248415398 req-524e875f-3f85-447a-a20c-0746ab8a4faa tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 943 time: 0.0508401 Nov 02 13:04:32.501374 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-449a5315-e43d-446f-b624-448248415398 req-39ac576a-4f92-46cc-a552-059732030bae tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0485992 Nov 02 13:04:33.510817 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:33.629305 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de959a36-66c6-4c01-99eb-93c866241878 req-879ed314-7d1f-4a8c-b0be-8dc19b2efb8c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:33.630941 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-de959a36-66c6-4c01-99eb-93c866241878 req-879ed314-7d1f-4a8c-b0be-8dc19b2efb8c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 943 time: 0.0546093 Nov 02 13:04:33.682069 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-de959a36-66c6-4c01-99eb-93c866241878 req-16fd7bf8-3255-4612-8781-d1fe796b86b6 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0447955 Nov 02 13:04:34.834060 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-de4eacf1-436d-41bf-aae9-e49e08ac74a4 req-55fb2b32-b2a7-47df-9889-e63c0721ee55 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:34.835456 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-de4eacf1-436d-41bf-aae9-e49e08ac74a4 req-55fb2b32-b2a7-47df-9889-e63c0721ee55 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 943 time: 0.0649331 Nov 02 13:04:34.908204 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-de4eacf1-436d-41bf-aae9-e49e08ac74a4 req-cb245614-c5ce-4630-b34f-ef12fb00efb0 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0646968 Nov 02 13:04:35.300092 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device ef4f480a-cf21-4d37-9a5f-75aa209da3ce details requested by agent hyperv_hv-cinder-81632 with host hv-cinder-81632 {{(pid=108544) get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:102}} Nov 02 13:04:35.403105 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port ef4f480a-cf21-4d37-9a5f-75aa209da3ce, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=ef4f480a-cf21-4d37-9a5f-75aa209da3ce,segment=NetworkSegment(990fa8e2-8f5c-4714-aa6e-d15bfa97b992),segment_id=990fa8e2-8f5c-4714-aa6e-d15bfa97b992)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:04:35.414970 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Returning: {'device': 'ef4f480a-cf21-4d37-9a5f-75aa209da3ce', 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4', 'port_id': 'ef4f480a-cf21-4d37-9a5f-75aa209da3ce', 'mac_address': 'fa:16:3e:1a:8f:8f', 'admin_state_up': True, 'network_type': 'vlan', 'segmentation_id': 889, 'physical_network': 'physnet1', 'mtu': 1500, 'fixed_ips': [{'subnet_id': '424f2c99-da28-4193-b1e7-1cafea9ef4ee', 'ip_address': '172.20.0.9'}], 'device_owner': 'compute:nova', 'allowed_address_pairs': [], 'port_security_enabled': True, 'qos_policy_id': None, 'network_qos_policy_id': None, 'profile': {}, 'propagate_uplink_status': False} {{(pid=108544) _get_device_details /opt/stack/neutron/neutron/plugins/ml2/rpc.py:184}} Nov 02 13:04:35.462591 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:35.477966 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Ignoring state change previous_port_status: DOWN current_port_status: BUILD port_id ef4f480a-cf21-4d37-9a5f-75aa209da3ce {{(pid=108544) record_port_status_changed /opt/stack/neutron/neutron/notifiers/nova.py:224}} Nov 02 13:04:35.501160 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port ef4f480a-cf21-4d37-9a5f-75aa209da3ce, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=ef4f480a-cf21-4d37-9a5f-75aa209da3ce,segment=NetworkSegment(990fa8e2-8f5c-4714-aa6e-d15bfa97b992),segment_id=990fa8e2-8f5c-4714-aa6e-d15bfa97b992)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:04:35.580338 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:35.637650 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=ef4f480a-cf21-4d37-9a5f-75aa209da3ce,revision_number=4']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:04:35.861671 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['ef4f480a-cf21-4d37-9a5f-75aa209da3ce'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 13:04:36.040895 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7a8ad31b-5c78-4037-be50-3b482ab07cb9 req-2e75152f-6a63-412f-9db7-07e3052d9280 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:36.042530 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7a8ad31b-5c78-4037-be50-3b482ab07cb9 req-2e75152f-6a63-412f-9db7-07e3052d9280 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 944 time: 0.0606518 Nov 02 13:04:36.102937 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7a8ad31b-5c78-4037-be50-3b482ab07cb9 req-d922f81a-27cd-4235-bba5-b817011e9ee8 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0501668 Nov 02 13:04:37.226763 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-670a8d8b-2cc0-40ed-b44f-5a7fae673ab1 req-06f39b75-1d7f-4081-beec-79b54c9d9a89 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:37.228237 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-670a8d8b-2cc0-40ed-b44f-5a7fae673ab1 req-06f39b75-1d7f-4081-beec-79b54c9d9a89 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 944 time: 0.0507176 Nov 02 13:04:37.276864 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-670a8d8b-2cc0-40ed-b44f-5a7fae673ab1 req-15d947c1-24bb-4d88-8dad-90597dccdccf tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0426629 Nov 02 13:04:37.316301 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device ef4f480a-cf21-4d37-9a5f-75aa209da3ce up at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_up /opt/stack/neutron/neutron/plugins/ml2/rpc.py:296}} Nov 02 13:04:37.471258 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning for port ef4f480a-cf21-4d37-9a5f-75aa209da3ce completed by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:133}} Nov 02 13:04:37.475915 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Provisioning complete for port ef4f480a-cf21-4d37-9a5f-75aa209da3ce triggered by entity L2. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:04:37.476282 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:37.560370 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:37.585273 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '45226cec-a8e5-4f79-b716-f30663a5d352', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ef4f480a-cf21-4d37-9a5f-75aa209da3ce'}] {{(pid=108544) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 13:04:37.587619 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}9e53e1894296d85ff79585f5a14d30c001b8f48e59866ce79fb6ab294ceb0f1d" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-e952a37f-476a-4b02-a8cf-dc6e24d13686" -d '{"events": [{"server_uuid": "45226cec-a8e5-4f79-b716-f30663a5d352", "name": "network-vif-plugged", "status": "completed", "tag": "ef4f480a-cf21-4d37-9a5f-75aa209da3ce"}]}' {{(pid=108544) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 13:04:37.601903 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] For port ef4f480a-cf21-4d37-9a5f-75aa209da3ce, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=ef4f480a-cf21-4d37-9a5f-75aa209da3ce,segment=NetworkSegment(990fa8e2-8f5c-4714-aa6e-d15bfa97b992),segment_id=990fa8e2-8f5c-4714-aa6e-d15bfa97b992)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:04:37.626660 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 13:04:37 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-bf9c1e55-242c-413b-bbf7-d9bfc5ca939c x-openstack-request-id: req-bf9c1e55-242c-413b-bbf7-d9bfc5ca939c {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 13:04:37.626954 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "45226cec-a8e5-4f79-b716-f30663a5d352", "name": "network-vif-plugged", "status": "completed", "tag": "ef4f480a-cf21-4d37-9a5f-75aa209da3ce", "code": 200}]} {{(pid=108544) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 13:04:37.627201 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-bf9c1e55-242c-413b-bbf7-d9bfc5ca939c {{(pid=108544) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 13:04:37.627591 dv-cinder-816324-1-iscsi neutron-server[108544]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '45226cec-a8e5-4f79-b716-f30663a5d352', 'name': 'network-vif-plugged', 'status': 'completed', 'tag': 'ef4f480a-cf21-4d37-9a5f-75aa209da3ce', 'code': 200} Nov 02 13:04:37.666503 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705'] for port, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:37.724651 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Pushing event updated for resources: {'Port': ['ID=ef4f480a-cf21-4d37-9a5f-75aa209da3ce,revision_number=5']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:04:37.988860 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b4befa54-8599-4ee4-8a0f-97a9e4d25d5d req-4e6ae433-1ced-4c14-a1d0-8a260f5bce32 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:37.990296 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b4befa54-8599-4ee4-8a0f-97a9e4d25d5d req-4e6ae433-1ced-4c14-a1d0-8a260f5bce32 service neutron] 10.222.0.90 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 1098 time: 0.0411549 Nov 02 13:04:38.054337 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b4befa54-8599-4ee4-8a0f-97a9e4d25d5d req-4f9ce374-c82b-49f3-84ce-598315d75e9e service neutron] 10.222.0.90 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0512450 Nov 02 13:04:38.402362 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0d1cd029-4351-4f7b-9940-8ad2f6cc7a77 req-05227715-ec2e-4c1b-8856-6fa0be85c311 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:38.404019 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0d1cd029-4351-4f7b-9940-8ad2f6cc7a77 req-05227715-ec2e-4c1b-8856-6fa0be85c311 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 945 time: 0.0558298 Nov 02 13:04:38.462739 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0d1cd029-4351-4f7b-9940-8ad2f6cc7a77 req-288ff497-f121-42e8-9e8b-88207b124140 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0517993 Nov 02 13:04:39.585009 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-568a2c4c-6935-46c5-9e48-7ca12aa4a704 req-3aef41ef-8c4c-4586-86fa-2b52b52823b1 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:39.586551 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-568a2c4c-6935-46c5-9e48-7ca12aa4a704 req-3aef41ef-8c4c-4586-86fa-2b52b52823b1 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 945 time: 0.0501635 Nov 02 13:04:39.640523 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-568a2c4c-6935-46c5-9e48-7ca12aa4a704 req-16516884-78a7-4e64-b9c9-96bb62955294 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0475204 Nov 02 13:04:39.761255 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-26d1fef5-49f5-4eda-a983-92deab8ae912 req-afd0a332-4bb5-4689-b1a0-051ac0963d0b tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:39.762720 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-26d1fef5-49f5-4eda-a983-92deab8ae912 req-afd0a332-4bb5-4689-b1a0-051ac0963d0b tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 945 time: 0.0536788 Nov 02 13:04:39.814229 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-26d1fef5-49f5-4eda-a983-92deab8ae912 req-71930179-fa27-4e87-84e7-d8305baeb3cd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452969 Nov 02 13:04:40.149929 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-7661da52-3ee6-4615-a17b-d3b3c71ee173 req-a348cdf4-e741-429a-94c0-2736015453f2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:40.151477 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7661da52-3ee6-4615-a17b-d3b3c71ee173 req-a348cdf4-e741-429a-94c0-2736015453f2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 945 time: 0.0608680 Nov 02 13:04:40.203695 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-7661da52-3ee6-4615-a17b-d3b3c71ee173 req-28c46284-1ede-4dc1-9e28-1acc3fe32455 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0452957 Nov 02 13:04:47.470630 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 13:04:50.919795 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a0bfb0a0-ee88-493f-a86b-553f54fc2180 req-293d4abb-465d-457e-a114-6f653bb3bcdc tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:50.922218 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a0bfb0a0-ee88-493f-a86b-553f54fc2180 req-293d4abb-465d-457e-a114-6f653bb3bcdc tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 945 time: 0.0673568 Nov 02 13:04:50.989410 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a0bfb0a0-ee88-493f-a86b-553f54fc2180 req-6c8d27ac-fdf9-4435-9828-17c69e85bc17 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0567844 Nov 02 13:04:51.020019 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 37258) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:04:51.125464 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [None req-891b74b1-6a87-4165-a20f-724e736ac800 tempest-TestMinimumBasicScenario-1014452096 tempest-TestMinimumBasicScenario-1014452096-project-admin] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108542) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:51.127052 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-891b74b1-6a87-4165-a20f-724e736ac800 tempest-TestMinimumBasicScenario-1014452096 tempest-TestMinimumBasicScenario-1014452096-project-admin] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 1093 time: 0.1059012 Nov 02 13:04:51.131867 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 37262) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:04:51.136621 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.v2.base [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Request body: {'floatingip': {'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'port_id': 'ef4f480a-cf21-4d37-9a5f-75aa209da3ce', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'fixed_ip_address': '172.20.0.9'}} {{(pid=108542) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 13:04:51.242749 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for floatingip, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:51.359928 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:51.498562 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.db_base_plugin_common [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Allocated IP 172.27.0.3 (43464fa8-eb00-46fb-9ca0-be7342f9ddbf/44a807bc-f2b6-41f0-b765-e5d3393fe305/acb40146-eab9-4ba9-9ef5-89d30d15890c) {{(pid=108542) _store_ip_allocation /opt/stack/neutron/neutron/db/db_base_plugin_common.py:131}} Nov 02 13:04:51.627541 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for port, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:51.734682 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_new_port-8738449414669', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:51.776602 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.dhcp_agent_scheduler [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Network 43464fa8-eb00-46fb-9ca0-be7342f9ddbf is already hosted by enough agents. {{(pid=108542) _get_dhcp_agents_hosting_network /opt/stack/neutron/neutron/scheduler/dhcp_agent_scheduler.py:275}} Nov 02 13:04:51.782845 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.base_scheduler [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Resources bound (agent type, host, resource id): {{(pid=108542) schedule /opt/stack/neutron/neutron/scheduler/base_scheduler.py:57}} Nov 02 13:04:51.788723 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Received port after_create {{(pid=108542) _notify_l3_agent_new_port /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:535}} Nov 02 13:04:51.795763 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Pushing event updated for resources: {'Port': ['ID=acb40146-eab9-4ba9-9ef5-89d30d15890c,revision_number=1']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:04:51.828532 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:04:51.829048 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:04:51.829269 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:04:51.829544 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:04:51.829886 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:04:51.830222 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:04:51.830582 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:04:51.830924 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:04:51.831282 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:04:51.831618 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:04:51.831945 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:04:51.832267 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:04:52.282599 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for floatingip, precommit_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:52.449349 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:52.614189 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for port, precommit_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:52.724056 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126476609'] for port, after_update {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:52.796065 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Pushing event updated for resources: {'Port': ['ID=acb40146-eab9-4ba9-9ef5-89d30d15890c,revision_number=2']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:04:52.814880 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._create_dvr_floating_gw_port-1594992'] for floatingip, after_create {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:52.924215 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.db.l3_db [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Floating IP 2e959346-0fbc-4e31-8bc5-6603d7de066b associated. External IP: 172.27.0.3, port: ef4f480a-cf21-4d37-9a5f-75aa209da3ce. Nov 02 13:04:53.455733 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Router 8f644798-f842-47ae-90c4-f5e349fed2fb has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108542) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 13:04:53.505688 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-75ebac0d-6e36-41db-abd1-3482c74909a6 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:53.573026 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108542) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 13:04:53.584084 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd0a4e91-6f65-43d1-99ae-ac2e2caf1fba None None] Sync routers for ids ['8f644798-f842-47ae-90c4-f5e349fed2fb'] in dv-cinder-816324-1-iscsi {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 13:04:53.594224 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd0a4e91-6f65-43d1-99ae-ac2e2caf1fba None None] Routers {'8f644798-f842-47ae-90c4-f5e349fed2fb'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:04:53.594869 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-fd0a4e91-6f65-43d1-99ae-ac2e2caf1fba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:04:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['8f644798-f842-47ae-90c4-f5e349fed2fb'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:04:53.657157 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for floatingip, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:53.686939 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-4d2bef38-f78b-4e8f-99b5-ad5a34762acd tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "POST /v2.0/floatingips HTTP/1.1" status: 201 len: 994 time: 2.5537567 Nov 02 13:04:53.687597 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '45226cec-a8e5-4f79-b716-f30663a5d352', 'tag': 'ef4f480a-cf21-4d37-9a5f-75aa209da3ce'}] {{(pid=108542) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 13:04:53.689922 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 37264) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:04:53.690521 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}8fdc2194739644bb754d6b187539f80d2eba7dc5c5d5392f1a2d22d03c0a316c" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-8098ede4-82c4-452b-b7f4-3ff2ddf1eb23" -d '{"events": [{"name": "network-changed", "server_uuid": "45226cec-a8e5-4f79-b716-f30663a5d352", "tag": "ef4f480a-cf21-4d37-9a5f-75aa209da3ce"}]}' {{(pid=108542) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 13:04:53.708263 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-5db3c87a-d277-4e1a-ac21-0fa319dd7f2c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Request body: {'security_group': {'name': 'tempest-secgroup-smoke-251103679', 'description': 'tempest-secgroup-smoke-251103679 description', 'project_id': '36f51757702242e8b1343954aa4f93fe'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 13:04:53.716458 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-fd0a4e91-6f65-43d1-99ae-ac2e2caf1fba None None] Set router 8f644798-f842-47ae-90c4-f5e349fed2fb gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:04:53.745273 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 13:04:53 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-a54c4eff-c3b8-4b8a-a978-c982a76db493 x-openstack-request-id: req-a54c4eff-c3b8-4b8a-a978-c982a76db493 {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 13:04:53.745553 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "45226cec-a8e5-4f79-b716-f30663a5d352", "tag": "ef4f480a-cf21-4d37-9a5f-75aa209da3ce", "status": "completed", "code": 200}]} {{(pid=108542) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 13:04:53.745833 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-a54c4eff-c3b8-4b8a-a978-c982a76db493 {{(pid=108542) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 13:04:53.746232 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '45226cec-a8e5-4f79-b716-f30663a5d352', 'tag': 'ef4f480a-cf21-4d37-9a5f-75aa209da3ce', 'status': 'completed', 'code': 200} Nov 02 13:04:53.786180 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-5db3c87a-d277-4e1a-ac21-0fa319dd7f2c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for security_group, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:53.840079 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8098ede4-82c4-452b-b7f4-3ff2ddf1eb23 req-1063f908-0bc1-47e7-9096-f32c21f31c31 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:53.841572 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8098ede4-82c4-452b-b7f4-3ff2ddf1eb23 req-1063f908-0bc1-47e7-9096-f32c21f31c31 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=36f51757702242e8b1343954aa4f93fe&device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 1098 time: 0.0679440 Nov 02 13:04:53.946858 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-5db3c87a-d277-4e1a-ac21-0fa319dd7f2c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for security_group, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:53.966275 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-fd0a4e91-6f65-43d1-99ae-ac2e2caf1fba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'name': 'tempest-TestMinimumBasicScenario-539319503-router', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:03:48Z', 'revision_number': 4, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'gw_port': {'id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:95:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:03:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': '2e959346-0fbc-4e31-8bc5-6603d7de066b', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'floating_ip_address': '172.27.0.3', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'port_id': 'ef4f480a-cf21-4d37-9a5f-75aa209da3ce', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 693, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4', 'mac_address': 'fa:16:3e:1a:8f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '45226cec-a8e5-4f79-b716-f30663a5d352', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T13:04:52Z', 'updated_at': '2021-11-02T13:04:52Z', 'revision_number': 0, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9fd131ff-7577-434d-808c-a8686762bec8', 'name': '', 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'mac_address': 'fa:16:3e:5e:18:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '424f2c99-da28-4193-b1e7-1cafea9ef4ee', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:47Z', 'updated_at': '2021-11-02T13:03:53Z', 'revision_number': 5, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'subnets': [{'id': '424f2c99-da28-4193-b1e7-1cafea9ef4ee', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:04:53.970163 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8098ede4-82c4-452b-b7f4-3ff2ddf1eb23 req-debe4951-f0b4-45e6-9c04-d0470e41438b service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:53.971831 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8098ede4-82c4-452b-b7f4-3ff2ddf1eb23 req-debe4951-f0b4-45e6-9c04-d0470e41438b service neutron] 10.222.0.90 "GET /v2.0/networks?id=547d6dbb-2ff3-449a-acfb-935d7f0325c4 HTTP/1.1" status: 200 len: 915 time: 0.1200800 Nov 02 13:04:53.997989 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd0a4e91-6f65-43d1-99ae-ac2e2caf1fba None None] Checking router: 8f644798-f842-47ae-90c4-f5e349fed2fb for host: dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 13:04:54.008455 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-fd0a4e91-6f65-43d1-99ae-ac2e2caf1fba None None] Routers {'8f644798-f842-47ae-90c4-f5e349fed2fb'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:04:54.009163 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-fd0a4e91-6f65-43d1-99ae-ac2e2caf1fba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 0, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:04:26Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['8f644798-f842-47ae-90c4-f5e349fed2fb'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:04:54.015668 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-5db3c87a-d277-4e1a-ac21-0fa319dd7f2c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:54.064901 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-5db3c87a-d277-4e1a-ac21-0fa319dd7f2c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Pushing event updated for resources: {'SecurityGroup': ['ID=d903c15b-eb65-4948-b101-c642f2182891,revision_number=1']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:04:54.073559 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8098ede4-82c4-452b-b7f4-3ff2ddf1eb23 req-9ad349cc-aade-4635-9a00-83d68c55bd2a service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ef4f480a-cf21-4d37-9a5f-75aa209da3ce HTTP/1.1" status: 200 len: 997 time: 0.0948231 Nov 02 13:04:54.078424 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5db3c87a-d277-4e1a-ac21-0fa319dd7f2c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:04:54.078774 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5db3c87a-d277-4e1a-ac21-0fa319dd7f2c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:04:54.079112 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5db3c87a-d277-4e1a-ac21-0fa319dd7f2c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:04:54.079446 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5db3c87a-d277-4e1a-ac21-0fa319dd7f2c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:04:54.079776 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5db3c87a-d277-4e1a-ac21-0fa319dd7f2c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:04:54.080112 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5db3c87a-d277-4e1a-ac21-0fa319dd7f2c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:04:54.080436 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5db3c87a-d277-4e1a-ac21-0fa319dd7f2c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:04:54.080797 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5db3c87a-d277-4e1a-ac21-0fa319dd7f2c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:04:54.081150 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5db3c87a-d277-4e1a-ac21-0fa319dd7f2c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:04:54.081507 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5db3c87a-d277-4e1a-ac21-0fa319dd7f2c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:04:54.081828 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5db3c87a-d277-4e1a-ac21-0fa319dd7f2c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:04:54.082147 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-5db3c87a-d277-4e1a-ac21-0fa319dd7f2c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:04:54.118715 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-5db3c87a-d277-4e1a-ac21-0fa319dd7f2c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:54.119868 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-5db3c87a-d277-4e1a-ac21-0fa319dd7f2c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "POST /v2.0/security-groups HTTP/1.1" status: 201 len: 1809 time: 0.4279604 Nov 02 13:04:54.123115 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 37268) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:04:54.128375 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-33f52b2d-1842-4112-b5cd-d4c045e65aff tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Request body: {'security_group_rule': {'security_group_id': 'd903c15b-eb65-4948-b101-c642f2182891', 'project_id': '36f51757702242e8b1343954aa4f93fe', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'ingress'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 13:04:54.136711 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-fd0a4e91-6f65-43d1-99ae-ac2e2caf1fba None None] Set router 8f644798-f842-47ae-90c4-f5e349fed2fb gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:04:54.155258 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8098ede4-82c4-452b-b7f4-3ff2ddf1eb23 req-cb971a1d-b99f-4d33-ae59-4bdc6e6eed8e service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:54.156715 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8098ede4-82c4-452b-b7f4-3ff2ddf1eb23 req-cb971a1d-b99f-4d33-ae59-4bdc6e6eed8e service neutron] 10.222.0.90 "GET /v2.0/subnets?id=424f2c99-da28-4193-b1e7-1cafea9ef4ee HTTP/1.1" status: 200 len: 853 time: 0.0704129 Nov 02 13:04:54.220508 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-8098ede4-82c4-452b-b7f4-3ff2ddf1eb23 req-96395e7e-ec6c-4576-9f17-0b9b50aae190 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:54.222516 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8098ede4-82c4-452b-b7f4-3ff2ddf1eb23 req-96395e7e-ec6c-4576-9f17-0b9b50aae190 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=547d6dbb-2ff3-449a-acfb-935d7f0325c4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0577757 Nov 02 13:04:54.238935 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-33f52b2d-1842-4112-b5cd-d4c045e65aff tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:54.356458 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-33f52b2d-1842-4112-b5cd-d4c045e65aff tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:54.359156 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8098ede4-82c4-452b-b7f4-3ff2ddf1eb23 req-1a8d0992-604a-4ec0-94e8-16e9725618f4 service neutron] 10.222.0.90 "GET /v2.0/networks/547d6dbb-2ff3-449a-acfb-935d7f0325c4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1296320 Nov 02 13:04:54.393495 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-fd0a4e91-6f65-43d1-99ae-ac2e2caf1fba None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'name': 'tempest-TestMinimumBasicScenario-539319503-router', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:03:48Z', 'revision_number': 4, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'gw_port': {'id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:95:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:03:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': '2e959346-0fbc-4e31-8bc5-6603d7de066b', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'floating_ip_address': '172.27.0.3', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'port_id': 'ef4f480a-cf21-4d37-9a5f-75aa209da3ce', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 693, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4', 'mac_address': 'fa:16:3e:1a:8f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '45226cec-a8e5-4f79-b716-f30663a5d352', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T13:04:52Z', 'updated_at': '2021-11-02T13:04:52Z', 'revision_number': 0, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9fd131ff-7577-434d-808c-a8686762bec8', 'name': '', 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'mac_address': 'fa:16:3e:5e:18:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '424f2c99-da28-4193-b1e7-1cafea9ef4ee', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:47Z', 'updated_at': '2021-11-02T13:03:53Z', 'revision_number': 5, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'subnets': [{'id': '424f2c99-da28-4193-b1e7-1cafea9ef4ee', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:04:54.421855 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-33f52b2d-1842-4112-b5cd-d4c045e65aff tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:54.433839 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-fd0a4e91-6f65-43d1-99ae-ac2e2caf1fba None None] The sync data for ids ['8f644798-f842-47ae-90c4-f5e349fed2fb'] in dv-cinder-816324-1-iscsi is: [{'id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'name': 'tempest-TestMinimumBasicScenario-539319503-router', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:03:48Z', 'revision_number': 4, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'gw_port': {'id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:95:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:03:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_floatingips': [{'id': '2e959346-0fbc-4e31-8bc5-6603d7de066b', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'floating_ip_address': '172.27.0.3', 'floating_network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'router_id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'port_id': 'ef4f480a-cf21-4d37-9a5f-75aa209da3ce', 'fixed_ip_address': '172.20.0.9', 'status': 'DOWN', 'standard_attr_id': 693, 'description': '', 'qos_policy_id': None, 'port_details': {'name': '', 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4', 'mac_address': 'fa:16:3e:1a:8f:8f', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '45226cec-a8e5-4f79-b716-f30663a5d352', 'device_owner': 'compute:nova'}, 'dns_domain': '', 'dns_name': '', 'tags': [], 'created_at': '2021-11-02T13:04:52Z', 'updated_at': '2021-11-02T13:04:52Z', 'revision_number': 0, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'fixed_ip_address_scope': None}], '_interfaces': [{'id': '9fd131ff-7577-434d-808c-a8686762bec8', 'name': '', 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'mac_address': 'fa:16:3e:5e:18:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '424f2c99-da28-4193-b1e7-1cafea9ef4ee', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:47Z', 'updated_at': '2021-11-02T13:03:53Z', 'revision_number': 5, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'subnets': [{'id': '424f2c99-da28-4193-b1e7-1cafea9ef4ee', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 13:04:54.461971 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-33f52b2d-1842-4112-b5cd-d4c045e65aff tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=2f7319e9-37a2-4767-af65-dbcb1a29ea57,revision_number=0']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:04:54.481801 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-8098ede4-82c4-452b-b7f4-3ff2ddf1eb23 req-cf5d506d-8aca-45ab-a939-1e0a5081f270 service neutron] 10.222.0.90 "GET /v2.0/networks/547d6dbb-2ff3-449a-acfb-935d7f0325c4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1150813 Nov 02 13:04:54.520869 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-33f52b2d-1842-4112-b5cd-d4c045e65aff tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:54.523165 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-33f52b2d-1842-4112-b5cd-d4c045e65aff tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 764 time: 0.3985159 Nov 02 13:04:54.526083 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 37270) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:04:54.533909 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-57c53c69-f972-48f6-b3ed-00f024f43ca2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Request body: {'security_group_rule': {'security_group_id': 'd903c15b-eb65-4948-b101-c642f2182891', 'project_id': '36f51757702242e8b1343954aa4f93fe', 'protocol': 'tcp', 'port_range_min': 22, 'port_range_max': 22, 'direction': 'egress'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 13:04:54.661850 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-57c53c69-f972-48f6-b3ed-00f024f43ca2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:54.702585 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-b4331ab4-e78a-4cdd-b0e5-334ec22e0bd6 None None] New status for floating IP 2e959346-0fbc-4e31-8bc5-6603d7de066b: ACTIVE {{(pid=108545) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 02 13:04:54.752555 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-57c53c69-f972-48f6-b3ed-00f024f43ca2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:54.825142 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-57c53c69-f972-48f6-b3ed-00f024f43ca2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:54.844028 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-57c53c69-f972-48f6-b3ed-00f024f43ca2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=f974708f-892a-49f1-b027-1c74a8b67379,revision_number=0']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:04:54.913943 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-57c53c69-f972-48f6-b3ed-00f024f43ca2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:54.915220 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-57c53c69-f972-48f6-b3ed-00f024f43ca2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 763 time: 0.3878000 Nov 02 13:04:54.918020 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 37272) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:04:54.922550 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-129fcef9-de85-4df4-b135-1af421176c8c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Request body: {'security_group_rule': {'security_group_id': 'd903c15b-eb65-4948-b101-c642f2182891', 'project_id': '36f51757702242e8b1343954aa4f93fe', 'protocol': 'icmp', 'direction': 'ingress'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 13:04:55.030850 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-129fcef9-de85-4df4-b135-1af421176c8c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:55.097521 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-129fcef9-de85-4df4-b135-1af421176c8c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:55.174199 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-129fcef9-de85-4df4-b135-1af421176c8c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:55.195250 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-129fcef9-de85-4df4-b135-1af421176c8c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=b08f1aed-655b-4439-a35a-bfab047ca6ac,revision_number=0']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:04:55.272447 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-129fcef9-de85-4df4-b135-1af421176c8c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:55.273590 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-129fcef9-de85-4df4-b135-1af421176c8c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 769 time: 0.3545263 Nov 02 13:04:55.276612 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 37274) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:04:55.281545 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-314e3355-5d19-4892-a9cc-fc7c5bc7745c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Request body: {'security_group_rule': {'security_group_id': 'd903c15b-eb65-4948-b101-c642f2182891', 'project_id': '36f51757702242e8b1343954aa4f93fe', 'protocol': 'icmp', 'direction': 'egress'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 13:04:55.373323 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-314e3355-5d19-4892-a9cc-fc7c5bc7745c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:55.442855 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-314e3355-5d19-4892-a9cc-fc7c5bc7745c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:55.528487 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-314e3355-5d19-4892-a9cc-fc7c5bc7745c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:55.549609 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-314e3355-5d19-4892-a9cc-fc7c5bc7745c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=c3950d84-08a1-4da0-b077-7c88300c05f6,revision_number=0']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:04:55.655992 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-314e3355-5d19-4892-a9cc-fc7c5bc7745c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:55.657312 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-314e3355-5d19-4892-a9cc-fc7c5bc7745c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 768 time: 0.3794088 Nov 02 13:04:55.661926 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 37276) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:04:55.666578 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-548be072-2949-4bef-804c-4afb97aaef51 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Request body: {'security_group_rule': {'security_group_id': 'd903c15b-eb65-4948-b101-c642f2182891', 'project_id': '36f51757702242e8b1343954aa4f93fe', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'ingress'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 13:04:55.683113 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-697ecfd7-5981-4f43-aefc-a6c3ab788b68 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:55.768420 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.db.securitygroups_db [None req-548be072-2949-4bef-804c-4afb97aaef51 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Project 36f51757702242e8b1343954aa4f93fe added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 02 13:04:55.775337 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-548be072-2949-4bef-804c-4afb97aaef51 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:55.846483 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-548be072-2949-4bef-804c-4afb97aaef51 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:55.905058 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-548be072-2949-4bef-804c-4afb97aaef51 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:55.926179 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-548be072-2949-4bef-804c-4afb97aaef51 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=eb7b2ca9-7ac1-435e-ae96-ea5f66c26d2a,revision_number=0']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:04:55.981260 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-548be072-2949-4bef-804c-4afb97aaef51 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:55.983199 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-548be072-2949-4bef-804c-4afb97aaef51 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 774 time: 0.3195906 Nov 02 13:04:55.986806 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 37278) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:04:55.995819 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [None req-aca92dd0-4084-4b34-b08a-1e304faeaf0a tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Request body: {'security_group_rule': {'security_group_id': 'd903c15b-eb65-4948-b101-c642f2182891', 'project_id': '36f51757702242e8b1343954aa4f93fe', 'protocol': 'icmp', 'ethertype': 'IPv6', 'direction': 'egress'}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 13:04:56.071483 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.db.securitygroups_db [None req-aca92dd0-4084-4b34-b08a-1e304faeaf0a tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Project 36f51757702242e8b1343954aa4f93fe added a security group rule with legacy IPv6 ICMP protocol name icmp, ipv6-icmp should be used instead. It was automatically converted. Nov 02 13:04:56.080008 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-aca92dd0-4084-4b34-b08a-1e304faeaf0a tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for security_group_rule, before_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:56.152922 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-aca92dd0-4084-4b34-b08a-1e304faeaf0a tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for security_group_rule, precommit_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:56.225386 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-aca92dd0-4084-4b34-b08a-1e304faeaf0a tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062395'] for security_group_rule, after_create {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:56.249202 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-aca92dd0-4084-4b34-b08a-1e304faeaf0a tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Pushing event updated for resources: {'SecurityGroupRule': ['ID=8b11466e-55dd-4cd2-b1d6-bb068fbe95eb,revision_number=0']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:04:56.355915 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-aca92dd0-4084-4b34-b08a-1e304faeaf0a tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for security_group_rule, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:56.357474 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-aca92dd0-4084-4b34-b08a-1e304faeaf0a tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "POST /v2.0/security-group-rules HTTP/1.1" status: 201 len: 773 time: 0.3684528 Nov 02 13:04:56.510564 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-17611ab5-f3ba-4c19-a9ed-ca9a47c18618 req-452946fb-3baf-4ec0-9b90-fec2af9f7269 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-251103679&fields=id&tenant_id=36f51757702242e8b1343954aa4f93fe HTTP/1.1" status: 200 len: 267 time: 0.1069925 Nov 02 13:04:56.572304 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17611ab5-f3ba-4c19-a9ed-ca9a47c18618 req-28ed7a5d-d9b0-4cfd-b4e4-9e23fe5c0445 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:56.573940 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-17611ab5-f3ba-4c19-a9ed-ca9a47c18618 req-28ed7a5d-d9b0-4cfd-b4e4-9e23fe5c0445 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 945 time: 0.0567737 Nov 02 13:04:56.588219 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-17611ab5-f3ba-4c19-a9ed-ca9a47c18618 req-414a604d-f860-48e9-afa7-dcd244cb0045 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Request body: {'port': {'security_groups': ['6433fe5c-a062-47c1-827b-d94e9e3b8866', 'd903c15b-eb65-4948-b101-c642f2182891']}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 13:04:56.923361 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:56.942803 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-17611ab5-f3ba-4c19-a9ed-ca9a47c18618 req-414a604d-f860-48e9-afa7-dcd244cb0045 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:57.174947 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-17611ab5-f3ba-4c19-a9ed-ca9a47c18618 req-414a604d-f860-48e9-afa7-dcd244cb0045 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] For port ef4f480a-cf21-4d37-9a5f-75aa209da3ce, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=ef4f480a-cf21-4d37-9a5f-75aa209da3ce,segment=NetworkSegment(990fa8e2-8f5c-4714-aa6e-d15bfa97b992),segment_id=990fa8e2-8f5c-4714-aa6e-d15bfa97b992)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:04:57.208392 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-17611ab5-f3ba-4c19-a9ed-ca9a47c18618 req-414a604d-f860-48e9-afa7-dcd244cb0045 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for port, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:57.282645 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-17611ab5-f3ba-4c19-a9ed-ca9a47c18618 req-414a604d-f860-48e9-afa7-dcd244cb0045 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:57.296032 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['ef4f480a-cf21-4d37-9a5f-75aa209da3ce'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 13:04:57.328125 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-17611ab5-f3ba-4c19-a9ed-ca9a47c18618 req-414a604d-f860-48e9-afa7-dcd244cb0045 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:57.328633 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-17611ab5-f3ba-4c19-a9ed-ca9a47c18618 req-414a604d-f860-48e9-afa7-dcd244cb0045 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:57.330061 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-17611ab5-f3ba-4c19-a9ed-ca9a47c18618 req-414a604d-f860-48e9-afa7-dcd244cb0045 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "PUT /v2.0/ports/ef4f480a-cf21-4d37-9a5f-75aa209da3ce HTTP/1.1" status: 200 len: 981 time: 0.7467749 Nov 02 13:04:57.330564 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '45226cec-a8e5-4f79-b716-f30663a5d352', 'tag': 'ef4f480a-cf21-4d37-9a5f-75aa209da3ce'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 13:04:57.334601 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-a6bfb625-0d53-4ac1-9917-cb5e3c35240c" -d '{"events": [{"name": "network-changed", "server_uuid": "45226cec-a8e5-4f79-b716-f30663a5d352", "tag": "ef4f480a-cf21-4d37-9a5f-75aa209da3ce"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 13:04:57.369836 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-414a604d-f860-48e9-afa7-dcd244cb0045 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Pushing event updated for resources: {'Port': ['ID=ef4f480a-cf21-4d37-9a5f-75aa209da3ce,revision_number=6']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:04:57.404677 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['ef4f480a-cf21-4d37-9a5f-75aa209da3ce'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 13:04:57.416130 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 13:04:57 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-4167ff07-a132-483a-b6ad-8242be52389b x-openstack-request-id: req-4167ff07-a132-483a-b6ad-8242be52389b {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 13:04:57.424304 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "45226cec-a8e5-4f79-b716-f30663a5d352", "tag": "ef4f480a-cf21-4d37-9a5f-75aa209da3ce", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 13:04:57.424304 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-4167ff07-a132-483a-b6ad-8242be52389b {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 13:04:57.424304 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '45226cec-a8e5-4f79-b716-f30663a5d352', 'tag': 'ef4f480a-cf21-4d37-9a5f-75aa209da3ce', 'status': 'completed', 'code': 200} Nov 02 13:04:57.518410 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0cb9c70b-8741-45c0-ada4-bfaf60eefe6e req-df609547-3756-45c1-b894-41a534c749e7 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:57.520974 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0cb9c70b-8741-45c0-ada4-bfaf60eefe6e req-df609547-3756-45c1-b894-41a534c749e7 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 984 time: 0.0981748 Nov 02 13:04:57.530435 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6bfb625-0d53-4ac1-9917-cb5e3c35240c req-dfa9c318-3df2-492e-906c-da48844c6c79 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:57.532100 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a6bfb625-0d53-4ac1-9917-cb5e3c35240c req-dfa9c318-3df2-492e-906c-da48844c6c79 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=36f51757702242e8b1343954aa4f93fe&device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 1137 time: 0.0950711 Nov 02 13:04:57.668364 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0cb9c70b-8741-45c0-ada4-bfaf60eefe6e req-6ba68a48-2b70-4717-8dda-1aaa4051c85a tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&id=d903c15b-eb65-4948-b101-c642f2182891&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.1351864 Nov 02 13:04:57.695825 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6bfb625-0d53-4ac1-9917-cb5e3c35240c req-7b8d79df-93fa-477a-8f10-162f790a07a9 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:57.698074 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a6bfb625-0d53-4ac1-9917-cb5e3c35240c req-7b8d79df-93fa-477a-8f10-162f790a07a9 service neutron] 10.222.0.90 "GET /v2.0/networks?id=547d6dbb-2ff3-449a-acfb-935d7f0325c4 HTTP/1.1" status: 200 len: 915 time: 0.1557624 Nov 02 13:04:57.720117 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-09172394-8919-4f12-bc29-6cf394dd50cb None None] Provisioning complete for port ef4f480a-cf21-4d37-9a5f-75aa209da3ce triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:04:57.720660 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-09172394-8919-4f12-bc29-6cf394dd50cb None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:04:57.781143 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a6bfb625-0d53-4ac1-9917-cb5e3c35240c req-61fa17b2-2743-4a48-822f-684b3942692e service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ef4f480a-cf21-4d37-9a5f-75aa209da3ce HTTP/1.1" status: 200 len: 999 time: 0.0692296 Nov 02 13:04:57.836667 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6bfb625-0d53-4ac1-9917-cb5e3c35240c req-25d9186c-97aa-4759-9613-7a1c0fa51c74 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:57.838145 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a6bfb625-0d53-4ac1-9917-cb5e3c35240c req-25d9186c-97aa-4759-9613-7a1c0fa51c74 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=424f2c99-da28-4193-b1e7-1cafea9ef4ee HTTP/1.1" status: 200 len: 853 time: 0.0500524 Nov 02 13:04:57.901242 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-a6bfb625-0d53-4ac1-9917-cb5e3c35240c req-e7b27534-ebff-4efb-ab29-494dd7622460 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:04:57.902828 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a6bfb625-0d53-4ac1-9917-cb5e3c35240c req-e7b27534-ebff-4efb-ab29-494dd7622460 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=547d6dbb-2ff3-449a-acfb-935d7f0325c4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0544686 Nov 02 13:04:58.008858 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a6bfb625-0d53-4ac1-9917-cb5e3c35240c req-7ffc3d4b-992f-4843-a78d-80844f25c199 service neutron] 10.222.0.90 "GET /v2.0/networks/547d6dbb-2ff3-449a-acfb-935d7f0325c4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0960553 Nov 02 13:04:58.125260 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-a6bfb625-0d53-4ac1-9917-cb5e3c35240c req-e2a949d1-69df-44bb-a95f-f2950440ecc7 service neutron] 10.222.0.90 "GET /v2.0/networks/547d6dbb-2ff3-449a-acfb-935d7f0325c4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1073880 Nov 02 13:04:58.408283 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:05:00.847953 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:05:03.510852 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:05:15.036128 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-701f0550-9753-47dc-8628-46465456733c req-1678b5d3-7293-4cfd-a94b-86f2eba77757 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:05:15.037693 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-701f0550-9753-47dc-8628-46465456733c req-1678b5d3-7293-4cfd-a94b-86f2eba77757 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 984 time: 0.0544617 Nov 02 13:05:15.102866 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-701f0550-9753-47dc-8628-46465456733c req-a349ec71-0c29-40e8-ba29-af4923d74fb1 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&id=d903c15b-eb65-4948-b101-c642f2182891&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0589802 Nov 02 13:05:15.200752 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80ae44af-4ce9-4724-b055-dc2460aa11da req-7ed0d39e-b3e4-47b6-a4bf-eb6993abdd66 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:05:15.202164 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-80ae44af-4ce9-4724-b055-dc2460aa11da req-7ed0d39e-b3e4-47b6-a4bf-eb6993abdd66 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=36f51757702242e8b1343954aa4f93fe&device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 1137 time: 0.0982907 Nov 02 13:05:15.314506 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80ae44af-4ce9-4724-b055-dc2460aa11da req-65469a7a-04fb-483d-b0dd-ea557d0fae00 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:05:15.316053 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-80ae44af-4ce9-4724-b055-dc2460aa11da req-65469a7a-04fb-483d-b0dd-ea557d0fae00 service neutron] 10.222.0.90 "GET /v2.0/networks?id=547d6dbb-2ff3-449a-acfb-935d7f0325c4 HTTP/1.1" status: 200 len: 915 time: 0.1044400 Nov 02 13:05:15.396615 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-80ae44af-4ce9-4724-b055-dc2460aa11da req-dbabcbc6-9ec3-4577-a81b-05bcecfc7ede service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ef4f480a-cf21-4d37-9a5f-75aa209da3ce HTTP/1.1" status: 200 len: 999 time: 0.0727606 Nov 02 13:05:15.452140 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80ae44af-4ce9-4724-b055-dc2460aa11da req-54475f64-debc-4b57-aad0-8a1aa9911d14 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:05:15.453515 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-80ae44af-4ce9-4724-b055-dc2460aa11da req-54475f64-debc-4b57-aad0-8a1aa9911d14 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=424f2c99-da28-4193-b1e7-1cafea9ef4ee HTTP/1.1" status: 200 len: 853 time: 0.0463400 Nov 02 13:05:15.503349 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-80ae44af-4ce9-4724-b055-dc2460aa11da req-e3f24211-e441-4bde-aa03-b54d42c4d838 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:05:15.504870 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-80ae44af-4ce9-4724-b055-dc2460aa11da req-e3f24211-e441-4bde-aa03-b54d42c4d838 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=547d6dbb-2ff3-449a-acfb-935d7f0325c4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0437834 Nov 02 13:05:15.606984 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-80ae44af-4ce9-4724-b055-dc2460aa11da req-e1698eec-9525-4227-ae72-15bc6e615527 service neutron] 10.222.0.90 "GET /v2.0/networks/547d6dbb-2ff3-449a-acfb-935d7f0325c4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0940998 Nov 02 13:05:15.721138 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-80ae44af-4ce9-4724-b055-dc2460aa11da req-e2916956-cbfc-46d5-b221-25f25be8b031 service neutron] 10.222.0.90 "GET /v2.0/networks/547d6dbb-2ff3-449a-acfb-935d7f0325c4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1034791 Nov 02 13:05:16.229279 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5dd6ea0-8a25-4952-9112-4d0f4e30064d req-6d84fb76-2f9d-433c-932d-1aa6be085e2a tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:05:16.230834 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d5dd6ea0-8a25-4952-9112-4d0f4e30064d req-6d84fb76-2f9d-433c-932d-1aa6be085e2a tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 984 time: 0.0523753 Nov 02 13:05:16.299420 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d5dd6ea0-8a25-4952-9112-4d0f4e30064d req-10086684-251f-4066-b456-a3ab4c25a949 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&id=d903c15b-eb65-4948-b101-c642f2182891&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0625069 Nov 02 13:05:16.769847 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85d464a3-e19c-4b8b-92da-b5e963f38579 req-b713b6f2-ec9e-47c9-a6f6-d662a584cdcc service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:05:16.771630 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-85d464a3-e19c-4b8b-92da-b5e963f38579 req-b713b6f2-ec9e-47c9-a6f6-d662a584cdcc service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=36f51757702242e8b1343954aa4f93fe&device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 1137 time: 0.0431945 Nov 02 13:05:16.890296 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85d464a3-e19c-4b8b-92da-b5e963f38579 req-80fabfc3-c2de-464b-985a-c75ff5c235f2 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:05:16.892071 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-85d464a3-e19c-4b8b-92da-b5e963f38579 req-80fabfc3-c2de-464b-985a-c75ff5c235f2 service neutron] 10.222.0.90 "GET /v2.0/networks?id=547d6dbb-2ff3-449a-acfb-935d7f0325c4 HTTP/1.1" status: 200 len: 915 time: 0.0977051 Nov 02 13:05:16.963345 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-85d464a3-e19c-4b8b-92da-b5e963f38579 req-c1e10c57-6750-4757-9421-7a1b3142e0e1 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ef4f480a-cf21-4d37-9a5f-75aa209da3ce HTTP/1.1" status: 200 len: 999 time: 0.0641742 Nov 02 13:05:17.016074 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85d464a3-e19c-4b8b-92da-b5e963f38579 req-b4af110b-bd4d-4899-a42d-e21acb67a4e0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:05:17.017567 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-85d464a3-e19c-4b8b-92da-b5e963f38579 req-b4af110b-bd4d-4899-a42d-e21acb67a4e0 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=424f2c99-da28-4193-b1e7-1cafea9ef4ee HTTP/1.1" status: 200 len: 853 time: 0.0467947 Nov 02 13:05:17.065263 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-85d464a3-e19c-4b8b-92da-b5e963f38579 req-e88206a1-c318-4770-8e01-4a41f0be901a service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:05:17.066887 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-85d464a3-e19c-4b8b-92da-b5e963f38579 req-e88206a1-c318-4770-8e01-4a41f0be901a service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=547d6dbb-2ff3-449a-acfb-935d7f0325c4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0410299 Nov 02 13:05:17.168874 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-85d464a3-e19c-4b8b-92da-b5e963f38579 req-90494548-af05-417c-a145-0f48dd7ba8ff service neutron] 10.222.0.90 "GET /v2.0/networks/547d6dbb-2ff3-449a-acfb-935d7f0325c4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.0934417 Nov 02 13:05:17.269236 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-85d464a3-e19c-4b8b-92da-b5e963f38579 req-3030dcf3-126a-4e27-813b-74424d18c8c7 service neutron] 10.222.0.90 "GET /v2.0/networks/547d6dbb-2ff3-449a-acfb-935d7f0325c4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.0917342 Nov 02 13:05:17.471896 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-df460de6-5610-4606-8392-fb883594800b req-a26ee50e-2145-4fd6-99d3-838d7080be87 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:05:17.473416 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-df460de6-5610-4606-8392-fb883594800b req-a26ee50e-2145-4fd6-99d3-838d7080be87 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 984 time: 0.0557582 Nov 02 13:05:17.540893 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-df460de6-5610-4606-8392-fb883594800b req-f7caa59a-d00e-4887-b866-d293a26fb65f tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&id=d903c15b-eb65-4948-b101-c642f2182891&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0610998 Nov 02 13:05:18.665266 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-962c84d9-629c-43db-848a-9e4336e645e1 req-742ae8e7-7067-40fa-8b45-d1bc54251dc3 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:05:18.666801 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-962c84d9-629c-43db-848a-9e4336e645e1 req-742ae8e7-7067-40fa-8b45-d1bc54251dc3 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 984 time: 0.0525331 Nov 02 13:05:18.732613 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-962c84d9-629c-43db-848a-9e4336e645e1 req-6d2d5e95-f9cd-4c28-9ec3-5b5bb9faded0 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&id=d903c15b-eb65-4948-b101-c642f2182891&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0596819 Nov 02 13:05:19.860746 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-22ef03fa-368d-4de4-a7be-86088abbcf73 req-30e257c3-6ae6-43aa-8e1e-a4b11c2d55a2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:05:19.862892 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-22ef03fa-368d-4de4-a7be-86088abbcf73 req-30e257c3-6ae6-43aa-8e1e-a4b11c2d55a2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 984 time: 0.0568964 Nov 02 13:05:19.928210 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-22ef03fa-368d-4de4-a7be-86088abbcf73 req-b441fa74-9138-42ee-ad38-9a1d4b1bdb74 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&id=d903c15b-eb65-4948-b101-c642f2182891&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0593901 Nov 02 13:05:21.053924 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-d5c95e9a-592f-41d4-b3f0-315ca739bae1 req-f923be93-2e19-44ec-8a85-ff110e9c4e2c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:05:21.055520 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d5c95e9a-592f-41d4-b3f0-315ca739bae1 req-f923be93-2e19-44ec-8a85-ff110e9c4e2c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 984 time: 0.0528326 Nov 02 13:05:21.119854 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-d5c95e9a-592f-41d4-b3f0-315ca739bae1 req-c6e2db50-e08a-48be-bf8a-17d5dc99ae3c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&id=d903c15b-eb65-4948-b101-c642f2182891&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0575075 Nov 02 13:05:22.253998 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98be2522-ace3-4c62-bc5c-4ee6fae59f2c req-c37578f0-118e-4dda-af25-37dfae9f27a3 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:05:22.255567 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-98be2522-ace3-4c62-bc5c-4ee6fae59f2c req-c37578f0-118e-4dda-af25-37dfae9f27a3 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 984 time: 0.0526659 Nov 02 13:05:22.324167 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-98be2522-ace3-4c62-bc5c-4ee6fae59f2c req-ec463a98-aa30-44b0-9894-d480b30edb60 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&id=d903c15b-eb65-4948-b101-c642f2182891&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0621433 Nov 02 13:05:23.474216 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-c3ec1e96-1f15-4dab-845b-65c9e6013914 req-637f4175-27e6-48ce-a00c-d3d9e2f22634 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:05:23.475862 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c3ec1e96-1f15-4dab-845b-65c9e6013914 req-637f4175-27e6-48ce-a00c-d3d9e2f22634 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 984 time: 0.0624061 Nov 02 13:05:23.498678 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-b5858bc6-fe04-44a0-9949-f15a4cb7cd4e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:05:23.546743 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-c3ec1e96-1f15-4dab-845b-65c9e6013914 req-9986eacb-cefd-4e76-a708-a074e7bc4b47 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&id=d903c15b-eb65-4948-b101-c642f2182891&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0599740 Nov 02 13:05:24.470673 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 13:05:24.679099 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-98645751-5cf1-45fe-be2d-62234868c5dd req-e98fc0a5-cb7a-4502-a3bc-05ee64f408a7 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:05:24.680596 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-98645751-5cf1-45fe-be2d-62234868c5dd req-e98fc0a5-cb7a-4502-a3bc-05ee64f408a7 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 984 time: 0.0576589 Nov 02 13:05:24.744407 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-98645751-5cf1-45fe-be2d-62234868c5dd req-a1b410a6-5079-40d2-b977-bc491d63cdb9 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&id=d903c15b-eb65-4948-b101-c642f2182891&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0576093 Nov 02 13:05:25.625145 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-b8d48851-5253-4ac4-add8-48bad295da55 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:05:25.872749 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-62b8a255-0f6b-4294-bed2-a29222d3584c req-f4d7338b-1b13-4c8d-a236-9b0f27e7f097 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:05:25.874201 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-62b8a255-0f6b-4294-bed2-a29222d3584c req-f4d7338b-1b13-4c8d-a236-9b0f27e7f097 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 984 time: 0.0562563 Nov 02 13:05:25.939358 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-62b8a255-0f6b-4294-bed2-a29222d3584c req-56e3171b-bc04-473f-b548-57c50d304002 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&id=d903c15b-eb65-4948-b101-c642f2182891&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0587206 Nov 02 13:05:26.921599 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:05:27.075661 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-fcc01887-1e26-41cd-9cf3-811f02fefd3d req-8efe47da-571c-46f5-af84-f4c305a32eae tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:05:27.077198 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fcc01887-1e26-41cd-9cf3-811f02fefd3d req-8efe47da-571c-46f5-af84-f4c305a32eae tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 984 time: 0.0602539 Nov 02 13:05:27.140848 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-fcc01887-1e26-41cd-9cf3-811f02fefd3d req-656114b8-e226-443e-ac05-71017943419c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&id=d903c15b-eb65-4948-b101-c642f2182891&fields=id&fields=name HTTP/1.1" status: 200 len: 379 time: 0.0575440 Nov 02 13:05:28.407312 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:05:30.841473 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:05:33.470011 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:05:53.509040 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1f11e9b7-0cb7-4489-b0ac-fc6bd90d1807 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:05:55.663230 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-e219c22c-a7dd-4c64-b8d6-461645862366 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:05:56.909258 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:05:58.400414 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:05:59.652387 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ec72d9ee-a26e-40c8-9a61-f38d3c688513 req-ba67c90c-e3a5-4ce6-8483-dd7beb2f0516 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?name=tempest-secgroup-smoke-251103679&fields=id&tenant_id=36f51757702242e8b1343954aa4f93fe HTTP/1.1" status: 200 len: 267 time: 0.0521967 Nov 02 13:05:59.714728 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec72d9ee-a26e-40c8-9a61-f38d3c688513 req-57bb7389-e789-4f46-9d1a-b79b05c1691c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:05:59.716300 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ec72d9ee-a26e-40c8-9a61-f38d3c688513 req-57bb7389-e789-4f46-9d1a-b79b05c1691c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 984 time: 0.0576961 Nov 02 13:05:59.728174 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.v2.base [req-ec72d9ee-a26e-40c8-9a61-f38d3c688513 req-bffd4888-9154-4ad5-96ea-f2dcec863a53 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Request body: {'port': {'security_groups': ['6433fe5c-a062-47c1-827b-d94e9e3b8866']}} {{(pid=108543) prepare_request_body /opt/stack/neutron/neutron/api/v2/base.py:729}} Nov 02 13:05:59.805351 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ec72d9ee-a26e-40c8-9a61-f38d3c688513 req-bffd4888-9154-4ad5-96ea-f2dcec863a53 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupDbMixin._ensure_default_security_group_handler-941750'] for port, before_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:05:59.991788 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-ec72d9ee-a26e-40c8-9a61-f38d3c688513 req-bffd4888-9154-4ad5-96ea-f2dcec863a53 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] For port ef4f480a-cf21-4d37-9a5f-75aa209da3ce, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=ef4f480a-cf21-4d37-9a5f-75aa209da3ce,segment=NetworkSegment(990fa8e2-8f5c-4714-aa6e-d15bfa97b992),segment_id=990fa8e2-8f5c-4714-aa6e-d15bfa97b992)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:06:00.027627 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ec72d9ee-a26e-40c8-9a61-f38d3c688513 req-bffd4888-9154-4ad5-96ea-f2dcec863a53 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for port, precommit_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:00.092151 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ec72d9ee-a26e-40c8-9a61-f38d3c688513 req-bffd4888-9154-4ad5-96ea-f2dcec863a53 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_gateway_port_ip_changed-8738449974101', 'neutron.db.l3_dvrscheduler_db._notify_l3_agent_port_update-8738449414687', 'neutron.db.l3_hascheduler_db._notify_l3_agent_ha_port_update-8738449414705', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_updated-126393832'] for port, after_update {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:00.110258 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['ef4f480a-cf21-4d37-9a5f-75aa209da3ce'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 13:06:00.140264 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-ec72d9ee-a26e-40c8-9a61-f38d3c688513 req-bffd4888-9154-4ad5-96ea-f2dcec863a53 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:06:00.141016 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-ec72d9ee-a26e-40c8-9a61-f38d3c688513 req-bffd4888-9154-4ad5-96ea-f2dcec863a53 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:00.142425 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-ec72d9ee-a26e-40c8-9a61-f38d3c688513 req-bffd4888-9154-4ad5-96ea-f2dcec863a53 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "PUT /v2.0/ports/ef4f480a-cf21-4d37-9a5f-75aa209da3ce HTTP/1.1" status: 200 len: 942 time: 0.4192040 Nov 02 13:06:00.142971 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '45226cec-a8e5-4f79-b716-f30663a5d352', 'tag': 'ef4f480a-cf21-4d37-9a5f-75aa209da3ce'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 13:06:00.145678 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-41282c17-264e-43f5-baf9-b2d50c3cd0e5" -d '{"events": [{"name": "network-changed", "server_uuid": "45226cec-a8e5-4f79-b716-f30663a5d352", "tag": "ef4f480a-cf21-4d37-9a5f-75aa209da3ce"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 13:06:00.150823 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 37336) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:06:00.193211 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bffd4888-9154-4ad5-96ea-f2dcec863a53 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Pushing event updated for resources: {'Port': ['ID=ef4f480a-cf21-4d37-9a5f-75aa209da3ce,revision_number=7']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:06:00.207206 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bffd4888-9154-4ad5-96ea-f2dcec863a53 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:00.215539 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bffd4888-9154-4ad5-96ea-f2dcec863a53 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:00.215539 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bffd4888-9154-4ad5-96ea-f2dcec863a53 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:00.215539 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bffd4888-9154-4ad5-96ea-f2dcec863a53 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:00.215539 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bffd4888-9154-4ad5-96ea-f2dcec863a53 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:00.215539 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bffd4888-9154-4ad5-96ea-f2dcec863a53 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:00.215539 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bffd4888-9154-4ad5-96ea-f2dcec863a53 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:00.215539 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bffd4888-9154-4ad5-96ea-f2dcec863a53 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:00.215539 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bffd4888-9154-4ad5-96ea-f2dcec863a53 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:00.215539 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bffd4888-9154-4ad5-96ea-f2dcec863a53 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:00.215539 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bffd4888-9154-4ad5-96ea-f2dcec863a53 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:00.215539 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-bffd4888-9154-4ad5-96ea-f2dcec863a53 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108543) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:00.219752 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 13:06:00 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-e09a3bc7-5ecb-4f4f-b2d2-8b3b191dbd3d x-openstack-request-id: req-e09a3bc7-5ecb-4f4f-b2d2-8b3b191dbd3d {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 13:06:00.220565 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "45226cec-a8e5-4f79-b716-f30663a5d352", "tag": "ef4f480a-cf21-4d37-9a5f-75aa209da3ce", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 13:06:00.220811 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-e09a3bc7-5ecb-4f4f-b2d2-8b3b191dbd3d {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 13:06:00.222208 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '45226cec-a8e5-4f79-b716-f30663a5d352', 'tag': 'ef4f480a-cf21-4d37-9a5f-75aa209da3ce', 'status': 'completed', 'code': 200} Nov 02 13:06:00.246867 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['ef4f480a-cf21-4d37-9a5f-75aa209da3ce'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 13:06:00.247063 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-86ca8f1a-4abe-4fc1-ba4a-2f00130625e2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for security_group, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:00.275045 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-86ca8f1a-4abe-4fc1-ba4a-2f00130625e2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for security_group, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:00.296550 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41282c17-264e-43f5-baf9-b2d50c3cd0e5 req-76cfde7e-1a4d-4523-b437-a0829713fb33 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:06:00.298192 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-41282c17-264e-43f5-baf9-b2d50c3cd0e5 req-76cfde7e-1a4d-4523-b437-a0829713fb33 service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=36f51757702242e8b1343954aa4f93fe&device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 1098 time: 0.0471067 Nov 02 13:06:00.421645 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41282c17-264e-43f5-baf9-b2d50c3cd0e5 req-00bf0e14-e751-4aac-9f09-5ded358f09ff service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:06:00.423051 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-41282c17-264e-43f5-baf9-b2d50c3cd0e5 req-00bf0e14-e751-4aac-9f09-5ded358f09ff service neutron] 10.222.0.90 "GET /v2.0/networks?id=547d6dbb-2ff3-449a-acfb-935d7f0325c4 HTTP/1.1" status: 200 len: 915 time: 0.1175809 Nov 02 13:06:00.480505 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-86ca8f1a-4abe-4fc1-ba4a-2f00130625e2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:00.485076 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-86ca8f1a-4abe-4fc1-ba4a-2f00130625e2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for security_group, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:00.487596 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-86ca8f1a-4abe-4fc1-ba4a-2f00130625e2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "DELETE /v2.0/security-groups/d903c15b-eb65-4948-b101-c642f2182891 HTTP/1.1" status: 204 len: 168 time: 0.3355172 Nov 02 13:06:00.491998 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 37340) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:06:00.506195 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-86ca8f1a-4abe-4fc1-ba4a-2f00130625e2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Pushing event deleted for resources: {'SecurityGroup': ['ID=d903c15b-eb65-4948-b101-c642f2182891,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:06:00.520710 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ca8f1a-4abe-4fc1-ba4a-2f00130625e2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:00.521754 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ca8f1a-4abe-4fc1-ba4a-2f00130625e2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:00.522302 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ca8f1a-4abe-4fc1-ba4a-2f00130625e2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:00.527713 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ca8f1a-4abe-4fc1-ba4a-2f00130625e2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:00.527713 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ca8f1a-4abe-4fc1-ba4a-2f00130625e2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:00.527713 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ca8f1a-4abe-4fc1-ba4a-2f00130625e2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:00.527713 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ca8f1a-4abe-4fc1-ba4a-2f00130625e2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:00.527713 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ca8f1a-4abe-4fc1-ba4a-2f00130625e2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:00.527713 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ca8f1a-4abe-4fc1-ba4a-2f00130625e2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:00.527713 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ca8f1a-4abe-4fc1-ba4a-2f00130625e2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:00.527713 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ca8f1a-4abe-4fc1-ba4a-2f00130625e2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:00.529145 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-86ca8f1a-4abe-4fc1-ba4a-2f00130625e2 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108542) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:00.550086 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-41282c17-264e-43f5-baf9-b2d50c3cd0e5 req-226cb5b0-544b-4763-9c8a-2b06a3ceadee service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ef4f480a-cf21-4d37-9a5f-75aa209da3ce HTTP/1.1" status: 200 len: 999 time: 0.1123338 Nov 02 13:06:00.558607 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.provisioning_blocks [None req-c12831de-9c96-43a4-85d1-bf749307157f None None] Provisioning complete for port ef4f480a-cf21-4d37-9a5f-75aa209da3ce triggered by entity DHCP. {{(pid=108544) provisioning_complete /opt/stack/neutron/neutron/db/provisioning_blocks.py:139}} Nov 02 13:06:00.559021 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-c12831de-9c96-43a4-85d1-bf749307157f None None] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._port_provisioned-930096'] for port, provisioning_complete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:00.667790 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41282c17-264e-43f5-baf9-b2d50c3cd0e5 req-723bc4c8-df49-40d7-a1d1-63a3b68e39d5 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:06:00.668299 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-41282c17-264e-43f5-baf9-b2d50c3cd0e5 req-723bc4c8-df49-40d7-a1d1-63a3b68e39d5 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=424f2c99-da28-4193-b1e7-1cafea9ef4ee HTTP/1.1" status: 200 len: 853 time: 0.1035411 Nov 02 13:06:00.750325 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-41282c17-264e-43f5-baf9-b2d50c3cd0e5 req-811523fc-19c3-4046-97b3-89477b25c6bb service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:06:00.752481 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-41282c17-264e-43f5-baf9-b2d50c3cd0e5 req-811523fc-19c3-4046-97b3-89477b25c6bb service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=547d6dbb-2ff3-449a-acfb-935d7f0325c4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0768857 Nov 02 13:06:00.791942 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-d4bde35b-2d42-4dbb-8bbd-c57405a98519 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Deleting port acb40146-eab9-4ba9-9ef5-89d30d15890c {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:06:00.792176 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d4bde35b-2d42-4dbb-8bbd-c57405a98519 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:00.840318 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:00.914759 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-41282c17-264e-43f5-baf9-b2d50c3cd0e5 req-1447dc65-41ef-4254-b772-07f6c7b06f54 service neutron] 10.222.0.90 "GET /v2.0/networks/547d6dbb-2ff3-449a-acfb-935d7f0325c4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1515539 Nov 02 13:06:00.924604 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d4bde35b-2d42-4dbb-8bbd-c57405a98519 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:00.924892 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d4bde35b-2d42-4dbb-8bbd-c57405a98519 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for floatingip, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:00.960736 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-d4bde35b-2d42-4dbb-8bbd-c57405a98519 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Calling delete_port for acb40146-eab9-4ba9-9ef5-89d30d15890c owned by network:floatingip {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:06:01.074786 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-41282c17-264e-43f5-baf9-b2d50c3cd0e5 req-505c953e-6359-4450-b1cf-acfa6e7725b1 service neutron] 10.222.0.90 "GET /v2.0/networks/547d6dbb-2ff3-449a-acfb-935d7f0325c4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1520925 Nov 02 13:06:01.235374 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d4bde35b-2d42-4dbb-8bbd-c57405a98519 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:01.260414 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-d4bde35b-2d42-4dbb-8bbd-c57405a98519 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Pushing event deleted for resources: {'Port': ['ID=acb40146-eab9-4ba9-9ef5-89d30d15890c,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:06:01.333721 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d4bde35b-2d42-4dbb-8bbd-c57405a98519 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks [] for floatingip, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:01.333958 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.db.l3_db [None req-d4bde35b-2d42-4dbb-8bbd-c57405a98519 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Floating IP 2e959346-0fbc-4e31-8bc5-6603d7de066b disassociated (deleted). External IP: 172.27.0.3, port: ef4f480a-cf21-4d37-9a5f-75aa209da3ce. Nov 02 13:06:01.470234 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 13:06:01.552600 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-d4bde35b-2d42-4dbb-8bbd-c57405a98519 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Router 8f644798-f842-47ae-90c4-f5e349fed2fb has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108543) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 13:06:01.665764 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-d4bde35b-2d42-4dbb-8bbd-c57405a98519 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108543) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 13:06:01.670958 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-d4bde35b-2d42-4dbb-8bbd-c57405a98519 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for floatingip, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:01.677051 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-778a5420-dc27-4dd5-ac7b-1c090accece1 None None] Sync routers for ids ['8f644798-f842-47ae-90c4-f5e349fed2fb'] in dv-cinder-816324-1-iscsi {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 13:06:01.687461 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-778a5420-dc27-4dd5-ac7b-1c090accece1 None None] Routers {'8f644798-f842-47ae-90c4-f5e349fed2fb'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:06:01.688076 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-778a5420-dc27-4dd5-ac7b-1c090accece1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:05:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['8f644798-f842-47ae-90c4-f5e349fed2fb'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:06:01.703258 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-d4bde35b-2d42-4dbb-8bbd-c57405a98519 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "DELETE /v2.0/floatingips/2e959346-0fbc-4e31-8bc5-6603d7de066b HTTP/1.1" status: 204 len: 168 time: 1.2098489 Nov 02 13:06:01.807577 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-778a5420-dc27-4dd5-ac7b-1c090accece1 None None] Set router 8f644798-f842-47ae-90c4-f5e349fed2fb gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:06:02.026450 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-778a5420-dc27-4dd5-ac7b-1c090accece1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'name': 'tempest-TestMinimumBasicScenario-539319503-router', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:03:48Z', 'revision_number': 4, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'gw_port': {'id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:95:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:03:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '9fd131ff-7577-434d-808c-a8686762bec8', 'name': '', 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'mac_address': 'fa:16:3e:5e:18:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '424f2c99-da28-4193-b1e7-1cafea9ef4ee', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:47Z', 'updated_at': '2021-11-02T13:03:53Z', 'revision_number': 5, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'subnets': [{'id': '424f2c99-da28-4193-b1e7-1cafea9ef4ee', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:06:02.059078 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-778a5420-dc27-4dd5-ac7b-1c090accece1 None None] Checking router: 8f644798-f842-47ae-90c4-f5e349fed2fb for host: dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 13:06:02.068325 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-778a5420-dc27-4dd5-ac7b-1c090accece1 None None] Routers {'8f644798-f842-47ae-90c4-f5e349fed2fb'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:06:02.068951 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-778a5420-dc27-4dd5-ac7b-1c090accece1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:05:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['8f644798-f842-47ae-90c4-f5e349fed2fb'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:06:02.180111 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-778a5420-dc27-4dd5-ac7b-1c090accece1 None None] Set router 8f644798-f842-47ae-90c4-f5e349fed2fb gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:06:02.223826 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'name': 'network-changed', 'server_uuid': '45226cec-a8e5-4f79-b716-f30663a5d352', 'tag': 'ef4f480a-cf21-4d37-9a5f-75aa209da3ce'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 13:06:02.226243 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-0404ba53-da71-49b4-90aa-19c1b5e7fda8" -d '{"events": [{"name": "network-changed", "server_uuid": "45226cec-a8e5-4f79-b716-f30663a5d352", "tag": "ef4f480a-cf21-4d37-9a5f-75aa209da3ce"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 13:06:02.269360 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 179 Content-Type: application/json Date: Tue, 02 Nov 2021 13:06:02 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-8a7b00fd-0a8d-4e84-83d8-9be160341d39 x-openstack-request-id: req-8a7b00fd-0a8d-4e84-83d8-9be160341d39 {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 13:06:02.270041 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"name": "network-changed", "server_uuid": "45226cec-a8e5-4f79-b716-f30663a5d352", "tag": "ef4f480a-cf21-4d37-9a5f-75aa209da3ce", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 13:06:02.270382 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-8a7b00fd-0a8d-4e84-83d8-9be160341d39 {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 13:06:02.270890 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'name': 'network-changed', 'server_uuid': '45226cec-a8e5-4f79-b716-f30663a5d352', 'tag': 'ef4f480a-cf21-4d37-9a5f-75aa209da3ce', 'status': 'completed', 'code': 200} Nov 02 13:06:02.353056 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0404ba53-da71-49b4-90aa-19c1b5e7fda8 req-d02ce921-5bff-465a-a00d-21d5872968cd service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:06:02.354627 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0404ba53-da71-49b4-90aa-19c1b5e7fda8 req-d02ce921-5bff-465a-a00d-21d5872968cd service neutron] 10.222.0.90 "GET /v2.0/ports?tenant_id=36f51757702242e8b1343954aa4f93fe&device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 1098 time: 0.0544536 Nov 02 13:06:02.422234 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-778a5420-dc27-4dd5-ac7b-1c090accece1 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'name': 'tempest-TestMinimumBasicScenario-539319503-router', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:03:48Z', 'revision_number': 4, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'gw_port': {'id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:95:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:03:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '9fd131ff-7577-434d-808c-a8686762bec8', 'name': '', 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'mac_address': 'fa:16:3e:5e:18:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '424f2c99-da28-4193-b1e7-1cafea9ef4ee', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:47Z', 'updated_at': '2021-11-02T13:03:53Z', 'revision_number': 5, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'subnets': [{'id': '424f2c99-da28-4193-b1e7-1cafea9ef4ee', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:06:02.458390 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-778a5420-dc27-4dd5-ac7b-1c090accece1 None None] The sync data for ids ['8f644798-f842-47ae-90c4-f5e349fed2fb'] in dv-cinder-816324-1-iscsi is: [{'id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'name': 'tempest-TestMinimumBasicScenario-539319503-router', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:03:48Z', 'revision_number': 4, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'gw_port': {'id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:95:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:03:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi', '_interfaces': [{'id': '9fd131ff-7577-434d-808c-a8686762bec8', 'name': '', 'network_id': '547d6dbb-2ff3-449a-acfb-935d7f0325c4', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'mac_address': 'fa:16:3e:5e:18:23', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'device_owner': 'network:router_interface', 'standard_attr_id': 678, 'fixed_ips': [{'subnet_id': '424f2c99-da28-4193-b1e7-1cafea9ef4ee', 'ip_address': '172.20.0.1', 'prefixlen': 28}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:47Z', 'updated_at': '2021-11-02T13:03:53Z', 'revision_number': 5, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'subnets': [{'id': '424f2c99-da28-4193-b1e7-1cafea9ef4ee', 'cidr': '172.20.0.0/28', 'gateway_ip': '172.20.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}]}] {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 13:06:02.470091 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0404ba53-da71-49b4-90aa-19c1b5e7fda8 req-49c24646-c226-49ca-b131-e9c1e1f9a0a8 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'vlan_transparent'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:06:02.471711 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0404ba53-da71-49b4-90aa-19c1b5e7fda8 req-49c24646-c226-49ca-b131-e9c1e1f9a0a8 service neutron] 10.222.0.90 "GET /v2.0/networks?id=547d6dbb-2ff3-449a-acfb-935d7f0325c4 HTTP/1.1" status: 200 len: 915 time: 0.1084428 Nov 02 13:06:02.526049 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0404ba53-da71-49b4-90aa-19c1b5e7fda8 req-79215756-251c-4d2f-a564-f98b9da63924 service neutron] 10.222.0.90 "GET /v2.0/floatingips?fixed_ip_address=172.20.0.9&port_id=ef4f480a-cf21-4d37-9a5f-75aa209da3ce HTTP/1.1" status: 200 len: 217 time: 0.0437102 Nov 02 13:06:02.582862 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0404ba53-da71-49b4-90aa-19c1b5e7fda8 req-0abcc7c1-4d00-45c4-bf60-055e53b377b0 service neutron] Attributes excluded by policy engine: ['standard_attr_id', 'shared', 'segment_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:06:02.584403 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0404ba53-da71-49b4-90aa-19c1b5e7fda8 req-0abcc7c1-4d00-45c4-bf60-055e53b377b0 service neutron] 10.222.0.90 "GET /v2.0/subnets?id=424f2c99-da28-4193-b1e7-1cafea9ef4ee HTTP/1.1" status: 200 len: 853 time: 0.0501430 Nov 02 13:06:02.644273 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-0404ba53-da71-49b4-90aa-19c1b5e7fda8 req-2e3b2b77-0828-4366-ab2e-6eadcb91baa5 service neutron] Attributes excluded by policy engine: ['standard_attr_id'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:06:02.646140 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0404ba53-da71-49b4-90aa-19c1b5e7fda8 req-2e3b2b77-0828-4366-ab2e-6eadcb91baa5 service neutron] 10.222.0.90 "GET /v2.0/ports?network_id=547d6dbb-2ff3-449a-acfb-935d7f0325c4&device_owner=network%3Adhcp HTTP/1.1" status: 200 len: 1175 time: 0.0537679 Nov 02 13:06:02.737854 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-ce924f7c-bb7a-4aa6-aa2f-7a225e44101b None None] New status for floating IP 2e959346-0fbc-4e31-8bc5-6603d7de066b: DOWN {{(pid=108545) update_floatingip_statuses /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:270}} Nov 02 13:06:02.769959 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0404ba53-da71-49b4-90aa-19c1b5e7fda8 req-40b15598-77af-4bee-886c-c4105a713dc8 service neutron] 10.222.0.90 "GET /v2.0/networks/547d6dbb-2ff3-449a-acfb-935d7f0325c4?fields=segments HTTP/1.1" status: 200 len: 212 time: 0.1124651 Nov 02 13:06:02.894969 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-0404ba53-da71-49b4-90aa-19c1b5e7fda8 req-4307ffe1-8865-4260-be91-7dc6eceee6f5 service neutron] 10.222.0.90 "GET /v2.0/networks/547d6dbb-2ff3-449a-acfb-935d7f0325c4?fields=provider%3Aphysical_network&fields=provider%3Anetwork_type HTTP/1.1" status: 200 len: 281 time: 0.1113019 Nov 02 13:06:03.492206 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:06.006893 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4fdc314b-a825-4c5c-8afd-97e6dce3c8d3 req-ec6caadd-7051-46c5-97f9-9e4b8a397e18 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:06:06.008439 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4fdc314b-a825-4c5c-8afd-97e6dce3c8d3 req-ec6caadd-7051-46c5-97f9-9e4b8a397e18 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 945 time: 0.0581565 Nov 02 13:06:06.059399 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4fdc314b-a825-4c5c-8afd-97e6dce3c8d3 req-46e588ad-3191-477c-a8a7-4dbdcbad8872 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0448186 Nov 02 13:06:07.179956 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-1735e86c-ff8a-494f-8f16-6557872354b9 req-01229c01-4683-48b8-8a75-be7c9b6c286a tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:06:07.181458 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1735e86c-ff8a-494f-8f16-6557872354b9 req-01229c01-4683-48b8-8a75-be7c9b6c286a tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 945 time: 0.0511591 Nov 02 13:06:07.229741 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-1735e86c-ff8a-494f-8f16-6557872354b9 req-7ffa0f73-2b94-46d8-91da-32114048911f tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0420287 Nov 02 13:06:07.966232 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-b854471d-743a-4309-93ab-ad80ec861e89 req-076037d6-72ea-41ce-8f05-29b37db8db74 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:06:07.968082 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b854471d-743a-4309-93ab-ad80ec861e89 req-076037d6-72ea-41ce-8f05-29b37db8db74 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.90 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 945 time: 0.0500131 Nov 02 13:06:08.067429 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-b854471d-743a-4309-93ab-ad80ec861e89 req-f24c7f9d-6b69-46fb-a4e0-09d50912e1b3 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Deleting port ef4f480a-cf21-4d37-9a5f-75aa209da3ce {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:06:08.067796 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b854471d-743a-4309-93ab-ad80ec861e89 req-f24c7f9d-6b69-46fb-a4e0-09d50912e1b3 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:08.174448 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [req-b854471d-743a-4309-93ab-ad80ec861e89 req-f24c7f9d-6b69-46fb-a4e0-09d50912e1b3 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] For port ef4f480a-cf21-4d37-9a5f-75aa209da3ce, host hv-cinder-81632, got binding levels [PortBindingLevel(driver='hyperv',host='hv-cinder-81632',level=0,port_id=ef4f480a-cf21-4d37-9a5f-75aa209da3ce,segment=NetworkSegment(990fa8e2-8f5c-4714-aa6e-d15bfa97b992),segment_id=990fa8e2-8f5c-4714-aa6e-d15bfa97b992)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:06:08.174814 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b854471d-743a-4309-93ab-ad80ec861e89 req-f24c7f9d-6b69-46fb-a4e0-09d50912e1b3 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:08.194411 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [req-b854471d-743a-4309-93ab-ad80ec861e89 req-f24c7f9d-6b69-46fb-a4e0-09d50912e1b3 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Calling delete_port for ef4f480a-cf21-4d37-9a5f-75aa209da3ce owned by compute:nova {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:06:08.592417 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.pecan_wsgi.hooks.policy_enforcement [req-4791040b-0e65-4415-9cb9-18a646c66cec req-93a8e488-f687-487c-9018-f1da1ca3d4db tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Attributes excluded by policy engine: ['standard_attr_id', 'binding:profile', 'binding:host_id', 'binding:vif_type', 'binding:vif_details'] {{(pid=108543) _exclude_attributes_by_policy /opt/stack/neutron/neutron/pecan_wsgi/hooks/policy_enforcement.py:255}} Nov 02 13:06:08.593825 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4791040b-0e65-4415-9cb9-18a646c66cec req-93a8e488-f687-487c-9018-f1da1ca3d4db tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 945 time: 0.0784333 Nov 02 13:06:08.686918 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-4791040b-0e65-4415-9cb9-18a646c66cec req-f7087c06-375a-4690-b079-45ac619d323c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/security-groups?id=6433fe5c-a062-47c1-827b-d94e9e3b8866&fields=id&fields=name HTTP/1.1" status: 200 len: 286 time: 0.0832443 Nov 02 13:06:08.743524 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b854471d-743a-4309-93ab-ad80ec861e89 req-f24c7f9d-6b69-46fb-a4e0-09d50912e1b3 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:08.761008 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] get_ports_and_sgs() called for port_ids ['ef4f480a-cf21-4d37-9a5f-75aa209da3ce'] {{(pid=108544) get_ports_and_sgs /opt/stack/neutron/neutron/plugins/ml2/db.py:156}} Nov 02 13:06:08.774086 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f24c7f9d-6b69-46fb-a4e0-09d50912e1b3 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Pushing event deleted for resources: {'Port': ['ID=ef4f480a-cf21-4d37-9a5f-75aa209da3ce,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:06:08.818260 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [req-b854471d-743a-4309-93ab-ad80ec861e89 req-f24c7f9d-6b69-46fb-a4e0-09d50912e1b3 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] No DVR routers for this DVR port ef4f480a-cf21-4d37-9a5f-75aa209da3ce on host hv-cinder-81632 {{(pid=108543) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 13:06:08.820916 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [req-b854471d-743a-4309-93ab-ad80ec861e89 req-f24c7f9d-6b69-46fb-a4e0-09d50912e1b3 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] Publish callbacks ['neutron.notifiers.nova.Notifier._send_nova_notification-91310'] for port, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:08.824256 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-b854471d-743a-4309-93ab-ad80ec861e89 req-f24c7f9d-6b69-46fb-a4e0-09d50912e1b3 tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.90 "DELETE /v2.0/ports/ef4f480a-cf21-4d37-9a5f-75aa209da3ce HTTP/1.1" status: 204 len: 173 time: 0.8492668 Nov 02 13:06:08.824694 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.notifiers.nova [-] Sending events: [{'server_uuid': '45226cec-a8e5-4f79-b716-f30663a5d352', 'name': 'network-vif-deleted', 'tag': 'ef4f480a-cf21-4d37-9a5f-75aa209da3ce'}] {{(pid=108543) send_events /opt/stack/neutron/neutron/notifiers/nova.py:262}} Nov 02 13:06:08.827046 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] REQ: curl -g -i --cacert "/opt/stack/data/ca-bundle.pem" -X POST http://10.222.0.98/compute/v2.1/os-server-external-events -H "Accept: application/json" -H "Content-Type: application/json" -H "User-Agent: python-novaclient" -H "X-Auth-Token: {SHA256}257f536f2d1ab23dcbf752b3b57bd11d4ff5a3a551553de59a8b569a7a6438b5" -H "X-OpenStack-Nova-API-Version: 2.1" -H "X-OpenStack-Request-ID: req-6078ae08-ee89-432d-9f2c-403785b344cc" -d '{"events": [{"server_uuid": "45226cec-a8e5-4f79-b716-f30663a5d352", "name": "network-vif-deleted", "tag": "ef4f480a-cf21-4d37-9a5f-75aa209da3ce"}]}' {{(pid=108543) _http_log_request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:519}} Nov 02 13:06:08.879001 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP: [200] Connection: close Content-Length: 183 Content-Type: application/json Date: Tue, 02 Nov 2021 13:06:08 GMT OpenStack-API-Version: compute 2.1 Server: Apache/2.4.41 (Ubuntu) Vary: OpenStack-API-Version,X-OpenStack-Nova-API-Version X-OpenStack-Nova-API-Version: 2.1 x-compute-request-id: req-9ae9144d-9a3f-4fa8-b015-f11615677159 x-openstack-request-id: req-9ae9144d-9a3f-4fa8-b015-f11615677159 {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:550}} Nov 02 13:06:08.879290 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] RESP BODY: {"events": [{"server_uuid": "45226cec-a8e5-4f79-b716-f30663a5d352", "name": "network-vif-deleted", "tag": "ef4f480a-cf21-4d37-9a5f-75aa209da3ce", "status": "completed", "code": 200}]} {{(pid=108543) _http_log_response /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:582}} Nov 02 13:06:08.879541 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG novaclient.v2.client [-] POST call to compute for http://10.222.0.98/compute/v2.1/os-server-external-events used request id req-9ae9144d-9a3f-4fa8-b015-f11615677159 {{(pid=108543) request /usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py:954}} Nov 02 13:06:08.879936 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.notifiers.nova [-] Nova event response: {'server_uuid': '45226cec-a8e5-4f79-b716-f30663a5d352', 'name': 'network-vif-deleted', 'tag': 'ef4f480a-cf21-4d37-9a5f-75aa209da3ce', 'status': 'completed', 'code': 200} Nov 02 13:06:09.809348 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [req-72219366-39ea-4307-8674-c257736a8451 req-544a42a0-41d7-4ee0-acbc-b7632370709c tempest-TestMinimumBasicScenario-39753388 tempest-TestMinimumBasicScenario-39753388-project] 10.222.0.98 "GET /v2.0/ports?device_id=45226cec-a8e5-4f79-b716-f30663a5d352 HTTP/1.1" status: 200 len: 210 time: 0.0286288 Nov 02 13:06:11.828765 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device ef4f480a-cf21-4d37-9a5f-75aa209da3ce no longer exists at agent hyperv_hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 13:06:11.851529 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] No Port match for: ef4f480a-cf21-4d37-9a5f-75aa209da3ce {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 13:06:11.851529 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Device ef4f480a-cf21-4d37-9a5f-75aa209da3ce not bound to the agent host hv-cinder-81632 {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 13:06:11.893925 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 37434) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:06:12.251673 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-fa682b17-2c5b-4d94-ac26-2b5c3358a5fb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1590128'] for router_interface, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:12.512199 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-fa682b17-2c5b-4d94-ac26-2b5c3358a5fb admin admin] Deleting port 9fd131ff-7577-434d-808c-a8686762bec8 {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:06:12.512441 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-fa682b17-2c5b-4d94-ac26-2b5c3358a5fb admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:12.600975 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [None req-fa682b17-2c5b-4d94-ac26-2b5c3358a5fb admin admin] For port 9fd131ff-7577-434d-808c-a8686762bec8, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=9fd131ff-7577-434d-808c-a8686762bec8,segment=NetworkSegment(990fa8e2-8f5c-4714-aa6e-d15bfa97b992),segment_id=990fa8e2-8f5c-4714-aa6e-d15bfa97b992)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:06:12.601252 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-fa682b17-2c5b-4d94-ac26-2b5c3358a5fb admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:12.619689 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-fa682b17-2c5b-4d94-ac26-2b5c3358a5fb admin admin] Calling delete_port for 9fd131ff-7577-434d-808c-a8686762bec8 owned by network:router_interface {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:06:12.879481 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-fa682b17-2c5b-4d94-ac26-2b5c3358a5fb admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:12.906658 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fa682b17-2c5b-4d94-ac26-2b5c3358a5fb admin admin] Pushing event deleted for resources: {'Port': ['ID=9fd131ff-7577-434d-808c-a8686762bec8,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:06:13.085838 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-fa682b17-2c5b-4d94-ac26-2b5c3358a5fb admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1649147', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1591488'] for router_interface, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:13.316848 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-fa682b17-2c5b-4d94-ac26-2b5c3358a5fb admin admin] Router 8f644798-f842-47ae-90c4-f5e349fed2fb has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108543) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 13:06:13.434749 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-fa682b17-2c5b-4d94-ac26-2b5c3358a5fb admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108543) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 13:06:13.440508 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-fa682b17-2c5b-4d94-ac26-2b5c3358a5fb admin admin] 10.222.0.98 "PUT /v2.0/routers/8f644798-f842-47ae-90c4-f5e349fed2fb/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.5452054 Nov 02 13:06:13.444611 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 37436) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:06:13.449838 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2de1f52a-0c7a-482a-a21f-a28fb12a38e4 None None] Sync routers for ids ['8f644798-f842-47ae-90c4-f5e349fed2fb'] in dv-cinder-816324-1-iscsi {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 13:06:13.461091 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2de1f52a-0c7a-482a-a21f-a28fb12a38e4 None None] Routers {'8f644798-f842-47ae-90c4-f5e349fed2fb'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:06:13.461735 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-2de1f52a-0c7a-482a-a21f-a28fb12a38e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:05:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['8f644798-f842-47ae-90c4-f5e349fed2fb'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:06:13.565614 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f46492d1-1f7e-41eb-947b-66cc6880612b admin admin] Publish callbacks [] for router, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:13.583702 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-2de1f52a-0c7a-482a-a21f-a28fb12a38e4 None None] Set router 8f644798-f842-47ae-90c4-f5e349fed2fb gateway port host: dv-cinder-816324-1-iscsi {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:06:13.703534 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f46492d1-1f7e-41eb-947b-66cc6880612b admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:13.794386 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-2de1f52a-0c7a-482a-a21f-a28fb12a38e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'name': 'tempest-TestMinimumBasicScenario-539319503-router', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29'}], 'enable_snat': True}, 'gw_port_id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:06:12Z', 'revision_number': 5, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'gw_port': {'id': 'da758e7f-f09a-49c1-8f4b-d623ff24fff3', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:11:95:30', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'device_owner': 'network:router_gateway', 'standard_attr_id': 677, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.29', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:03:50Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:06:13.818114 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-f46492d1-1f7e-41eb-947b-66cc6880612b admin admin] Deleting port da758e7f-f09a-49c1-8f4b-d623ff24fff3 {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:06:13.818486 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f46492d1-1f7e-41eb-947b-66cc6880612b admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:13.824843 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2de1f52a-0c7a-482a-a21f-a28fb12a38e4 None None] Checking router: 8f644798-f842-47ae-90c4-f5e349fed2fb for host: dv-cinder-816324-1-iscsi {{(pid=108544) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 13:06:13.835396 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2de1f52a-0c7a-482a-a21f-a28fb12a38e4 None None] Routers {'8f644798-f842-47ae-90c4-f5e349fed2fb'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108544) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:06:13.835937 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-2de1f52a-0c7a-482a-a21f-a28fb12a38e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:05:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['8f644798-f842-47ae-90c4-f5e349fed2fb'], 'active': True} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:06:13.907828 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [None req-f46492d1-1f7e-41eb-947b-66cc6880612b admin admin] For port da758e7f-f09a-49c1-8f4b-d623ff24fff3, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=da758e7f-f09a-49c1-8f4b-d623ff24fff3,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:06:13.908448 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f46492d1-1f7e-41eb-947b-66cc6880612b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:13.927943 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvr_db [None req-2de1f52a-0c7a-482a-a21f-a28fb12a38e4 None None] Set router 8f644798-f842-47ae-90c4-f5e349fed2fb gateway port host: None {{(pid=108544) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:06:13.931553 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-f46492d1-1f7e-41eb-947b-66cc6880612b admin admin] Calling delete_port for da758e7f-f09a-49c1-8f4b-d623ff24fff3 owned by network:router_gateway {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:06:13.984975 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_hamode_db [None req-2de1f52a-0c7a-482a-a21f-a28fb12a38e4 None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'name': 'tempest-TestMinimumBasicScenario-539319503-router', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:06:13Z', 'revision_number': 6, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'gw_port_host': None}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108544) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:06:14.011869 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-2de1f52a-0c7a-482a-a21f-a28fb12a38e4 None None] The sync data for ids ['8f644798-f842-47ae-90c4-f5e349fed2fb'] in dv-cinder-816324-1-iscsi is: [{'id': '8f644798-f842-47ae-90c4-f5e349fed2fb', 'name': 'tempest-TestMinimumBasicScenario-539319503-router', 'tenant_id': '36f51757702242e8b1343954aa4f93fe', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': None, 'gw_port_id': None, 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T13:03:44Z', 'updated_at': '2021-11-02T13:06:13Z', 'revision_number': 6, 'project_id': '36f51757702242e8b1343954aa4f93fe', 'gw_port_host': None}] {{(pid=108544) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 13:06:14.188647 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f46492d1-1f7e-41eb-947b-66cc6880612b admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:14.220499 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f46492d1-1f7e-41eb-947b-66cc6880612b admin admin] Pushing event deleted for resources: {'Port': ['ID=da758e7f-f09a-49c1-8f4b-d623ff24fff3,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:06:14.288501 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f46492d1-1f7e-41eb-947b-66cc6880612b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1595046'] for router_gateway, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:14.397827 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f46492d1-1f7e-41eb-947b-66cc6880612b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1593116', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-25699'] for router, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:14.400340 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f46492d1-1f7e-41eb-947b-66cc6880612b admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:14.520523 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f46492d1-1f7e-41eb-947b-66cc6880612b admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1593093'] for router, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:14.521050 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f46492d1-1f7e-41eb-947b-66cc6880612b admin admin] Fanout notify agent at l3_agent the message router_deleted on router 8f644798-f842-47ae-90c4-f5e349fed2fb {{(pid=108543) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 02 13:06:14.525386 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f46492d1-1f7e-41eb-947b-66cc6880612b admin admin] Publish callbacks [] for router, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:14.526601 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-f46492d1-1f7e-41eb-947b-66cc6880612b admin admin] 10.222.0.98 "DELETE /v2.0/routers/8f644798-f842-47ae-90c4-f5e349fed2fb HTTP/1.1" status: 204 len: 168 time: 1.0810034 Nov 02 13:06:14.529334 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 37438) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:06:14.576492 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_v2 [None req-bddeb9af-1725-41e1-ad18-235648e74680 admin admin] Deleting subnet 424f2c99-da28-4193-b1e7-1cafea9ef4ee {{(pid=108543) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 02 13:06:14.580026 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bddeb9af-1725-41e1-ad18-235648e74680 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:14.621066 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bddeb9af-1725-41e1-ad18-235648e74680 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3308629'] for subnet, precommit_delete_associations {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:14.730029 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bddeb9af-1725-41e1-ad18-235648e74680 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-933154'] for subnet, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:14.838939 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 9fd131ff-7577-434d-808c-a8686762bec8 no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 13:06:14.860014 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: 9fd131ff-7577-434d-808c-a8686762bec8 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 13:06:14.860349 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bddeb9af-1725-41e1-ad18-235648e74680 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-933141', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126393134', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126244844'] for subnet, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:14.860484 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device 9fd131ff-7577-434d-808c-a8686762bec8 not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 13:06:14.860780 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device da758e7f-f09a-49c1-8f4b-d623ff24fff3 no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 13:06:14.880404 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: da758e7f-f09a-49c1-8f4b-d623ff24fff3 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 13:06:14.880792 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device da758e7f-f09a-49c1-8f4b-d623ff24fff3 not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 13:06:14.887911 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bddeb9af-1725-41e1-ad18-235648e74680 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=424f2c99-da28-4193-b1e7-1cafea9ef4ee,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:06:14.893754 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bddeb9af-1725-41e1-ad18-235648e74680 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for subnet, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:14.898013 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-bddeb9af-1725-41e1-ad18-235648e74680 admin admin] 10.222.0.98 "DELETE /v2.0/subnets/424f2c99-da28-4193-b1e7-1cafea9ef4ee HTTP/1.1" status: 204 len: 168 time: 0.3675065 Nov 02 13:06:14.901546 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [-] (108542) accepted ('10.222.0.98', 37440) {{(pid=108542) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:06:14.904155 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-75686bca-fd61-4e4b-8e2b-7938aa8ee6e9 None None] Network 547d6dbb-2ff3-449a-acfb-935d7f0325c4 requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 13:06:14.997979 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b9b1e698-946c-459a-a6a0-5c4f3ad89ff9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-972735'] for network, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:15.073315 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-b9b1e698-946c-459a-a6a0-5c4f3ad89ff9 admin admin] Deleting port c524c07f-371a-4ead-ad5f-25aa69583cc9 {{(pid=108542) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:06:15.073658 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b9b1e698-946c-459a-a6a0-5c4f3ad89ff9 admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:15.149985 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.db [None req-b9b1e698-946c-459a-a6a0-5c4f3ad89ff9 admin admin] For port c524c07f-371a-4ead-ad5f-25aa69583cc9, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=c524c07f-371a-4ead-ad5f-25aa69583cc9,segment=NetworkSegment(990fa8e2-8f5c-4714-aa6e-d15bfa97b992),segment_id=990fa8e2-8f5c-4714-aa6e-d15bfa97b992)] {{(pid=108542) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:06:15.150303 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b9b1e698-946c-459a-a6a0-5c4f3ad89ff9 admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:15.173929 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.plugin [None req-b9b1e698-946c-459a-a6a0-5c4f3ad89ff9 admin admin] Calling delete_port for c524c07f-371a-4ead-ad5f-25aa69583cc9 owned by network:dhcp {{(pid=108542) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:06:15.251263 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-95394e26-c1bc-45c9-a469-05e574648ca5 None None] DHCP port deletion for 547d6dbb-2ff3-449a-acfb-935d7f0325c4 request from dv-cinder-816324-1-iscsi {{(pid=108544) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 02 13:06:15.393005 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-95394e26-c1bc-45c9-a469-05e574648ca5 None None] Deleting port c524c07f-371a-4ead-ad5f-25aa69583cc9 {{(pid=108544) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:06:15.393386 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-95394e26-c1bc-45c9-a469-05e574648ca5 None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:15.463256 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b9b1e698-946c-459a-a6a0-5c4f3ad89ff9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126476632'] for port, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:15.470794 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-95394e26-c1bc-45c9-a469-05e574648ca5 None None] For port c524c07f-371a-4ead-ad5f-25aa69583cc9, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=c524c07f-371a-4ead-ad5f-25aa69583cc9,segment=NetworkSegment(990fa8e2-8f5c-4714-aa6e-d15bfa97b992),segment_id=990fa8e2-8f5c-4714-aa6e-d15bfa97b992)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:06:15.471221 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-95394e26-c1bc-45c9-a469-05e574648ca5 None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:15.488884 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-95394e26-c1bc-45c9-a469-05e574648ca5 None None] Calling delete_port for c524c07f-371a-4ead-ad5f-25aa69583cc9 owned by network:dhcp {{(pid=108544) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:06:15.497759 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.db.l3_dvrscheduler_db [None req-b9b1e698-946c-459a-a6a0-5c4f3ad89ff9 admin admin] No DVR routers for this DVR port c524c07f-371a-4ead-ad5f-25aa69583cc9 on host dv-cinder-816324-1-iscsi {{(pid=108542) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 13:06:15.502887 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9b1e698-946c-459a-a6a0-5c4f3ad89ff9 admin admin] Pushing event deleted for resources: {'Port': ['ID=c524c07f-371a-4ead-ad5f-25aa69583cc9,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:06:15.584369 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-95394e26-c1bc-45c9-a469-05e574648ca5 None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678'] for port, after_delete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:15.586117 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b9b1e698-946c-459a-a6a0-5c4f3ad89ff9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-930985', 'neutron.services.segments.db._delete_segments_for_network-8738449897966'] for network, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:15.610799 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-b9b1e698-946c-459a-a6a0-5c4f3ad89ff9 admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['547d6dbb-2ff3-449a-acfb-935d7f0325c4']}} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:06:15.613027 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-95394e26-c1bc-45c9-a469-05e574648ca5 None None] Pushing event deleted for resources: {'Port': ['ID=c524c07f-371a-4ead-ad5f-25aa69583cc9,revision_number=None']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:06:15.615652 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-95394e26-c1bc-45c9-a469-05e574648ca5 None None] No DVR routers for this DVR port c524c07f-371a-4ead-ad5f-25aa69583cc9 on host dv-cinder-816324-1-iscsi {{(pid=108544) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 13:06:15.624476 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95394e26-c1bc-45c9-a469-05e574648ca5 None None] Version for resource type AddressGroup changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:15.624895 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95394e26-c1bc-45c9-a469-05e574648ca5 None None] Version for resource type ConntrackHelper changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:15.625064 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-b9b1e698-946c-459a-a6a0-5c4f3ad89ff9 admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '990fa8e2-8f5c-4714-aa6e-d15bfa97b992') {'for_net_delete': True} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:06:15.625410 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.services.segments.db [None req-b9b1e698-946c-459a-a6a0-5c4f3ad89ff9 admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '990fa8e2-8f5c-4714-aa6e-d15bfa97b992') {} {{(pid=108542) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:06:15.625596 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95394e26-c1bc-45c9-a469-05e574648ca5 None None] Version for resource type Log changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:15.626662 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95394e26-c1bc-45c9-a469-05e574648ca5 None None] Version for resource type Network changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:15.626817 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95394e26-c1bc-45c9-a469-05e574648ca5 None None] Version for resource type Port changed None to 1.7 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:15.627126 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95394e26-c1bc-45c9-a469-05e574648ca5 None None] Version for resource type PortForwarding changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:15.627869 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95394e26-c1bc-45c9-a469-05e574648ca5 None None] Version for resource type QosPolicy changed None to 1.10 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:15.627869 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95394e26-c1bc-45c9-a469-05e574648ca5 None None] Version for resource type SecurityGroup changed None to 1.5 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:15.628092 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95394e26-c1bc-45c9-a469-05e574648ca5 None None] Version for resource type SecurityGroupRule changed None to 1.2 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:15.628393 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95394e26-c1bc-45c9-a469-05e574648ca5 None None] Version for resource type SubPort changed None to 1.0 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:15.628706 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95394e26-c1bc-45c9-a469-05e574648ca5 None None] Version for resource type Subnet changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:15.629034 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.callbacks.version_manager [None req-95394e26-c1bc-45c9-a469-05e574648ca5 None None] Version for resource type Trunk changed None to 1.1 on consumer Open vSwitch agent@dv-cinder-816324-1-iscsi {{(pid=108544) _set_version /opt/stack/neutron/neutron/api/rpc/callbacks/version_manager.py:113}} Nov 02 13:06:15.639600 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b9b1e698-946c-459a-a6a0-5c4f3ad89ff9 admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738449902583', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3344697'] for segment, before_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:15.658401 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b9b1e698-946c-459a-a6a0-5c4f3ad89ff9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:15.665395 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-b9b1e698-946c-459a-a6a0-5c4f3ad89ff9 admin admin] Releasing vlan 889 on physical network physnet1 to pool {{(pid=108542) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b9b1e698-946c-459a-a6a0-5c4f3ad89ff9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126476581'] for segment, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: Traceback (most recent call last): Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: timer() Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: cb(*args, **kw) Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: return func(*args, **kwargs) Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: self._notify() Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: self.callback(batched_events) Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: event.method(event) Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: aggregate_uuid = self.p_client.list_aggregates( Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: return f(self, *a, **k) Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: return self._get(url).json() Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: return self.request(url, 'GET', **kwargs) Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: base_url = self.get_endpoint(auth, allow=allow, Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 02 13:06:15.672027 dv-cinder-816324-1-iscsi neutron-server[108542]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 02 13:06:15.851761 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b9b1e698-946c-459a-a6a0-5c4f3ad89ff9 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-930976', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1594946'] for network, after_delete {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:15.857792 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron_lib.callbacks.manager [None req-b9b1e698-946c-459a-a6a0-5c4f3ad89ff9 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108542) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:15.861248 dv-cinder-816324-1-iscsi neutron-server[108542]: INFO neutron.wsgi [None req-b9b1e698-946c-459a-a6a0-5c4f3ad89ff9 admin admin] 10.222.0.98 "DELETE /v2.0/networks/547d6dbb-2ff3-449a-acfb-935d7f0325c4 HTTP/1.1" status: 204 len: 168 time: 0.9585989 Nov 02 13:06:15.864631 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 37442) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:06:15.879540 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-b9b1e698-946c-459a-a6a0-5c4f3ad89ff9 admin admin] Pushing event deleted for resources: {'Network': ['ID=547d6dbb-2ff3-449a-acfb-935d7f0325c4,revision_number=None']} {{(pid=108542) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:06:16.235755 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f1e80de9-9788-411b-9823-bb7365a080db admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cache_related_dvr_routers_info_before_interface_removal-1590128'] for router_interface, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:16.500372 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-f1e80de9-9788-411b-9823-bb7365a080db admin admin] Deleting port c24dc862-8075-4797-aa33-29a73025f1b7 {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:06:16.500624 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f1e80de9-9788-411b-9823-bb7365a080db admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:16.588641 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [None req-f1e80de9-9788-411b-9823-bb7365a080db admin admin] For port c24dc862-8075-4797-aa33-29a73025f1b7, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=c24dc862-8075-4797-aa33-29a73025f1b7,segment=NetworkSegment(4061b408-6fc7-4fc7-928c-ef9dfc54c821),segment_id=4061b408-6fc7-4fc7-928c-ef9dfc54c821)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:06:16.589005 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f1e80de9-9788-411b-9823-bb7365a080db admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:16.602792 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-f1e80de9-9788-411b-9823-bb7365a080db admin admin] Calling delete_port for c24dc862-8075-4797-aa33-29a73025f1b7 owned by network:router_interface {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:06:16.725304 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device c524c07f-371a-4ead-ad5f-25aa69583cc9 no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 13:06:16.746026 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: c524c07f-371a-4ead-ad5f-25aa69583cc9 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 13:06:16.746401 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device c524c07f-371a-4ead-ad5f-25aa69583cc9 not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 13:06:16.903112 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f1e80de9-9788-411b-9823-bb7365a080db admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:16.932536 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-f1e80de9-9788-411b-9823-bb7365a080db admin admin] Pushing event deleted for resources: {'Port': ['ID=c24dc862-8075-4797-aa33-29a73025f1b7,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:06:17.133488 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-f1e80de9-9788-411b-9823-bb7365a080db admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._after_router_interface_deleted-1649147', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._cleanup_after_interface_removal-1591488'] for router_interface, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:17.385288 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.scheduler.l3_agent_scheduler [None req-f1e80de9-9788-411b-9823-bb7365a080db admin admin] Router 625b8bfa-e779-4e0e-b6b7-0b10dadd40ba has already been hosted by L3 agent 7c2506b5-f202-419c-ba92-350963c5c4bc {{(pid=108543) _get_candidates /opt/stack/neutron/neutron/scheduler/l3_agent_scheduler.py:126}} Nov 02 13:06:17.517445 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-f1e80de9-9788-411b-9823-bb7365a080db admin admin] Notify agent at l3_agent.dv-cinder-816324-1-iscsi the message routers_updated {{(pid=108543) _agent_notification /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:65}} Nov 02 13:06:17.527018 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-f1e80de9-9788-411b-9823-bb7365a080db admin admin] 10.222.0.98 "PUT /v2.0/routers/625b8bfa-e779-4e0e-b6b7-0b10dadd40ba/remove_router_interface HTTP/1.1" status: 200 len: 503 time: 1.6589048 Nov 02 13:06:17.527433 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 37444) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:06:17.530778 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8aecb262-5db3-4fd0-aa08-914a8b005bdd None None] Sync routers for ids ['625b8bfa-e779-4e0e-b6b7-0b10dadd40ba'] in dv-cinder-816324-1-iscsi {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:125}} Nov 02 13:06:17.548348 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8aecb262-5db3-4fd0-aa08-914a8b005bdd None None] Routers {'625b8bfa-e779-4e0e-b6b7-0b10dadd40ba'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:06:17.549388 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-8aecb262-5db3-4fd0-aa08-914a8b005bdd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:05:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['625b8bfa-e779-4e0e-b6b7-0b10dadd40ba'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:06:17.700310 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-8aecb262-5db3-4fd0-aa08-914a8b005bdd None None] Set router 625b8bfa-e779-4e0e-b6b7-0b10dadd40ba gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:06:17.964200 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-071c8a98-5914-4c15-a842-6fcc80d675ac admin admin] Publish callbacks [] for router, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:18.013486 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-8aecb262-5db3-4fd0-aa08-914a8b005bdd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '625b8bfa-e779-4e0e-b6b7-0b10dadd40ba', 'name': 'tempest-TestMinimumBasicScenario-200701357-router', 'tenant_id': '6fe63572d2d044a3bd46527067b9a0e2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.185'}], 'enable_snat': True}, 'gw_port_id': 'c27080dd-3f5d-4572-a1ce-98f5b3c9fe74', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T13:03:52Z', 'updated_at': '2021-11-02T13:06:16Z', 'revision_number': 5, 'project_id': '6fe63572d2d044a3bd46527067b9a0e2', 'gw_port': {'id': 'c27080dd-3f5d-4572-a1ce-98f5b3c9fe74', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ef:2c:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '625b8bfa-e779-4e0e-b6b7-0b10dadd40ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:53Z', 'updated_at': '2021-11-02T13:04:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:06:18.060316 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8aecb262-5db3-4fd0-aa08-914a8b005bdd None None] Checking router: 625b8bfa-e779-4e0e-b6b7-0b10dadd40ba for host: dv-cinder-816324-1-iscsi {{(pid=108545) _ensure_host_set_on_ports /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:155}} Nov 02 13:06:18.077426 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvrscheduler_db [None req-8aecb262-5db3-4fd0-aa08-914a8b005bdd None None] Routers {'625b8bfa-e779-4e0e-b6b7-0b10dadd40ba'} bound to L3 agent in host dv-cinder-816324-1-iscsi {{(pid=108545) _get_router_ids_for_agent /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:420}} Nov 02 13:06:18.078735 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-8aecb262-5db3-4fd0-aa08-914a8b005bdd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method get_ha_sync_data_for_host called with arguments (, 'dv-cinder-816324-1-iscsi', Agent(admin_state_up=True,agent_type='L3 agent',availability_zone='nova',binary='neutron-l3-agent',configurations={"agent_mode": "legacy", "ex_gw_ports": 3, "extensions": [], "floating_ips": 1, "handle_internal_only_routers": true, "interface_driver": "openvswitch", "interfaces": 3, "log_agent_heartbeats": false, "routers": 3},created_at=2021-11-02T12:40:26Z,description=,heartbeat_timestamp=2021-11-02T13:05:56Z,host='dv-cinder-816324-1-iscsi',id=7c2506b5-f202-419c-ba92-350963c5c4bc,load=0,resource_versions=,resources_synced=,started_at=2021-11-02T12:40:26Z,topic='l3_agent')) {'router_ids': ['625b8bfa-e779-4e0e-b6b7-0b10dadd40ba'], 'active': True} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:06:18.148686 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-071c8a98-5914-4c15-a842-6fcc80d675ac admin admin] Publish callbacks [] for router_gateway, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:18.222659 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_dvr_db [None req-8aecb262-5db3-4fd0-aa08-914a8b005bdd None None] Set router 625b8bfa-e779-4e0e-b6b7-0b10dadd40ba gateway port host: dv-cinder-816324-1-iscsi {{(pid=108545) _build_routers_list /opt/stack/neutron/neutron/db/l3_dvr_db.py:906}} Nov 02 13:06:18.306795 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-071c8a98-5914-4c15-a842-6fcc80d675ac admin admin] Deleting port c27080dd-3f5d-4572-a1ce-98f5b3c9fe74 {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:06:18.307128 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-071c8a98-5914-4c15-a842-6fcc80d675ac admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:18.399776 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [None req-071c8a98-5914-4c15-a842-6fcc80d675ac admin admin] For port c27080dd-3f5d-4572-a1ce-98f5b3c9fe74, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=c27080dd-3f5d-4572-a1ce-98f5b3c9fe74,segment=NetworkSegment(64efaa63-f19c-4383-a10b-56b16f82f716),segment_id=64efaa63-f19c-4383-a10b-56b16f82f716)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:06:18.400284 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-071c8a98-5914-4c15-a842-6fcc80d675ac admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:18.421318 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-071c8a98-5914-4c15-a842-6fcc80d675ac admin admin] Calling delete_port for c27080dd-3f5d-4572-a1ce-98f5b3c9fe74 owned by network:router_gateway {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:06:18.427743 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.l3_hamode_db [None req-8aecb262-5db3-4fd0-aa08-914a8b005bdd None None] neutron.services.l3_router.l3_router_plugin.L3RouterPlugin method _process_sync_ha_data called with arguments (, [{'id': '625b8bfa-e779-4e0e-b6b7-0b10dadd40ba', 'name': 'tempest-TestMinimumBasicScenario-200701357-router', 'tenant_id': '6fe63572d2d044a3bd46527067b9a0e2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.185'}], 'enable_snat': True}, 'gw_port_id': 'c27080dd-3f5d-4572-a1ce-98f5b3c9fe74', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T13:03:52Z', 'updated_at': '2021-11-02T13:06:16Z', 'revision_number': 5, 'project_id': '6fe63572d2d044a3bd46527067b9a0e2', 'gw_port': {'id': 'c27080dd-3f5d-4572-a1ce-98f5b3c9fe74', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ef:2c:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '625b8bfa-e779-4e0e-b6b7-0b10dadd40ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:53Z', 'updated_at': '2021-11-02T13:04:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}], 'dv-cinder-816324-1-iscsi', False) {} {{(pid=108545) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:06:18.461772 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.api.rpc.handlers.l3_rpc [None req-8aecb262-5db3-4fd0-aa08-914a8b005bdd None None] The sync data for ids ['625b8bfa-e779-4e0e-b6b7-0b10dadd40ba'] in dv-cinder-816324-1-iscsi is: [{'id': '625b8bfa-e779-4e0e-b6b7-0b10dadd40ba', 'name': 'tempest-TestMinimumBasicScenario-200701357-router', 'tenant_id': '6fe63572d2d044a3bd46527067b9a0e2', 'admin_state_up': True, 'status': 'ACTIVE', 'external_gateway_info': {'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'external_fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.185'}], 'enable_snat': True}, 'gw_port_id': 'c27080dd-3f5d-4572-a1ce-98f5b3c9fe74', 'description': '', 'availability_zones': ['nova'], 'distributed': False, 'ha': False, 'ha_vr_id': 0, 'availability_zone_hints': [], 'routes': [], 'flavor_id': None, 'tags': [], 'created_at': '2021-11-02T13:03:52Z', 'updated_at': '2021-11-02T13:06:16Z', 'revision_number': 5, 'project_id': '6fe63572d2d044a3bd46527067b9a0e2', 'gw_port': {'id': 'c27080dd-3f5d-4572-a1ce-98f5b3c9fe74', 'name': '', 'network_id': '43464fa8-eb00-46fb-9ca0-be7342f9ddbf', 'tenant_id': '', 'mac_address': 'fa:16:3e:ef:2c:32', 'admin_state_up': True, 'status': 'ACTIVE', 'device_id': '625b8bfa-e779-4e0e-b6b7-0b10dadd40ba', 'device_owner': 'network:router_gateway', 'standard_attr_id': 689, 'fixed_ips': [{'subnet_id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'ip_address': '172.27.0.185', 'prefixlen': 24}], 'allowed_address_pairs': [], 'extra_dhcp_opts': [], 'security_groups': [], 'description': '', 'binding:vnic_type': 'normal', 'binding:profile': {}, 'binding:host_id': 'dv-cinder-816324-1-iscsi', 'binding:vif_type': 'ovs', 'binding:vif_details': {'connectivity': 'l2', 'port_filter': True, 'ovs_hybrid_plug': False, 'datapath_type': 'system', 'bridge_name': 'br-int'}, 'port_security_enabled': False, 'tags': [], 'created_at': '2021-11-02T13:03:53Z', 'updated_at': '2021-11-02T13:04:00Z', 'revision_number': 4, 'project_id': '', 'subnets': [{'id': '44a807bc-f2b6-41f0-b765-e5d3393fe305', 'cidr': '172.27.0.0/24', 'gateway_ip': '172.27.0.1', 'dns_nameservers': [], 'ipv6_ra_mode': None, 'subnetpool_id': None}], 'extra_subnets': [], 'address_scopes': {4: None, 6: None}, 'mtu': 1500}, 'enable_snat': True, 'gw_port_host': 'dv-cinder-816324-1-iscsi'}] {{(pid=108545) sync_routers /opt/stack/neutron/neutron/api/rpc/handlers/l3_rpc.py:137}} Nov 02 13:06:18.737624 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-071c8a98-5914-4c15-a842-6fcc80d675ac admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:18.777959 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-071c8a98-5914-4c15-a842-6fcc80d675ac admin admin] Pushing event deleted for resources: {'Port': ['ID=c27080dd-3f5d-4572-a1ce-98f5b3c9fe74,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:06:18.851844 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-071c8a98-5914-4c15-a842-6fcc80d675ac admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler._delete_dvr_internal_ports-1595046'] for router_gateway, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:18.952169 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device c24dc862-8075-4797-aa33-29a73025f1b7 no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 13:06:18.974817 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-071c8a98-5914-4c15-a842-6fcc80d675ac admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._release_router_vr_id-1593116', 'neutron.services.l3_router.service_providers.driver_controller.DriverController._clear_router_provider-25699'] for router, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:18.977675 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-071c8a98-5914-4c15-a842-6fcc80d675ac admin admin] Publish callbacks [] for router_controller, precommit_delete_associations {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:18.982238 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: c24dc862-8075-4797-aa33-29a73025f1b7 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 13:06:18.982738 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device c24dc862-8075-4797-aa33-29a73025f1b7 not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 13:06:19.068614 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-071c8a98-5914-4c15-a842-6fcc80d675ac admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_HA_NAT_db_mixin._cleanup_ha_network_handler-1593093'] for router, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:19.069198 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.agentnotifiers.l3_rpc_agent_api [None req-071c8a98-5914-4c15-a842-6fcc80d675ac admin admin] Fanout notify agent at l3_agent the message router_deleted on router 625b8bfa-e779-4e0e-b6b7-0b10dadd40ba {{(pid=108543) _notification_fanout /opt/stack/neutron/neutron/api/rpc/agentnotifiers/l3_rpc_agent_api.py:114}} Nov 02 13:06:19.074629 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-071c8a98-5914-4c15-a842-6fcc80d675ac admin admin] Publish callbacks [] for router, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:19.075814 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-071c8a98-5914-4c15-a842-6fcc80d675ac admin admin] 10.222.0.98 "DELETE /v2.0/routers/625b8bfa-e779-4e0e-b6b7-0b10dadd40ba HTTP/1.1" status: 204 len: 168 time: 1.5475655 Nov 02 13:06:19.079880 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 37446) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:06:19.133895 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.db_base_plugin_v2 [None req-fb247892-3a10-40b5-8e45-9f246656bac4 admin admin] Deleting subnet ef953611-234b-4101-b890-254859ae3613 {{(pid=108543) delete_subnet /opt/stack/neutron/neutron/db/db_base_plugin_v2.py:1059}} Nov 02 13:06:19.138074 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-fb247892-3a10-40b5-8e45-9f246656bac4 admin admin] Publish callbacks [] for subnet, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:19.179342 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-fb247892-3a10-40b5-8e45-9f246656bac4 admin admin] Publish callbacks ['neutron.services.segments.plugin.Plugin._validate_auto_address_subnet_delete-3308629'] for subnet, precommit_delete_associations {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:19.281875 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-fb247892-3a10-40b5-8e45-9f246656bac4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_precommit_handler-933154'] for subnet, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:19.428875 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-fb247892-3a10-40b5-8e45-9f246656bac4 admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._subnet_delete_after_delete_handler-933141', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2038843', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_subnet_deleted-126393134', 'neutron.services.segments.plugin.SegmentHostRoutes.host_routes_after_delete-126244844'] for subnet, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:19.455838 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-fb247892-3a10-40b5-8e45-9f246656bac4 admin admin] Pushing event deleted for resources: {'Subnet': ['ID=ef953611-234b-4101-b890-254859ae3613,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:06:19.459430 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-fb247892-3a10-40b5-8e45-9f246656bac4 admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for subnet, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:19.463092 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-fb247892-3a10-40b5-8e45-9f246656bac4 admin admin] 10.222.0.98 "DELETE /v2.0/subnets/ef953611-234b-4101-b890-254859ae3613 HTTP/1.1" status: 204 len: 168 time: 0.3819320 Nov 02 13:06:19.465283 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 37448) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:06:19.466229 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-b68306c4-a9d3-405b-9425-0a8c1e77575e None None] Network 91dd6799-b00d-4e11-9a1f-9e1f44d1d95d requested from dv-cinder-816324-1-iscsi {{(pid=108544) get_network_info /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:218}} Nov 02 13:06:19.555954 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bdfc5475-aeb8-4677-bcb1-3d289ac7488c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.External_net_db_mixin._before_network_delete_handler-972735'] for network, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:19.636884 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-bdfc5475-aeb8-4677-bcb1-3d289ac7488c admin admin] Deleting port aff253af-d893-42ac-bd26-211a5721f3aa {{(pid=108543) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:06:19.637291 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bdfc5475-aeb8-4677-bcb1-3d289ac7488c admin admin] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:19.691803 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.dhcp_rpc [None req-2d7a4b20-ee1d-44ed-b474-cb4a6b82139a None None] DHCP port deletion for 91dd6799-b00d-4e11-9a1f-9e1f44d1d95d request from dv-cinder-816324-1-iscsi {{(pid=108544) release_dhcp_port /opt/stack/neutron/neutron/api/rpc/handlers/dhcp_rpc.py:266}} Nov 02 13:06:19.719546 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.db [None req-bdfc5475-aeb8-4677-bcb1-3d289ac7488c admin admin] For port aff253af-d893-42ac-bd26-211a5721f3aa, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=aff253af-d893-42ac-bd26-211a5721f3aa,segment=NetworkSegment(4061b408-6fc7-4fc7-928c-ef9dfc54c821),segment_id=4061b408-6fc7-4fc7-928c-ef9dfc54c821)] {{(pid=108543) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:06:19.720020 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bdfc5475-aeb8-4677-bcb1-3d289ac7488c admin admin] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:19.734213 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.plugin [None req-bdfc5475-aeb8-4677-bcb1-3d289ac7488c admin admin] Calling delete_port for aff253af-d893-42ac-bd26-211a5721f3aa owned by network:dhcp {{(pid=108543) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:06:19.745490 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-2d7a4b20-ee1d-44ed-b474-cb4a6b82139a None None] Deleting port aff253af-d893-42ac-bd26-211a5721f3aa {{(pid=108544) _pre_delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:1934}} Nov 02 13:06:19.745933 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-2d7a4b20-ee1d-44ed-b474-cb4a6b82139a None None] Publish callbacks ['neutron.db.l3_db.L3_NAT_dbonly_mixin._prevent_l3_port_delete_callback-8738449820793'] for port, before_delete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:19.815583 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.db [None req-2d7a4b20-ee1d-44ed-b474-cb4a6b82139a None None] For port aff253af-d893-42ac-bd26-211a5721f3aa, host dv-cinder-816324-1-iscsi, got binding levels [PortBindingLevel(driver='openvswitch',host='dv-cinder-816324-1-iscsi',level=0,port_id=aff253af-d893-42ac-bd26-211a5721f3aa,segment=NetworkSegment(4061b408-6fc7-4fc7-928c-ef9dfc54c821),segment_id=4061b408-6fc7-4fc7-928c-ef9dfc54c821)] {{(pid=108544) get_binding_level_objs /opt/stack/neutron/neutron/plugins/ml2/db.py:74}} Nov 02 13:06:19.816245 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-2d7a4b20-ee1d-44ed-b474-cb4a6b82139a None None] Publish callbacks ['neutron.services.l3_router.l3_router_plugin.L3_NAT_dbonly_mixin._precommit_delete_port_callback-1604818'] for port, precommit_delete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:19.834047 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-2d7a4b20-ee1d-44ed-b474-cb4a6b82139a None None] Calling delete_port for aff253af-d893-42ac-bd26-211a5721f3aa owned by network:dhcp {{(pid=108544) delete_port /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2012}} Nov 02 13:06:19.891551 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bdfc5475-aeb8-4677-bcb1-3d289ac7488c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_port_created_or_deleted-126393841'] for port, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:19.917918 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdfc5475-aeb8-4677-bcb1-3d289ac7488c admin admin] Pushing event deleted for resources: {'Port': ['ID=aff253af-d893-42ac-bd26-211a5721f3aa,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:06:19.918194 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-2d7a4b20-ee1d-44ed-b474-cb4a6b82139a None None] Publish callbacks ['neutron.plugins.ml2.plugin.SecurityGroupServerNotifierRpcMixin._notify_sg_on_port_change-941616', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-71643', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.db.l3_db.L3RpcNotifierMixin._notify_routers_callback-8738449974083', 'neutron.db.l3_dvrscheduler_db._notify_port_delete-8738449414678'] for port, after_delete {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:19.921653 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.db.l3_dvrscheduler_db [None req-bdfc5475-aeb8-4677-bcb1-3d289ac7488c admin admin] No DVR routers for this DVR port aff253af-d893-42ac-bd26-211a5721f3aa on host dv-cinder-816324-1-iscsi {{(pid=108543) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 13:06:19.946010 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-2d7a4b20-ee1d-44ed-b474-cb4a6b82139a None None] Pushing event deleted for resources: {'Port': ['ID=aff253af-d893-42ac-bd26-211a5721f3aa,revision_number=None']} {{(pid=108544) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:06:19.949604 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.db.l3_dvrscheduler_db [None req-2d7a4b20-ee1d-44ed-b474-cb4a6b82139a None None] No DVR routers for this DVR port aff253af-d893-42ac-bd26-211a5721f3aa on host dv-cinder-816324-1-iscsi {{(pid=108544) get_dvr_routers_to_remove /opt/stack/neutron/neutron/db/l3_dvrscheduler_db.py:214}} Nov 02 13:06:20.007233 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bdfc5475-aeb8-4677-bcb1-3d289ac7488c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_precommit_handler-930985', 'neutron.services.segments.db._delete_segments_for_network-8738449897966'] for network, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:20.031812 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.services.segments.db [None req-bdfc5475-aeb8-4677-bcb1-3d289ac7488c admin admin] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['91dd6799-b00d-4e11-9a1f-9e1f44d1d95d']}} {{(pid=108543) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:06:20.043536 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.services.segments.db [None req-bdfc5475-aeb8-4677-bcb1-3d289ac7488c admin admin] neutron.services.segments.plugin.Plugin method delete_segment called with arguments (, '4061b408-6fc7-4fc7-928c-ef9dfc54c821') {'for_net_delete': True} {{(pid=108543) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:06:20.043829 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.services.segments.db [None req-bdfc5475-aeb8-4677-bcb1-3d289ac7488c admin admin] neutron.services.segments.plugin.Plugin method get_segment called with arguments (, '4061b408-6fc7-4fc7-928c-ef9dfc54c821') {} {{(pid=108543) wrapper /usr/local/lib/python3.8/dist-packages/oslo_log/helpers.py:65}} Nov 02 13:06:20.054818 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bdfc5475-aeb8-4677-bcb1-3d289ac7488c admin admin] Publish callbacks ['neutron.plugins.ml2.db._prevent_segment_delete_with_port_bound-8738449902583', 'neutron.services.segments.plugin.Plugin._prevent_segment_delete_with_subnet_associated-3308610'] for segment, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:20.070506 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bdfc5475-aeb8-4677-bcb1-3d289ac7488c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697'] for segment, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:20.077285 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.plugins.ml2.drivers.type_vlan [None req-bdfc5475-aeb8-4677-bcb1-3d289ac7488c admin admin] Releasing vlan 876 on physical network physnet1 to pool {{(pid=108543) release_segment /opt/stack/neutron/neutron/plugins/ml2/drivers/type_vlan.py:304}} Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bdfc5475-aeb8-4677-bcb1-3d289ac7488c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._handle_segment_change-969697', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_segment_deleted-126393740'] for segment, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: Traceback (most recent call last): Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: timer() Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: cb(*args, **kw) Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/common/utils.py", line 914, in wrapper Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: return func(*args, **kwargs) Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 58, in synced_send Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: self._notify() Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/notifiers/batch_notifier.py", line 69, in _notify Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: self.callback(batched_events) Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 211, in _send_notifications Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: event.method(event) Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 383, in _delete_nova_inventory Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: aggregate_id = self._get_aggregate_id(event.segment_id) Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/opt/stack/neutron/neutron/services/segments/plugin.py", line 370, in _get_aggregate_id Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: aggregate_uuid = self.p_client.list_aggregates( Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 58, in wrapper Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: return f(self, *a, **k) Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 554, in list_aggregates Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: return self._get(url).json() Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/neutron_lib/placement/client.py", line 190, in _get Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: return self._client.get(url, endpoint_filter=self._ks_filter, Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1141, in get Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: return self.request(url, 'GET', **kwargs) Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 811, in request Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: base_url = self.get_endpoint(auth, allow=allow, Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1241, in get_endpoint Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: auth = self._auth_required(auth, 'determine endpoint URL') Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: File "/usr/local/lib/python3.8/dist-packages/keystoneauth1/session.py", line 1181, in _auth_required Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: raise exceptions.MissingAuthPlugin(msg_fmt % msg) Nov 02 13:06:20.086118 dv-cinder-816324-1-iscsi neutron-server[108543]: keystoneauth1.exceptions.auth_plugins.MissingAuthPlugin: An auth plugin is required to determine endpoint URL Nov 02 13:06:20.223496 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bdfc5475-aeb8-4677-bcb1-3d289ac7488c admin admin] Publish callbacks ['neutron.plugins.ml2.plugin.Ml2Plugin._network_delete_after_delete_handler-930976', 'neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062534', 'neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._native_event_send_dhcp_notification-1649026', 'neutron.services.l3_router.l3_router_plugin.DVRResourceOperationHandler.delete_fip_namespaces_for_ext_net-1594946'] for network, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:20.229331 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-bdfc5475-aeb8-4677-bcb1-3d289ac7488c admin admin] Publish callbacks ['neutron.api.rpc.agentnotifiers.dhcp_rpc_agent_api.DhcpAgentNotifyAPI._send_dhcp_notification-1649044'] for network, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:20.232543 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-bdfc5475-aeb8-4677-bcb1-3d289ac7488c admin admin] 10.222.0.98 "DELETE /v2.0/networks/91dd6799-b00d-4e11-9a1f-9e1f44d1d95d HTTP/1.1" status: 204 len: 168 time: 0.7662849 Nov 02 13:06:20.244280 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-bdfc5475-aeb8-4677-bcb1-3d289ac7488c admin admin] Pushing event deleted for resources: {'Network': ['ID=91dd6799-b00d-4e11-9a1f-9e1f44d1d95d,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:06:20.617148 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 37452) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:06:20.667258 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-0108d157-329c-4007-8dc2-446d772c6f6e admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=36f51757702242e8b1343954aa4f93fe&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0487788 Nov 02 13:06:20.671185 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 37454) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:06:20.738459 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-261750ea-a205-44a3-92b7-512069c0613f admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:20.746122 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device c27080dd-3f5d-4572-a1ce-98f5b3c9fe74 no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 13:06:20.763089 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-261750ea-a205-44a3-92b7-512069c0613f admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:20.767998 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: c27080dd-3f5d-4572-a1ce-98f5b3c9fe74 {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 13:06:20.768258 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device c27080dd-3f5d-4572-a1ce-98f5b3c9fe74 not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 13:06:20.768666 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device aff253af-d893-42ac-bd26-211a5721f3aa no longer exists at agent ovs-agent-dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:259}} Nov 02 13:06:20.789019 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.plugin [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] No Port match for: aff253af-d893-42ac-bd26-211a5721f3aa {{(pid=108544) port_bound_to_host /opt/stack/neutron/neutron/plugins/ml2/plugin.py:2270}} Nov 02 13:06:20.789360 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron.plugins.ml2.rpc [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Device aff253af-d893-42ac-bd26-211a5721f3aa not bound to the agent host dv-cinder-816324-1-iscsi {{(pid=108544) update_device_down /opt/stack/neutron/neutron/plugins/ml2/rpc.py:269}} Nov 02 13:06:20.941886 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-261750ea-a205-44a3-92b7-512069c0613f admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:20.944518 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-261750ea-a205-44a3-92b7-512069c0613f admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:20.945678 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-261750ea-a205-44a3-92b7-512069c0613f admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/6433fe5c-a062-47c1-827b-d94e9e3b8866 HTTP/1.1" status: 204 len: 168 time: 0.2732205 Nov 02 13:06:20.954354 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-261750ea-a205-44a3-92b7-512069c0613f admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=6433fe5c-a062-47c1-827b-d94e9e3b8866,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:06:21.735643 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 37460) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:06:21.777470 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-f7784325-f04b-45ab-a905-5b708531e72a admin admin] 10.222.0.98 "GET /v2.0/security-groups?tenant_id=6fe63572d2d044a3bd46527067b9a0e2&name=default HTTP/1.1" status: 200 len: 2996 time: 0.0405347 Nov 02 13:06:21.780140 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [-] (108543) accepted ('10.222.0.98', 37462) {{(pid=108543) server /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:982}} Nov 02 13:06:21.834500 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-547276ea-dff0-40e2-91e8-9f8ba345e624 admin admin] Publish callbacks [] for security_group, before_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:21.861224 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-547276ea-dff0-40e2-91e8-9f8ba345e624 admin admin] Publish callbacks [] for security_group, precommit_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:22.022657 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-547276ea-dff0-40e2-91e8-9f8ba345e624 admin admin] Publish callbacks ['neutron.plugins.ml2.ovo_rpc._ObjectChangeHandler.handle_event-2062383'] for security_group, after_delete {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:22.025327 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron_lib.callbacks.manager [None req-547276ea-dff0-40e2-91e8-9f8ba345e624 admin admin] Publish callbacks [] for security_group, before_response {{(pid=108543) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:22.026524 dv-cinder-816324-1-iscsi neutron-server[108543]: INFO neutron.wsgi [None req-547276ea-dff0-40e2-91e8-9f8ba345e624 admin admin] 10.222.0.98 "DELETE /v2.0/security-groups/2be15f32-525c-4285-883a-0b30795d0a07 HTTP/1.1" status: 204 len: 168 time: 0.2453372 Nov 02 13:06:22.035338 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.api.rpc.handlers.resources_rpc [None req-547276ea-dff0-40e2-91e8-9f8ba345e624 admin admin] Pushing event deleted for resources: {'SecurityGroup': ['ID=2be15f32-525c-4285-883a-0b30795d0a07,revision_number=None']} {{(pid=108543) push /opt/stack/neutron/neutron/api/rpc/handlers/resources_rpc.py:237}} Nov 02 13:06:23.531272 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0793f34a-d965-4d3b-9712-653a8977804c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:25.708537 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-3978dbb8-5e7e-4e6c-87c8-ae397a28f824 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:26.914129 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:28.479704 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:30.862350 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:33.531035 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:38.468546 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 13:06:49.205781 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [req-99670f5b-5306-4584-9f12-51c810ec8889 req-0b672293-5b98-446b-b757-e21fc47771ad service neutron] (108543) timed out ('10.222.0.90', 58467) {{(pid=108543) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 02 13:06:53.496509 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-602b2ffc-807e-485e-bbd0-3047a7fcdab5 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:55.730127 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-d40b5f50-1751-43af-80a4-39d7ca7afda1 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:56.907343 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:06:58.438072 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:07:00.827021 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:07:03.495463 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:07:15.466980 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 13:07:23.506393 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-bcd58e9f-8c0c-4a86-885a-6dc2a362c21e None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:07:23.617530 dv-cinder-816324-1-iscsi neutron-server[108543]: DEBUG neutron.wsgi [req-0ab60ff8-a7a9-44cb-b634-35a052ced496 req-3fc58bc3-32d9-4849-af7b-938c7ed1aea3 tempest-ServerRescueNegativeTestJSON-483186410 tempest-ServerRescueNegativeTestJSON-483186410-project] (108543) timed out ('10.222.0.90', 58461) {{(pid=108543) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 02 13:07:24.458099 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [req-f97adaca-894d-4244-8e8b-dc43708966fe req-fac5081a-ee35-4ec0-9ac2-7be9fb52f020 service neutron] (108542) timed out ('10.222.0.98', 59210) {{(pid=108542) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 02 13:07:25.643254 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-00373fe3-17d9-4a2e-b682-ac4b1619f742 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:07:26.912073 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:07:28.471900 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:07:30.837788 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:07:33.563133 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:07:52.465443 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 13:07:53.505482 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-53600e02-f28d-4ade-971a-4e54427b6f09 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:07:55.654071 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-10343928-d619-4f2c-8429-0f127d9f9a13 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:07:56.905388 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:07:58.472326 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:08:00.853843 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:08:03.522871 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:08:23.504259 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5d789c7d-a9e3-4a74-9bce-890b5e99a0e2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:08:25.647756 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-d5f5405c-aaa5-4bdd-9011-85a5213a9abf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:08:26.916329 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:08:28.459402 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:08:29.464981 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 13:08:30.806976 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:08:33.522153 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:08:53.503576 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-dac38d81-215a-458d-9154-cc0922aa859d None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:08:55.669066 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-8cfb2dea-674b-4851-a653-9c74b0c10faf None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:08:56.915188 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:08:58.457322 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:09:00.800426 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:09:03.526297 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:09:06.464457 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 13:09:23.508759 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-3082ca89-b152-4996-83cb-096ee087bb27 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:09:25.674122 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-66fc3cb3-99ac-4d47-825b-2a2441264ce7 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:09:26.937309 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:09:28.451620 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:09:30.834010 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:09:33.553770 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:09:43.465050 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 13:09:53.558810 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-7ef7fb6f-3f51-4936-8308-a200a5e63b8f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:09:55.707656 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-b76853ba-b5ff-44a5-8fc1-cdc4498e268b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:09:56.982155 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:09:58.439540 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:10:00.838781 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:10:03.565083 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:10:20.471446 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 13:10:23.512906 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-52f33de0-caa4-4e6f-b2f1-eb82f7ae9d77 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:10:25.690384 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-b5103bcc-cb31-4584-bd13-646b3f513f6c None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:10:27.015501 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:10:28.562705 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:10:30.838301 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:10:33.563838 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:10:53.508217 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-167751a2-f20f-4941-8134-ad52ae635d7b None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:10:55.689771 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-cea4332a-a855-4bcd-86f6-a02c17342235 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:10:56.957249 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:10:57.475445 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}} Nov 02 13:10:58.460294 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:10:59.033835 dv-cinder-816324-1-iscsi neutron-server[108542]: DEBUG neutron.wsgi [req-107718ff-b5dd-4ef6-aabe-0d49aef068a4 req-869d0023-55b3-4f88-9069-05d422099d49 service neutron] (108542) timed out ('10.222.0.98', 34104) {{(pid=108542) process_request /usr/local/lib/python3.8/dist-packages/eventlet/wsgi.py:820}} Nov 02 13:11:00.860876 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:11:03.569184 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:11:23.551281 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-2a6cadc1-66be-4985-bc53-2de5af25bbb2 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:11:25.694083 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33a3e43e-3ffb-42bb-81b8-62afe88979fc None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:11:26.956777 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-0dfcc689-2901-4f86-94b3-e911bf614ebd None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:11:28.471750 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-5de00494-d36d-4f2d-bc4e-30126a21b432 None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:11:30.876988 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-33e4c069-8287-4f71-9fff-0f26e165dbec None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:11:33.613395 dv-cinder-816324-1-iscsi neutron-server[108544]: DEBUG neutron_lib.callbacks.manager [None req-1fdc0491-f740-4754-a044-bac000e8080f None None] Publish callbacks ['neutron.services.segments.db._update_segment_host_mapping_for_agent-8738449897948', 'neutron.plugins.ml2.plugin.Ml2Plugin._retry_binding_revived_agents-930147'] for agent, after_update {{(pid=108544) _notify_loop /usr/local/lib/python3.8/dist-packages/neutron_lib/callbacks/manager.py:175}} Nov 02 13:11:34.480894 dv-cinder-816324-1-iscsi neutron-server[108545]: DEBUG neutron.db.agents_db [None req-f1d85b2b-9c8c-4823-837d-462bf4fad693 None None] Agent healthcheck: found 6 active agents {{(pid=108545) agent_health_check /opt/stack/neutron/neutron/db/agents_db.py:317}}